Aug 10 12:40:12 devstack cinder-volume[78028]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 10 12:40:12 devstack cinder-volume[78028]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 10 12:40:12 devstack cinder-volume[78028]: we strongly recommend against using it for new projects. Aug 10 12:40:12 devstack cinder-volume[78028]: If you are already using Eventlet, we recommend migrating to a different Aug 10 12:40:12 devstack cinder-volume[78028]: framework. For more detail see Aug 10 12:40:12 devstack cinder-volume[78028]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 10 12:40:12 devstack cinder-volume[78028]: import eventlet # noqa Aug 10 12:40:15 devstack cinder-volume[78028]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=78028) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 10 12:40:15 devstack cinder-volume[78028]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=78028) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 10 12:40:15 devstack cinder-volume[78028]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=78028) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 10 12:40:16 devstack cinder-volume[78028]: INFO dbcounter [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] Registered counter for database cinder Aug 10 12:40:16 devstack cinder-volume[78028]: DEBUG oslo_db.sqlalchemy.engines [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78028) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 10 12:40:16 devstack cinder-volume[78028]: DEBUG dbcounter [-] [78028] Writer thread running {{(pid=78028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 10 12:40:16 devstack cinder-volume[78028]: INFO cinder.rpc [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 10 12:40:16 devstack cinder-volume[78028]: INFO cinder.rpc [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 10 12:40:16 devstack cinder-volume[78028]: DEBUG oslo_db.sqlalchemy.engines [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78028) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 10 12:40:16 devstack cinder-volume[78028]: INFO cinder.volume.manager [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] Determined volume DB was empty at startup. Aug 10 12:40:16 devstack cinder-volume[78028]: DEBUG cinder.volume.manager [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=78028) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 10 12:40:16 devstack cinder-volume[78028]: INFO cinder.volume.manager [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 10 12:40:16 devstack cinder-volume[78028]: WARNING stevedore.named [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 10 12:40:16 devstack cinder-volume[78028]: WARNING castellan.key_manager [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 10 12:40:16 devstack cinder-volume[78028]: WARNING cinder.keymgr.conf_key_mgr [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 10 12:40:16 devstack cinder-volume[78028]: DEBUG cinder.volume.drivers.lvm [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=78028) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Aug 10 12:40:16 devstack cinder-volume[78028]: DEBUG oslo_concurrency.processutils [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=78028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_concurrency.processutils [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] CMD "cinder-rtstool verify" returned: 0 in 0.479s {{(pid=78028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_db.sqlalchemy.engines [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78028) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 10 12:40:17 devstack cinder-volume[78028]: INFO cinder.rpc [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 10 12:40:17 devstack cinder-volume[78028]: INFO cinder.rpc [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Aug 10 12:40:17 devstack cinder-volume[78028]: WARNING stevedore.named [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 10 12:40:17 devstack cinder-volume[78028]: WARNING castellan.key_manager [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 10 12:40:17 devstack cinder-volume[78028]: INFO cinder.volume.manager [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] Image-volume cache enabled for host devstack@lvmdriver-1. Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_db.sqlalchemy.engines [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78028) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 10 12:40:17 devstack cinder-volume[78028]: INFO oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] Starting 1 workers Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] Started child 78218 {{(pid=78028) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] Full set of CONF: {{(pid=78028) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] ******************************************************************************** {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] Configuration options gathered from: {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] ================================================================================ {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] allow_availability_zone_fallback = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] allow_compression_on_image_upload = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] allowed_direct_url_schemes = [] {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] api_rate_limit = True {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78218]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] auth_strategy = keystone {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] az_cache_duration = 3600 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_availability_zone = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_host = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_name = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_stats_polling_interval = 60 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backup_api_class = cinder.backup.api.API {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backup_name_template = backup-%s {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backup_use_same_host = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backup_use_temp_snapshot = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] chap_password = **** {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] chap_username = {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cinder_internal_tenant_project_id = ea84f4a607c841beacde60600ce5c17e {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cinder_internal_tenant_user_id = 3eb77fdd72604c27a77d80086e2fd98c {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cloned_volume_same_az = True {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cluster = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] compression_format = gzip {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] compute_api_class = cinder.compute.nova.API {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] config_dir = [] {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] config_source = [] {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] control_exchange = openstack {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] debug = True {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] default_availability_zone = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] default_group_type = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] default_volume_type = lvmdriver-1 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] disk_geometry = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] driver_client_cert = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] driver_client_cert_key = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] driver_data_namespace = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] driver_ssl_cert_path = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] driver_ssl_cert_verify = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] driver_use_ssl = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] enable_force_upload = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] enable_new_services = True {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] enable_unsupported_driver = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] enabled_backends = ['lvmdriver-1'] {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] enforce_multipath_for_image_xfer = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] filter_function = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] glance_api_insecure = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] glance_api_servers = ['http://192.168.122.96/image'] {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] glance_api_ssl_compression = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] glance_ca_certificates_file = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] glance_catalog_info = image:glance:publicURL {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] glance_certfile = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] glance_keyfile = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] glance_num_retries = 3 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] glance_request_timeout = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] goodness_function = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] graceful_shutdown_timeout = 5 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] group_api_class = cinder.group.api.API {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] host = devstack {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] image_compress_on_upload = True {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] image_conversion_address_space_limit = 1 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] image_conversion_cpu_limit = 60 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] image_conversion_disable = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] image_upload_use_cinder_backend = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] image_upload_use_internal_tenant = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] image_volume_cache_enabled = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] image_volume_cache_max_count = 0 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] image_volume_cache_max_size_gb = 0 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] init_host_max_objects_retrieval = 0 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] instance_format = [instance: %(uuid)s] {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] iscsi_target_flags = {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] iscsi_write_cache = on {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] iser_helper = tgtadm {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] iser_ip_address = 192.168.122.96 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] iser_port = 3260 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] log_color = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] log_config_append = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] log_dir = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] log_file = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] log_options = True {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] log_rotate_interval = 1 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] log_rotate_interval_type = days {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] log_rotation_type = none {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] max_age = 0 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] max_logfile_count = 30 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] max_logfile_size_mb = 200 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] max_over_subscription_ratio = 20.0 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78218]: INFO cinder.volume.manager [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Starting volume driver LVMVolumeDriver (3.0.0) Aug 10 12:40:17 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] message_reap_interval = 86400 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] message_ttl = 2592000 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] migration_create_volume_timeout_secs = 300 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] monkey_patch = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] monkey_patch_modules = [] {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] my_ip = 192.168.122.96 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] no_snapshot_gb_quota = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] num_iser_scan_tries = 3 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] num_shell_tries = 3 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] num_volume_device_scan_tries = 3 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] nvmeof_conn_info_version = 1 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] nvmet_ns_id = 10 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] nvmet_port_id = 1 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] osapi_max_limit = 1000 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] osapi_volume_ext_list = [] {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] osapi_volume_listen = 0.0.0.0 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] osapi_volume_listen_port = 8776 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] osapi_volume_use_ssl = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] osapi_volume_workers = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] per_volume_size_limit = -1 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] periodic_fuzzy_delay = 60 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] periodic_interval = 60 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] project_id_regex = [0-9a-f\-]+ {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] public_endpoint = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] publish_errors = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] quota_backup_gigabytes = 1000 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] quota_backups = 10 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] quota_gigabytes = 1000 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] quota_groups = 10 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] quota_snapshots = 10 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] quota_volumes = 10 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] rate_limit_burst = 0 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] rate_limit_except_level = CRITICAL {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] rate_limit_interval = 0 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] reinit_driver_count = 3 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] replication_device = **** {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] report_discard_supported = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] report_interval = 120 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] reservation_clean_interval = 86400 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] reservation_expire = 86400 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] reserved_image_namespaces = [] {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] reserved_percentage = 0 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] rpc_response_timeout = 120 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] run_external_periodic_tasks = True {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] scst_target_driver = iscsi {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] scst_target_iqn_name = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] service_down_time = 720 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] shell_completion = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] snapshot_name_template = snapshot-%s {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] snapshot_same_host = True {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] split_loggers = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] state_path = /opt/stack/data/cinder {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] storage_availability_zone = nova {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] storage_protocol = iSCSI {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] syslog_log_facility = LOG_USER {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] target_helper = lioadm {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] target_ip_address = 192.168.122.96 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] target_port = 3260 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] target_protocol = iscsi {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] target_secondary_ip_addresses = [] {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] trace_flags = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] transfer_api_class = cinder.transfer.api.API {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] transport_url = **** {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] until_refresh = 0 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] use_chap_auth = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] use_default_quota_class = True {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] use_journal = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] use_json = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] use_multipath_for_image_xfer = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] use_stderr = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] use_syslog = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] verify_glance_signatures = enabled {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] volume_api_class = cinder.volume.api.API {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] volume_backend_name = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] volume_clear = zero {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] volume_clear_ionice = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] volume_clear_size = 0 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] volume_copy_bps_limit = 0 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] volume_dd_blocksize = 1M {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] volume_name_template = volume-%s {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] volume_service_inithost_offload = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] volume_usage_audit_period = month {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] zoning_mode = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_concurrency.disable_process_locking = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] keystone_authtoken.auth_section = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] keystone_authtoken.auth_type = password {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] keystone_authtoken.auth_version = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] keystone_authtoken.cache = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] keystone_authtoken.certfile = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] keystone_authtoken.delay_auth_decision = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] keystone_authtoken.http_connect_timeout = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] keystone_authtoken.include_service_catalog = True {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] keystone_authtoken.insecure = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] keystone_authtoken.interface = public {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] keystone_authtoken.keyfile = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] keystone_authtoken.memcache_password = {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.051s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] keystone_authtoken.memcache_username = {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] keystone_authtoken.region_name = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] keystone_authtoken.service_token_roles_required = True {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] keystone_authtoken.service_type = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] keystone_authtoken.token_cache_time = 300 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.96/identity {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cache.backend = dogpile.cache.null {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cache.backend_argument = **** {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cache.backend_expiration_time = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cache.config_prefix = cache.oslo {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cache.debug_cache_backend = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cache.enable_retry_client = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cache.enable_socket_keepalive = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cache.enabled = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cache.expiration_time = 600 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cache.hashclient_dead_timeout = 60.0 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cache.hashclient_retry_attempts = 2 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cache.memcache_dead_retry = 300 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cache.memcache_pool_maxsize = 10 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cache.memcache_sasl_enabled = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cache.memcache_servers = ['localhost:11211'] {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cache.password = **** {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cache.proxies = [] {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cache.redis_db = 0 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cache.redis_sentinel_service_name = mymaster {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cache.redis_server = localhost:6379 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cache.retry_attempts = 2 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cache.retry_delay = 0.0 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cache.socket_keepalive_count = 1 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cache.socket_keepalive_idle = 1 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cache.socket_keepalive_interval = 1 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cache.socket_timeout = 1.0 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cache.tls_allowed_ciphers = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cache.tls_cafile = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cache.tls_certfile = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cache.tls_enabled = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cache.tls_keyfile = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cache.username = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] coordination.backend_url = **** {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] database.asyncio_connection = **** {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] database.asyncio_slave_connection = **** {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] database.backend = sqlalchemy {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] database.connection = **** {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] database.connection_debug = 0 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] database.connection_parameters = {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] database.connection_recycle_time = 3600 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] database.connection_trace = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] database.db_inc_retry_interval = True {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] database.db_max_retries = 20 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] database.db_max_retry_interval = 10 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] database.db_retry_interval = 1 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] database.max_overflow = 50 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] database.max_pool_size = 5 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] database.max_retries = 10 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] database.mysql_sql_mode = TRADITIONAL {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] database.mysql_wsrep_sync_wait = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] database.pool_timeout = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] database.retry_interval = 10 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] database.slave_connection = **** {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] database.sqlite_synchronous = True {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] database.synchronous_reader = True {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] database.use_db_reconnect = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_metrics.metrics_process_name = {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] profiler.connection_string = messaging:// {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] profiler.enabled = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] profiler.es_doc_type = notification {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] profiler.es_scroll_size = 10000 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] profiler.es_scroll_time = 2m {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] profiler.filter_error_trace = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] profiler.hmac_keys = **** {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] profiler.sentinel_service_name = mymaster {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] profiler.socket_timeout = 0.1 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] profiler.trace_requests = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] profiler.trace_sqlalchemy = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] profiler_jaeger.process_tags = {} {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] profiler_jaeger.service_name_prefix = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] profiler_otlp.service_name_prefix = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_policy.enforce_new_defaults = True {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_policy.policy_default_rule = default {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_policy.policy_file = policy.yaml {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_policy.remote_timeout = 60.0 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] privsep_osbrick.capabilities = [21, 2] {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] privsep_osbrick.group = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] privsep_osbrick.helper_command = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack sudo[78240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Aug 10 12:40:17 devstack sudo[78240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] privsep_osbrick.user = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cinder_sys_admin.group = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cinder_sys_admin.helper_command = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] cinder_sys_admin.user = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] service_user.auth_section = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] service_user.auth_type = password {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] service_user.cafile = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] service_user.certfile = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] service_user.collect_timing = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] service_user.insecure = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] service_user.keyfile = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] service_user.send_service_user_token = True {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] service_user.split_loggers = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] service_user.timeout = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] glance.auth_section = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] glance.auth_type = password {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] glance.certfile = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] glance.collect_timing = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] glance.insecure = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] glance.keyfile = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] glance.region_name = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] glance.split_loggers = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] glance.timeout = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.backend_availability_zone = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.chap_password = **** {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.chap_username = {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.disk_geometry = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.driver_client_cert = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.driver_client_cert_key = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.driver_data_namespace = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.driver_use_ssl = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.enable_unsupported_driver = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.extra_capabilities = {} {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.filter_function = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.goodness_function = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.iscsi_target_flags = {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.iscsi_write_cache = on {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.iser_helper = tgtadm {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.iser_ip_address = 192.168.122.96 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.iser_port = 3260 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.lvm_mirrors = 0 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.lvm_share_target = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.lvm_type = auto {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.num_shell_tries = 3 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.nvmet_ns_id = 10 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.nvmet_port_id = 1 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.replication_device = **** {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.report_discard_supported = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.reserved_percentage = 0 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.scst_target_driver = iscsi {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.scst_target_iqn_name = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.storage_protocol = iSCSI {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.target_helper = tgtadm {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.target_ip_address = 192.168.122.96 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.target_port = 3260 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.target_protocol = iscsi {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.trace_flags = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.unique_fqdn_network = True {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.use_chap_auth = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.volume_backend_name = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.volume_clear = zero {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.volume_clear_ionice = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.volume_clear_size = 0 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.volume_group = cinder-volumes {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_reports.file_event_handler = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_reports.log_dir = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.backend_availability_zone = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.backend_host = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.chap_password = **** {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.chap_username = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.chiscsi_conf = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.disk_geometry = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.driver_client_cert = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.driver_client_cert_key = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.driver_data_namespace = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.driver_use_ssl = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.extra_capabilities = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.filter_function = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.goodness_function = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.iscsi_target_flags = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.iscsi_write_cache = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.iser_helper = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.iser_ip_address = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.iser_port = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.iser_target_prefix = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.lvm_conf_file = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.lvm_mirrors = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.lvm_share_target = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.lvm_type = auto {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.num_shell_tries = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.nvmet_ns_id = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.nvmet_port_id = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.replication_device = **** {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.report_discard_supported = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.reserved_percentage = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.scst_target_driver = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.storage_protocol = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.target_helper = lioadm {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.target_ip_address = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.target_port = 3260 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.target_protocol = iscsi {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.trace_flags = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.unique_fqdn_network = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.use_chap_auth = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.volume_clear = zero {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.volume_clear_ionice = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.volume_clear_size = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] lvmdriver-1.volumes_dir = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_rabbit.ssl = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_rabbit.ssl_version = {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_notifications.driver = [] {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_notifications.retry = -1 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] oslo_messaging_notifications.transport_url = **** {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] key_manager.fixed_key = **** {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] barbican.barbican_api_version = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] barbican.barbican_endpoint = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] barbican.barbican_endpoint_type = public {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] barbican.barbican_region_name = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] barbican.cafile = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] barbican.certfile = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] barbican.collect_timing = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] barbican.insecure = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] barbican.keyfile = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] barbican.number_of_retries = 60 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] barbican.retry_delay = 1 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] barbican.send_service_user_token = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] barbican.split_loggers = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] barbican.timeout = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] barbican.verify_ssl = True {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] barbican.verify_ssl_path = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] barbican_service_user.auth_section = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] barbican_service_user.auth_type = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] barbican_service_user.cafile = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] barbican_service_user.certfile = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] barbican_service_user.collect_timing = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] barbican_service_user.insecure = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] barbican_service_user.keyfile = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] barbican_service_user.split_loggers = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] barbican_service_user.timeout = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] vault.approle_role_id = **** {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] vault.approle_secret_id = **** {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] vault.auth_method = approle {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] vault.auth_path = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] vault.kv_mountpoint = secret {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] vault.kv_path = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] vault.kv_version = 2 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] vault.namespace = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] vault.root_token_id = **** {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] vault.ssl_ca_crt_file = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] vault.timeout = 60.0 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] vault.token_file = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] vault.token_role = None {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] vault.use_ssl = False {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:40:17 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] ******************************************************************************** {{(pid=78028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 10 12:40:17 devstack sudo[78240]: pam_unix(sudo:session): session closed for user root Aug 10 12:40:17 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.388s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:40:17 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:40:18 devstack sudo[78373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 10 12:40:18 devstack sudo[78373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:40:18 devstack sudo[78373]: pam_unix(sudo:session): session closed for user root Aug 10 12:40:18 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.265s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:40:18 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 12:40:18 devstack cinder-volume[78218]: INFO cinder.brick.local_dev.lvm [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Aug 10 12:40:18 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:40:18 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:40:18 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:40:18 devstack sudo[78468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 10 12:40:18 devstack sudo[78468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:40:18 devstack sudo[78468]: pam_unix(sudo:session): session closed for user root Aug 10 12:40:18 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:40:18 devstack cinder-volume[78218]: DEBUG cinder.brick.local_dev.lvm [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=78218) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Aug 10 12:40:18 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:40:18 devstack sudo[78564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 10 12:40:18 devstack sudo[78564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:40:19 devstack sudo[78564]: pam_unix(sudo:session): session closed for user root Aug 10 12:40:19 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.484s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:40:19 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:40:19 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:40:19 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:40:19 devstack sudo[78748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 10 12:40:19 devstack sudo[78748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:40:19 devstack sudo[78748]: pam_unix(sudo:session): session closed for user root Aug 10 12:40:19 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.304s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:40:19 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:40:19 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:40:19 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:40:19 devstack sudo[78833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Aug 10 12:40:19 devstack sudo[78833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:40:19 devstack sudo[78833]: pam_unix(sudo:session): session closed for user root Aug 10 12:40:19 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.262s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:40:19 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:40:19 devstack sudo[78839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 10 12:40:19 devstack sudo[78839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:40:19 devstack sudo[78839]: pam_unix(sudo:session): session closed for user root Aug 10 12:40:19 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.313s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:40:19 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:40:19 devstack sudo[78920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 10 12:40:19 devstack sudo[78920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:40:20 devstack sudo[78920]: pam_unix(sudo:session): session closed for user root Aug 10 12:40:20 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:40:20 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:40:20 devstack sudo[78927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 10 12:40:20 devstack sudo[78927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:40:20 devstack sudo[78927]: pam_unix(sudo:session): session closed for user root Aug 10 12:40:20 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:40:20 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:40:20 devstack sudo[78974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 10 12:40:20 devstack sudo[78974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:40:20 devstack sudo[78974]: pam_unix(sudo:session): session closed for user root Aug 10 12:40:20 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.305s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:40:20 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:40:20 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:40:20 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:40:20 devstack sudo[79016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 10 12:40:20 devstack sudo[79016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:40:21 devstack sudo[79016]: pam_unix(sudo:session): session closed for user root Aug 10 12:40:21 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:40:21 devstack cinder-volume[78218]: INFO cinder.volume.drivers.lvm [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Enabling LVM thin provisioning by default because a thin pool exists. Aug 10 12:40:21 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:40:21 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:40:21 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:40:21 devstack sudo[79020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 10 12:40:21 devstack sudo[79020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:40:21 devstack sudo[79020]: pam_unix(sudo:session): session closed for user root Aug 10 12:40:21 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:40:21 devstack cinder-volume[78218]: DEBUG cinder.volume.drivers.lvm [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Updating volume stats {{(pid=78218) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 10 12:40:21 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:40:21 devstack sudo[79023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 10 12:40:21 devstack sudo[79023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:40:21 devstack sudo[79023]: pam_unix(sudo:session): session closed for user root Aug 10 12:40:21 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:40:21 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:40:21 devstack sudo[79026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 10 12:40:21 devstack sudo[79026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:40:21 devstack sudo[79026]: pam_unix(sudo:session): session closed for user root Aug 10 12:40:21 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:40:21 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:40:21 devstack sudo[79029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 10 12:40:21 devstack sudo[79029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:40:22 devstack sudo[79029]: pam_unix(sudo:session): session closed for user root Aug 10 12:40:22 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:40:22 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:40:22 devstack sudo[79038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 10 12:40:22 devstack sudo[79038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:40:22 devstack sudo[79038]: pam_unix(sudo:session): session closed for user root Aug 10 12:40:22 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:40:22 devstack cinder-volume[78218]: INFO cinder.volume.driver [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Driver hasn't implemented _init_vendor_properties() Aug 10 12:40:22 devstack cinder-volume[78218]: DEBUG cinder.volume.driver [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=78218) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 10 12:40:22 devstack cinder-volume[78218]: DEBUG oslo_db.sqlalchemy.engines [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78218) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 10 12:40:22 devstack cinder-volume[78218]: DEBUG dbcounter [-] [78218] Writer thread running {{(pid=78218) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 10 12:40:22 devstack cinder-volume[78218]: DEBUG cinder.db.api [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Building query based on filter {{(pid=78218) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 10 12:40:22 devstack cinder-volume[78218]: DEBUG cinder.image.image_utils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=78218) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 10 12:40:22 devstack cinder-volume[78218]: INFO cinder.keymgr.migration [None req-c34b9ece-fae3-4d9b-b4c9-804756c1496f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 10 12:40:22 devstack cinder-volume[78218]: DEBUG cinder.volume.drivers.lvm [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Updating volume stats {{(pid=78218) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 10 12:40:22 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:40:22 devstack sudo[79041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 10 12:40:22 devstack sudo[79041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:40:22 devstack sudo[79041]: pam_unix(sudo:session): session closed for user root Aug 10 12:40:22 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:40:22 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:40:22 devstack sudo[79046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 10 12:40:22 devstack sudo[79046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:40:23 devstack sudo[79046]: pam_unix(sudo:session): session closed for user root Aug 10 12:40:23 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:40:23 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:40:23 devstack sudo[79050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 10 12:40:23 devstack sudo[79050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:40:23 devstack sudo[79050]: pam_unix(sudo:session): session closed for user root Aug 10 12:40:23 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:40:23 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:40:23 devstack sudo[79053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 10 12:40:23 devstack sudo[79053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:40:23 devstack sudo[79053]: pam_unix(sudo:session): session closed for user root Aug 10 12:40:23 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:40:23 devstack cinder-volume[78218]: DEBUG cinder.manager [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Notifying Schedulers of capabilities ... {{(pid=78218) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:40:23 devstack cinder-volume[78218]: INFO cinder.volume.manager [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Driver initialization completed successfully. Aug 10 12:40:23 devstack cinder-volume[78218]: INFO cinder.manager [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Initiating service 2 cleanup Aug 10 12:40:23 devstack cinder-volume[78218]: INFO cinder.manager [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Service 2 cleanup completed. Aug 10 12:40:23 devstack cinder-volume[78218]: DEBUG cinder.service [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Creating RPC server for service cinder-volume {{(pid=78218) start /opt/stack/cinder/cinder/service.py:231}} Aug 10 12:40:23 devstack cinder-volume[78218]: DEBUG cinder.service [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=78218) start /opt/stack/cinder/cinder/service.py:237}} Aug 10 12:40:23 devstack cinder-volume[78218]: INFO cinder.volume.manager [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Aug 10 12:40:23 devstack cinder-volume[78218]: DEBUG cinder.volume.drivers.lvm [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Updating volume stats {{(pid=78218) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 10 12:40:23 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:40:23 devstack sudo[79058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 10 12:40:23 devstack sudo[79058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:40:24 devstack sudo[79058]: pam_unix(sudo:session): session closed for user root Aug 10 12:40:24 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:40:24 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:40:24 devstack sudo[79061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 10 12:40:24 devstack sudo[79061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:40:24 devstack sudo[79061]: pam_unix(sudo:session): session closed for user root Aug 10 12:40:24 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:40:24 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:40:24 devstack sudo[79064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 10 12:40:24 devstack sudo[79064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:40:24 devstack sudo[79064]: pam_unix(sudo:session): session closed for user root Aug 10 12:40:24 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:40:24 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:40:24 devstack sudo[79067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 10 12:40:24 devstack sudo[79067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:40:24 devstack sudo[79067]: pam_unix(sudo:session): session closed for user root Aug 10 12:40:24 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:40:24 devstack cinder-volume[78218]: INFO cinder.volume.manager [None req-fefb1c37-f663-4c78-bd14-5eaad211db67 None None] Driver post RPC initialization completed successfully. Aug 10 12:40:27 devstack cinder-volume[78028]: DEBUG dbcounter [-] [78028] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=78028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:40:34 devstack cinder-volume[78218]: DEBUG dbcounter [-] [78218] Writing DB stats cinder:SELECT=2 {{(pid=78218) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:40:35 devstack cinder-volume[78218]: DEBUG dbcounter [-] [78218] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=78218) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:40:41 devstack cinder-volume[78218]: DEBUG oslo_service.periodic_task [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] Running periodic task VolumeManager._thread_info {{(pid=78218) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 12:40:42 devstack cinder-volume[78218]: DEBUG cinder.volume.manager [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] thread count: 6 {{(pid=78218) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 12:40:42 devstack cinder-volume[78218]: DEBUG cinder.volume.manager [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] thread info: [<_MainThread(MainThread, started 139350642827392)>, , , , , ] {{(pid=78218) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Aug 10 12:41:42 devstack cinder-volume[78218]: DEBUG oslo_service.periodic_task [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78218) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 12:41:42 devstack cinder-volume[78218]: DEBUG cinder.volume.drivers.lvm [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] Updating volume stats {{(pid=78218) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 10 12:41:42 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:41:42 devstack sudo[81449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 10 12:41:42 devstack sudo[81449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:41:42 devstack sudo[81449]: pam_unix(sudo:session): session closed for user root Aug 10 12:41:42 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:41:42 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:41:42 devstack sudo[81490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 10 12:41:42 devstack sudo[81490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:41:42 devstack sudo[81490]: pam_unix(sudo:session): session closed for user root Aug 10 12:41:42 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:41:42 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:41:42 devstack sudo[81592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 10 12:41:42 devstack sudo[81592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:41:42 devstack sudo[81592]: pam_unix(sudo:session): session closed for user root Aug 10 12:41:42 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:41:42 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:41:42 devstack sudo[81682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 10 12:41:42 devstack sudo[81682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:41:43 devstack sudo[81682]: pam_unix(sudo:session): session closed for user root Aug 10 12:41:43 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:41:43 devstack cinder-volume[78218]: DEBUG cinder.manager [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] Notifying Schedulers of capabilities ... {{(pid=78218) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:41:43 devstack cinder-volume[78218]: DEBUG oslo_service.periodic_task [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] Running periodic task VolumeManager._thread_info {{(pid=78218) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 12:41:43 devstack cinder-volume[78218]: DEBUG cinder.volume.manager [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] thread count: 6 {{(pid=78218) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 12:41:43 devstack cinder-volume[78218]: DEBUG cinder.volume.manager [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] thread info: [<_MainThread(MainThread, started 139350642827392)>, , , , , ] {{(pid=78218) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Aug 10 12:42:35 devstack cinder-volume[78218]: DEBUG dbcounter [-] [78218] Writing DB stats cinder:SELECT=1 {{(pid=78218) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:42:35 devstack cinder-volume[78218]: DEBUG dbcounter [-] [78218] Writing DB stats cinder:UPDATE=1 {{(pid=78218) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:42:42 devstack cinder-volume[78218]: DEBUG oslo_service.periodic_task [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78218) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 12:42:42 devstack cinder-volume[78218]: DEBUG cinder.volume.drivers.lvm [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] Updating volume stats {{(pid=78218) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 10 12:42:42 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:42:42 devstack sudo[84672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 10 12:42:42 devstack sudo[84672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:42:42 devstack sudo[84672]: pam_unix(sudo:session): session closed for user root Aug 10 12:42:42 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:42:42 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:42:42 devstack sudo[84683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 10 12:42:42 devstack sudo[84683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:42:42 devstack sudo[84683]: pam_unix(sudo:session): session closed for user root Aug 10 12:42:42 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:42:42 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:42:42 devstack sudo[84686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 10 12:42:42 devstack sudo[84686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:42:42 devstack sudo[84686]: pam_unix(sudo:session): session closed for user root Aug 10 12:42:42 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.243s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:42:42 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:42:42 devstack sudo[84696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 10 12:42:42 devstack sudo[84696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:42:43 devstack sudo[84696]: pam_unix(sudo:session): session closed for user root Aug 10 12:42:43 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:42:43 devstack cinder-volume[78218]: DEBUG cinder.manager [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] Notifying Schedulers of capabilities ... {{(pid=78218) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:43:42 devstack cinder-volume[78218]: DEBUG oslo_service.periodic_task [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78218) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 12:43:42 devstack cinder-volume[78218]: DEBUG cinder.volume.drivers.lvm [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] Updating volume stats {{(pid=78218) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 10 12:43:42 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:43:42 devstack sudo[86859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 10 12:43:42 devstack sudo[86859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:43:42 devstack sudo[86859]: pam_unix(sudo:session): session closed for user root Aug 10 12:43:42 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:43:42 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:43:42 devstack sudo[86871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 10 12:43:42 devstack sudo[86871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:43:42 devstack sudo[86871]: pam_unix(sudo:session): session closed for user root Aug 10 12:43:42 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:43:42 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:43:42 devstack sudo[86887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 10 12:43:42 devstack sudo[86887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:43:42 devstack sudo[86887]: pam_unix(sudo:session): session closed for user root Aug 10 12:43:42 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:43:42 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:43:42 devstack sudo[86894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 10 12:43:42 devstack sudo[86894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:43:43 devstack sudo[86894]: pam_unix(sudo:session): session closed for user root Aug 10 12:43:43 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:43:43 devstack cinder-volume[78218]: DEBUG cinder.manager [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] Notifying Schedulers of capabilities ... {{(pid=78218) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:43:43 devstack cinder-volume[78218]: DEBUG oslo_service.periodic_task [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] Running periodic task VolumeManager._thread_info {{(pid=78218) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 12:43:43 devstack cinder-volume[78218]: DEBUG cinder.volume.manager [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] thread count: 6 {{(pid=78218) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 12:43:43 devstack cinder-volume[78218]: DEBUG cinder.volume.manager [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] thread info: [<_MainThread(MainThread, started 139350642827392)>, , , , , ] {{(pid=78218) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Aug 10 12:44:34 devstack cinder-volume[78218]: DEBUG dbcounter [-] [78218] Writing DB stats cinder:SELECT=1 {{(pid=78218) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:44:35 devstack cinder-volume[78218]: DEBUG dbcounter [-] [78218] Writing DB stats cinder:UPDATE=1 {{(pid=78218) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:44:42 devstack cinder-volume[78218]: DEBUG oslo_service.periodic_task [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78218) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 12:44:42 devstack cinder-volume[78218]: DEBUG cinder.volume.drivers.lvm [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] Updating volume stats {{(pid=78218) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 10 12:44:42 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:44:42 devstack sudo[87983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 10 12:44:42 devstack sudo[87983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:44:42 devstack sudo[87983]: pam_unix(sudo:session): session closed for user root Aug 10 12:44:42 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:44:42 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:44:42 devstack sudo[87997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 10 12:44:42 devstack sudo[87997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:44:42 devstack sudo[87997]: pam_unix(sudo:session): session closed for user root Aug 10 12:44:42 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:44:42 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:44:42 devstack sudo[88000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 10 12:44:42 devstack sudo[88000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:44:42 devstack sudo[88000]: pam_unix(sudo:session): session closed for user root Aug 10 12:44:42 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:44:42 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:44:42 devstack sudo[88009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 10 12:44:42 devstack sudo[88009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:44:43 devstack sudo[88009]: pam_unix(sudo:session): session closed for user root Aug 10 12:44:43 devstack cinder-volume[78218]: DEBUG oslo_concurrency.processutils [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=78218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:44:43 devstack cinder-volume[78218]: DEBUG cinder.manager [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] Notifying Schedulers of capabilities ... {{(pid=78218) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:44:43 devstack cinder-volume[78218]: DEBUG oslo_service.periodic_task [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] Running periodic task VolumeManager._thread_info {{(pid=78218) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 12:44:43 devstack cinder-volume[78218]: DEBUG cinder.volume.manager [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] thread count: 6 {{(pid=78218) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 12:44:43 devstack cinder-volume[78218]: DEBUG cinder.volume.manager [None req-b172af6f-5ebb-4a87-b91c-f08fa0445d96 None None] thread info: [<_MainThread(MainThread, started 139350642827392)>, , , , , ] {{(pid=78218) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Aug 10 12:44:48 devstack cinder-volume[78028]: INFO oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] Caught SIGTERM, stopping children Aug 10 12:44:48 devstack cinder-volume[78028]: DEBUG oslo_concurrency.lockutils [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] Acquiring lock "singleton_lock" {{(pid=78028) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 10 12:44:48 devstack cinder-volume[78028]: DEBUG oslo_concurrency.lockutils [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] Acquired lock "singleton_lock" {{(pid=78028) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 10 12:44:48 devstack cinder-volume[78028]: DEBUG oslo_concurrency.lockutils [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] Releasing lock "singleton_lock" {{(pid=78028) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 10 12:44:48 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] Stop services. {{(pid=78028) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 10 12:44:48 devstack cinder-volume[78028]: DEBUG oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] Killing children. {{(pid=78028) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 10 12:44:48 devstack cinder-volume[78028]: INFO oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] Waiting on 1 children to exit Aug 10 12:44:48 devstack cinder-volume[78218]: DEBUG oslo_concurrency.lockutils [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] Acquiring lock "singleton_lock" {{(pid=78218) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 10 12:44:48 devstack cinder-volume[78218]: DEBUG oslo_concurrency.lockutils [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] Acquired lock "singleton_lock" {{(pid=78218) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 10 12:44:48 devstack cinder-volume[78218]: DEBUG oslo_concurrency.lockutils [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] Releasing lock "singleton_lock" {{(pid=78218) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 10 12:44:48 devstack cinder-volume[78218]: WARNING amqp [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 10 12:44:48 devstack cinder-volume[78218]: WARNING amqp [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 10 12:44:48 devstack cinder-volume[78028]: INFO oslo_service.backend._eventlet.service [None req-ac8d33af-cc90-4c75-b502-835d6ea1aafb None None] Child 78218 exited with status 0 Aug 10 12:44:49 devstack cinder-volume[88300]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 10 12:44:49 devstack cinder-volume[88300]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 10 12:44:49 devstack cinder-volume[88300]: we strongly recommend against using it for new projects. Aug 10 12:44:49 devstack cinder-volume[88300]: If you are already using Eventlet, we recommend migrating to a different Aug 10 12:44:49 devstack cinder-volume[88300]: framework. For more detail see Aug 10 12:44:49 devstack cinder-volume[88300]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 10 12:44:49 devstack cinder-volume[88300]: import eventlet # noqa Aug 10 12:44:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88300) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 10 12:44:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88300) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 10 12:44:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88300) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 10 12:44:52 devstack cinder-volume[88300]: INFO dbcounter [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] Registered counter for database cinder Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_db.sqlalchemy.engines [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88300) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writer thread running {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 10 12:44:52 devstack cinder-volume[88300]: INFO cinder.rpc [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 10 12:44:52 devstack cinder-volume[88300]: INFO cinder.rpc [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_db.sqlalchemy.engines [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88300) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 10 12:44:52 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] Determined volume DB was empty at startup. Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88300) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 10 12:44:52 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 10 12:44:52 devstack cinder-volume[88300]: WARNING stevedore.named [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 10 12:44:52 devstack cinder-volume[88300]: WARNING castellan.key_manager [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 10 12:44:52 devstack cinder-volume[88300]: WARNING cinder.keymgr.conf_key_mgr [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 10 12:44:52 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_db.sqlalchemy.engines [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88300) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 10 12:44:52 devstack cinder-volume[88300]: INFO oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] Starting 1 workers Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] Started child 88517 {{(pid=88300) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] Full set of CONF: {{(pid=88300) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] ******************************************************************************** {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] Configuration options gathered from: {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] ================================================================================ {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] allow_availability_zone_fallback = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] allow_compression_on_image_upload = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] allowed_direct_url_schemes = [] {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] api_rate_limit = True {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] auth_strategy = keystone {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_availability_zone = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_host = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_name = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_stats_polling_interval = 60 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backup_api_class = cinder.backup.api.API {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backup_name_template = backup-%s {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backup_use_same_host = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backup_use_temp_snapshot = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] chap_password = **** {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] chap_username = {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cinder_internal_tenant_project_id = ea84f4a607c841beacde60600ce5c17e {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cinder_internal_tenant_user_id = 3eb77fdd72604c27a77d80086e2fd98c {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cluster = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] compression_format = gzip {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] compute_api_class = cinder.compute.nova.API {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] config_dir = [] {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] config_source = [] {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] control_exchange = openstack {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] debug = True {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88517]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] default_availability_zone = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] default_group_type = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] default_volume_type = QuobyteHD {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] disk_geometry = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] driver_client_cert = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] driver_client_cert_key = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] driver_data_namespace = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] driver_ssl_cert_path = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] driver_ssl_cert_verify = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] driver_use_ssl = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] enable_new_services = True {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] enable_unsupported_driver = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] enabled_backends = ['QuobyteHD'] {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] enforce_multipath_for_image_xfer = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] filter_function = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] glance_api_insecure = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] glance_api_servers = ['http://192.168.122.96/image'] {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] glance_api_ssl_compression = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] glance_ca_certificates_file = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] glance_catalog_info = image:glance:publicURL {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] glance_certfile = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] glance_keyfile = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] glance_num_retries = 3 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] glance_request_timeout = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] goodness_function = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] graceful_shutdown_timeout = 5 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] group_api_class = cinder.group.api.API {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] host = devstack {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] image_compress_on_upload = True {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] image_conversion_address_space_limit = 1 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] image_conversion_cpu_limit = 60 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] image_conversion_disable = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] image_upload_use_cinder_backend = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] image_upload_use_internal_tenant = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] image_volume_cache_enabled = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] image_volume_cache_max_count = 0 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] image_volume_cache_max_size_gb = 0 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] init_host_max_objects_retrieval = 0 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] instance_format = [instance: %(uuid)s] {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] iscsi_target_flags = {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] iscsi_write_cache = on {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] iser_helper = tgtadm {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] iser_ip_address = 192.168.122.96 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] iser_port = 3260 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] log_color = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] log_config_append = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] log_dir = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] log_file = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] log_options = True {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] log_rotate_interval = 1 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] log_rotate_interval_type = days {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] log_rotation_type = none {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] max_age = 0 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] max_logfile_count = 30 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] max_logfile_size_mb = 200 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] max_over_subscription_ratio = 20.0 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] message_reap_interval = 86400 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] message_ttl = 2592000 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] migration_create_volume_timeout_secs = 300 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] monkey_patch = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] monkey_patch_modules = [] {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] my_ip = 192.168.122.96 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] no_snapshot_gb_quota = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] num_iser_scan_tries = 3 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] num_shell_tries = 3 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] num_volume_device_scan_tries = 3 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] nvmeof_conn_info_version = 1 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] nvmet_ns_id = 10 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] nvmet_port_id = 1 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] osapi_max_limit = 1000 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] osapi_volume_ext_list = [] {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] osapi_volume_listen = 0.0.0.0 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] osapi_volume_listen_port = 8776 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] osapi_volume_use_ssl = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] osapi_volume_workers = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] per_volume_size_limit = -1 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] periodic_fuzzy_delay = 60 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] periodic_interval = 60 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] project_id_regex = [0-9a-f\-]+ {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] public_endpoint = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] publish_errors = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] quota_backup_gigabytes = 1000 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] quota_backups = 10 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] quota_gigabytes = 1000 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] quota_groups = 10 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] quota_snapshots = 10 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] quota_volumes = 10 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] rate_limit_burst = 0 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] rate_limit_except_level = CRITICAL {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] rate_limit_interval = 0 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] reinit_driver_count = 3 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] replication_device = **** {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] report_discard_supported = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] report_interval = 120 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] reservation_clean_interval = 86400 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] reservation_expire = 86400 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] reserved_image_namespaces = [] {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] reserved_percentage = 0 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] rpc_response_timeout = 120 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] run_external_periodic_tasks = True {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] scst_target_driver = iscsi {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] scst_target_iqn_name = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] service_down_time = 720 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] shell_completion = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] snapshot_name_template = snapshot-%s {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] split_loggers = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] state_path = /opt/stack/data/cinder {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] storage_availability_zone = nova {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] storage_protocol = iSCSI {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] syslog_log_facility = LOG_USER {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] target_helper = lioadm {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] target_ip_address = 192.168.122.96 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] target_port = 3260 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] target_protocol = iscsi {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] target_secondary_ip_addresses = [] {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] trace_flags = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] transfer_api_class = cinder.transfer.api.API {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] transport_url = **** {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] until_refresh = 0 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] use_chap_auth = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] use_default_quota_class = True {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] use_journal = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] use_json = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] use_multipath_for_image_xfer = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] use_stderr = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] use_syslog = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] verify_glance_signatures = enabled {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] volume_api_class = cinder.volume.api.API {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] volume_backend_name = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] volume_clear = zero {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] volume_clear_ionice = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] volume_clear_size = 0 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] volume_copy_bps_limit = 0 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] volume_dd_blocksize = 1M {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] volume_name_template = volume-%s {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] volume_service_inithost_offload = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] volume_usage_audit_period = month {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] zoning_mode = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_concurrency.disable_process_locking = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] keystone_authtoken.auth_section = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] keystone_authtoken.auth_type = password {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] keystone_authtoken.auth_version = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] keystone_authtoken.cache = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] keystone_authtoken.certfile = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] keystone_authtoken.delay_auth_decision = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] keystone_authtoken.http_connect_timeout = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] keystone_authtoken.include_service_catalog = True {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] keystone_authtoken.insecure = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] keystone_authtoken.interface = public {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] keystone_authtoken.keyfile = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] keystone_authtoken.memcache_password = {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] keystone_authtoken.memcache_username = {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] keystone_authtoken.region_name = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] keystone_authtoken.service_token_roles_required = True {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] keystone_authtoken.service_type = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] keystone_authtoken.token_cache_time = 300 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.96/identity {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cache.backend = dogpile.cache.null {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cache.backend_argument = **** {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cache.backend_expiration_time = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cache.config_prefix = cache.oslo {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cache.debug_cache_backend = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cache.enable_retry_client = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cache.enable_socket_keepalive = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cache.enabled = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cache.expiration_time = 600 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cache.hashclient_retry_attempts = 2 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88517]: INFO cinder.volume.manager [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] Starting volume driver QuobyteDriver (1.2) Aug 10 12:44:52 devstack cinder-volume[88517]: DEBUG cinder.volume.drivers.remotefs [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88517) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cache.memcache_dead_retry = 300 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cache.memcache_pool_maxsize = 10 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cache.memcache_sasl_enabled = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cache.password = **** {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cache.proxies = [] {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cache.redis_db = 0 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cache.redis_sentinel_service_name = mymaster {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cache.redis_server = localhost:6379 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cache.retry_attempts = 2 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cache.retry_delay = 0.0 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cache.socket_keepalive_count = 1 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cache.socket_keepalive_idle = 1 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cache.socket_keepalive_interval = 1 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cache.socket_timeout = 1.0 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cache.tls_allowed_ciphers = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cache.tls_cafile = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cache.tls_certfile = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cache.tls_enabled = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cache.tls_keyfile = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cache.username = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] coordination.backend_url = **** {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] database.asyncio_connection = **** {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] database.asyncio_slave_connection = **** {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] database.backend = sqlalchemy {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] database.connection = **** {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] database.connection_debug = 0 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] database.connection_parameters = {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] database.connection_recycle_time = 3600 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] database.connection_trace = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] database.db_inc_retry_interval = True {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] database.db_max_retries = 20 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] database.db_max_retry_interval = 10 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] database.db_retry_interval = 1 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] database.max_overflow = 50 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] database.max_pool_size = 5 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] database.max_retries = 10 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] database.mysql_wsrep_sync_wait = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] database.pool_timeout = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] database.retry_interval = 10 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] database.slave_connection = **** {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] database.sqlite_synchronous = True {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] database.synchronous_reader = True {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] database.use_db_reconnect = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] profiler.connection_string = messaging:// {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] profiler.enabled = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] profiler.es_doc_type = notification {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] profiler.es_scroll_size = 10000 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] profiler.es_scroll_time = 2m {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] profiler.filter_error_trace = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] profiler.hmac_keys = **** {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] profiler.sentinel_service_name = mymaster {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] profiler.socket_timeout = 0.1 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] profiler.trace_requests = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] profiler.trace_sqlalchemy = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] profiler_jaeger.process_tags = {} {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] profiler_jaeger.service_name_prefix = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] profiler_otlp.service_name_prefix = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_policy.enforce_new_defaults = True {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_policy.policy_default_rule = default {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_policy.policy_file = policy.yaml {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_policy.remote_timeout = 60.0 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] privsep_osbrick.group = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] privsep_osbrick.helper_command = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] privsep_osbrick.user = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cinder_sys_admin.group = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cinder_sys_admin.helper_command = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] cinder_sys_admin.user = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] service_user.auth_section = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] service_user.auth_type = password {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] service_user.cafile = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] service_user.certfile = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] service_user.collect_timing = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] service_user.insecure = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] service_user.keyfile = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] service_user.send_service_user_token = True {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] service_user.split_loggers = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:52 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] service_user.timeout = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] glance.auth_section = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] glance.auth_type = password {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] glance.certfile = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] glance.collect_timing = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] glance.insecure = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] glance.keyfile = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] glance.region_name = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] glance.split_loggers = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] glance.timeout = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.backend_availability_zone = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.chap_password = **** {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.chap_username = {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.disk_geometry = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.driver_client_cert = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.driver_client_cert_key = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.driver_data_namespace = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88517]: DEBUG cinder.volume.drivers.quobyte [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88517) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 10 12:44:53 devstack cinder-volume[88517]: WARNING cinder.volume.drivers.quobyte [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 10 12:44:53 devstack cinder-volume[88517]: WARNING cinder.volume.drivers.quobyte [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.driver_use_ssl = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.enable_unsupported_driver = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88517]: DEBUG oslo_concurrency.processutils [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] Running cmd (subprocess): mount.quobyte {{(pid=88517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.extra_capabilities = {} {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.filter_function = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.goodness_function = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.iscsi_target_flags = {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.iscsi_write_cache = on {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.iser_helper = tgtadm {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.iser_ip_address = 192.168.122.96 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.iser_port = 3260 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.nas_host = {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.nas_login = admin {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.nas_mount_options = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.nas_password = **** {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.nas_private_key = {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.nas_share_path = {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.nas_ssh_port = 22 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.num_shell_tries = 3 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.nvmet_port_id = 1 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.quobyte_client_cfg = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.quobyte_volume_url = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.replication_device = **** {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.report_discard_supported = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.reserved_percentage = 0 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.scst_target_driver = iscsi {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.scst_target_iqn_name = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.storage_protocol = iSCSI {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.target_helper = tgtadm {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.target_ip_address = 192.168.122.96 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.target_port = 3260 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.target_protocol = iscsi {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.trace_flags = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.unique_fqdn_network = True {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.use_chap_auth = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.volume_backend_name = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.volume_clear = zero {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.volume_clear_ionice = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.volume_clear_size = 0 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_reports.file_event_handler = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_reports.log_dir = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.backend_availability_zone = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.backend_host = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.chap_password = **** {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.chap_username = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.chiscsi_conf = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.disk_geometry = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.driver_client_cert = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.driver_client_cert_key = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.driver_data_namespace = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.driver_use_ssl = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.extra_capabilities = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.filter_function = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.goodness_function = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.iscsi_target_flags = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.iscsi_write_cache = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.iser_helper = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.iser_ip_address = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.iser_port = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.iser_target_prefix = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.nas_host = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.nas_login = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.nas_mount_options = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.nas_password = **** {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.nas_private_key = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.nas_share_path = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.nas_ssh_port = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.num_shell_tries = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.nvmet_ns_id = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.nvmet_port_id = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.replication_device = **** {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.report_discard_supported = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack quobyte-client[88522]: Reading configuration file: /etc/quobyte/client.cfg Aug 10 12:44:53 devstack quobyte-client[88522]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.reserved_percentage = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.scst_target_driver = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.storage_protocol = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.target_helper = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.target_ip_address = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.target_port = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.target_prefix = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.target_protocol = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.trace_flags = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.unique_fqdn_network = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.use_chap_auth = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.volume_clear = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.volume_clear_ionice = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.volume_clear_size = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] QuobyteHD.volumes_dir = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88517]: DEBUG oslo_concurrency.processutils [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] CMD "mount.quobyte" returned: 1 in 0.091s {{(pid=88517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:44:53 devstack cinder-volume[88517]: DEBUG oslo_concurrency.lockutils [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:44:53 devstack cinder-volume[88517]: DEBUG oslo_concurrency.lockutils [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88517]: DEBUG cinder.volume.drivers.quobyte [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=88517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:44:53 devstack cinder-volume[88517]: INFO cinder.volume.drivers.quobyte [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d ... Aug 10 12:44:53 devstack cinder-volume[88517]: DEBUG oslo_concurrency.processutils [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e -c /etc/quobyte/client-cinder.cfg {{(pid=88517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_rabbit.ssl = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_rabbit.ssl_version = {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_notifications.driver = [] {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_notifications.retry = -1 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] oslo_messaging_notifications.transport_url = **** {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] key_manager.fixed_key = **** {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] barbican.barbican_api_version = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] barbican.barbican_endpoint = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] barbican.barbican_endpoint_type = public {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] barbican.barbican_region_name = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] barbican.cafile = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] barbican.certfile = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] barbican.collect_timing = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] barbican.insecure = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] barbican.keyfile = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] barbican.number_of_retries = 60 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] barbican.retry_delay = 1 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] barbican.send_service_user_token = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] barbican.split_loggers = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] barbican.timeout = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] barbican.verify_ssl = True {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] barbican.verify_ssl_path = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] barbican_service_user.auth_section = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] barbican_service_user.auth_type = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] barbican_service_user.cafile = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] barbican_service_user.certfile = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] barbican_service_user.collect_timing = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] barbican_service_user.insecure = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] barbican_service_user.keyfile = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] barbican_service_user.split_loggers = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] barbican_service_user.timeout = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] vault.approle_role_id = **** {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] vault.approle_secret_id = **** {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] vault.auth_method = approle {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] vault.auth_path = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] vault.kv_mountpoint = secret {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] vault.kv_path = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] vault.kv_version = 2 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] vault.namespace = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] vault.root_token_id = **** {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] vault.ssl_ca_crt_file = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] vault.timeout = 60.0 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] vault.token_file = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] vault.token_role = None {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] vault.use_ssl = False {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:44:53 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] ******************************************************************************** {{(pid=88300) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 10 12:44:53 devstack sudo[88523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e -c /etc/quobyte/client-cinder.cfg Aug 10 12:44:53 devstack sudo[88523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:44:53 devstack sudo[88523]: pam_unix(sudo:session): session closed for user root Aug 10 12:44:53 devstack cinder-volume[88517]: DEBUG oslo_concurrency.processutils [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.401s {{(pid=88517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:44:53 devstack cinder-volume[88517]: INFO cinder.volume.drivers.quobyte [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d succeeded Aug 10 12:44:53 devstack cinder-volume[88517]: DEBUG cinder.volume.drivers.quobyte [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=88517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:44:53 devstack cinder-volume[88517]: DEBUG oslo_concurrency.lockutils [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.415s {{(pid=88517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:44:53 devstack cinder-volume[88517]: DEBUG oslo_concurrency.processutils [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=88517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:44:53 devstack sudo[88592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:44:53 devstack sudo[88592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:44:53 devstack sudo[88592]: pam_unix(sudo:session): session closed for user root Aug 10 12:44:53 devstack cinder-volume[88517]: DEBUG oslo_concurrency.processutils [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.238s {{(pid=88517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:44:53 devstack cinder-volume[88517]: INFO cinder.volume.driver [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] Driver hasn't implemented _init_vendor_properties() Aug 10 12:44:53 devstack cinder-volume[88517]: DEBUG cinder.volume.driver [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576522827148, 'free_capacity_gb': 1775.7576522827148, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88517) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 10 12:44:53 devstack cinder-volume[88517]: DEBUG oslo_db.sqlalchemy.engines [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88517) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 10 12:44:53 devstack cinder-volume[88517]: DEBUG dbcounter [-] [88517] Writer thread running {{(pid=88517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 10 12:44:53 devstack cinder-volume[88517]: DEBUG cinder.db.api [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] Building query based on filter {{(pid=88517) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 10 12:44:53 devstack cinder-volume[88517]: DEBUG cinder.image.image_utils [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88517) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 10 12:44:53 devstack cinder-volume[88517]: INFO cinder.keymgr.migration [None req-a505f540-6488-4803-ac75-a3b402954b8d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 10 12:44:53 devstack cinder-volume[88517]: DEBUG oslo_concurrency.lockutils [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:44:53 devstack cinder-volume[88517]: DEBUG oslo_concurrency.lockutils [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:44:53 devstack cinder-volume[88517]: DEBUG cinder.volume.drivers.quobyte [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=88517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:44:53 devstack cinder-volume[88517]: DEBUG cinder.volume.drivers.quobyte [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=88517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:44:53 devstack cinder-volume[88517]: DEBUG oslo_concurrency.lockutils [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:44:53 devstack cinder-volume[88517]: DEBUG oslo_concurrency.processutils [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=88517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:44:53 devstack sudo[88595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:44:53 devstack sudo[88595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:44:54 devstack sudo[88595]: pam_unix(sudo:session): session closed for user root Aug 10 12:44:54 devstack cinder-volume[88517]: DEBUG oslo_concurrency.processutils [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.240s {{(pid=88517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:44:54 devstack cinder-volume[88517]: DEBUG cinder.manager [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] Notifying Schedulers of capabilities ... {{(pid=88517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:44:54 devstack cinder-volume[88517]: INFO cinder.volume.manager [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] Driver initialization completed successfully. Aug 10 12:44:54 devstack cinder-volume[88517]: INFO cinder.manager [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] Initiating service 3 cleanup Aug 10 12:44:54 devstack cinder-volume[88517]: INFO cinder.manager [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] Service 3 cleanup completed. Aug 10 12:44:54 devstack cinder-volume[88517]: DEBUG cinder.service [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] Creating RPC server for service cinder-volume {{(pid=88517) start /opt/stack/cinder/cinder/service.py:231}} Aug 10 12:44:54 devstack cinder-volume[88517]: DEBUG cinder.service [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88517) start /opt/stack/cinder/cinder/service.py:237}} Aug 10 12:44:54 devstack cinder-volume[88517]: INFO cinder.volume.manager [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 10 12:44:54 devstack cinder-volume[88517]: DEBUG oslo_concurrency.lockutils [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:44:54 devstack cinder-volume[88517]: DEBUG oslo_concurrency.lockutils [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:44:54 devstack cinder-volume[88517]: DEBUG cinder.volume.drivers.quobyte [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=88517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:44:54 devstack cinder-volume[88517]: DEBUG cinder.volume.drivers.quobyte [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=88517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:44:54 devstack cinder-volume[88517]: DEBUG oslo_concurrency.lockutils [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:44:54 devstack cinder-volume[88517]: DEBUG oslo_concurrency.processutils [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=88517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:44:54 devstack sudo[88598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:44:54 devstack sudo[88598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:44:54 devstack sudo[88598]: pam_unix(sudo:session): session closed for user root Aug 10 12:44:54 devstack cinder-volume[88517]: DEBUG oslo_concurrency.processutils [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.264s {{(pid=88517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:44:54 devstack cinder-volume[88517]: INFO cinder.volume.manager [None req-513faab2-8dcf-412a-bd9d-19615f892784 None None] Driver post RPC initialization completed successfully. Aug 10 12:44:59 devstack cinder-volume[88517]: DEBUG oslo_concurrency.lockutils [None req-34708d26-b0be-444e-b4b3-9f2275526918 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:44:59 devstack cinder-volume[88517]: DEBUG oslo_concurrency.lockutils [None req-34708d26-b0be-444e-b4b3-9f2275526918 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:44:59 devstack cinder-volume[88517]: DEBUG cinder.volume.drivers.quobyte [None req-34708d26-b0be-444e-b4b3-9f2275526918 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=88517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:44:59 devstack cinder-volume[88517]: DEBUG cinder.volume.drivers.quobyte [None req-34708d26-b0be-444e-b4b3-9f2275526918 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=88517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:44:59 devstack cinder-volume[88517]: DEBUG oslo_concurrency.lockutils [None req-34708d26-b0be-444e-b4b3-9f2275526918 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:44:59 devstack cinder-volume[88517]: DEBUG oslo_concurrency.processutils [None req-34708d26-b0be-444e-b4b3-9f2275526918 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=88517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:44:59 devstack sudo[88786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:44:59 devstack sudo[88786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:44:59 devstack cinder-volume[88300]: INFO oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] Caught SIGTERM, stopping children Aug 10 12:44:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] Acquiring lock "singleton_lock" {{(pid=88300) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 10 12:44:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] Acquired lock "singleton_lock" {{(pid=88300) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 10 12:44:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] Releasing lock "singleton_lock" {{(pid=88300) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 10 12:44:59 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] Stop services. {{(pid=88300) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 10 12:44:59 devstack cinder-volume[88300]: DEBUG oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] Killing children. {{(pid=88300) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 10 12:44:59 devstack cinder-volume[88300]: INFO oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] Waiting on 1 children to exit Aug 10 12:44:59 devstack sudo[88786]: pam_unix(sudo:session): session closed for user root Aug 10 12:44:59 devstack cinder-volume[88517]: DEBUG oslo_concurrency.processutils [None req-34708d26-b0be-444e-b4b3-9f2275526918 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.298s {{(pid=88517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:44:59 devstack cinder-volume[88517]: DEBUG cinder.manager [None req-34708d26-b0be-444e-b4b3-9f2275526918 None None] Notifying Schedulers of capabilities ... {{(pid=88517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo.messaging._drivers.impl_rabbit [None req-34708d26-b0be-444e-b4b3-9f2275526918 None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo.messaging._drivers.impl_rabbit [None req-34708d26-b0be-444e-b4b3-9f2275526918 None None] Unable to connect to AMQP server on 192.168.122.96:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server [None req-34708d26-b0be-444e-b4b3-9f2275526918 None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.96:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1109, in ensure Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server ret, channel = autoretry_method() Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^ Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server return fun(*args, **kwargs) Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^ Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__ Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server return fun(*args, channel=channels[0], **kwargs), channels[0] Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1098, in execute_method Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server method() Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1560, in _publish Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server self._producer.publish( Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server return _publish( Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server ^^^^^^^^^ Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server return channel.basic_publish( Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server self.wait([spec.Basic.Ack, spec.Basic.Nack], Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server self.connection.drain_events(timeout=timeout) Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server while not self.blocking_read(timeout): Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server return self.on_inbound_frame(frame) Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server callback(channel, method_sig, buf, None) Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server return self.channels[channel_id].dispatch_method( Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server listener(*args) Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server raise error_for_code( Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server self._publish_service_capabilities(context) Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/manager.py", line 220, in _publish_service_capabilities Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server self.scheduler_rpcapi.update_service_capabilities( Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server cctxt.cast(ctxt, 'update_service_capabilities', **msg_args) Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 154, in cast Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server self.transport._send(self.target, msg_ctxt, msg, Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server return self._driver.send(target, ctxt, message, Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 794, in send Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server return self._send(target, ctxt, message, wait_for_reply, timeout, Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 769, in _send Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server conn.fanout_send(target.topic, msg, retry=retry) Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1679, in fanout_send Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server self._ensure_publishing(self._publish, exchange, msg, retry=retry) Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1509, in _ensure_publishing Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server self.ensure(method, retry=retry, error_callback=_error_callback) Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1131, in ensure Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server raise exceptions.MessageDeliveryFailure(msg) Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.96:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Aug 10 12:44:59 devstack cinder-volume[88517]: ERROR oslo_messaging.rpc.server Aug 10 12:45:02 devstack cinder-volume[88517]: DEBUG oslo_concurrency.lockutils [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] Acquiring lock "singleton_lock" {{(pid=88517) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 10 12:45:02 devstack cinder-volume[88517]: DEBUG oslo_concurrency.lockutils [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] Acquired lock "singleton_lock" {{(pid=88517) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 10 12:45:02 devstack cinder-volume[88517]: DEBUG oslo_concurrency.lockutils [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] Releasing lock "singleton_lock" {{(pid=88517) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 10 12:45:02 devstack cinder-volume[88517]: WARNING amqp [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 10 12:45:02 devstack cinder-volume[88517]: WARNING amqp [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 10 12:45:02 devstack cinder-volume[88300]: INFO oslo_service.backend._eventlet.service [None req-7a8eafe5-32e5-4c5f-aa19-9a5baf6c4beb None None] Child 88517 exited with status 0 Aug 10 12:45:03 devstack cinder-volume[88803]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 10 12:45:03 devstack cinder-volume[88803]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 10 12:45:03 devstack cinder-volume[88803]: we strongly recommend against using it for new projects. Aug 10 12:45:03 devstack cinder-volume[88803]: If you are already using Eventlet, we recommend migrating to a different Aug 10 12:45:03 devstack cinder-volume[88803]: framework. For more detail see Aug 10 12:45:03 devstack cinder-volume[88803]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 10 12:45:03 devstack cinder-volume[88803]: import eventlet # noqa Aug 10 12:45:06 devstack cinder-volume[88803]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88803) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 10 12:45:06 devstack cinder-volume[88803]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88803) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 10 12:45:06 devstack cinder-volume[88803]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88803) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 10 12:45:06 devstack cinder-volume[88803]: INFO dbcounter [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] Registered counter for database cinder Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_db.sqlalchemy.engines [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88803) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG dbcounter [-] [88803] Writer thread running {{(pid=88803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 10 12:45:07 devstack cinder-volume[88803]: INFO cinder.rpc [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 10 12:45:07 devstack cinder-volume[88803]: INFO cinder.rpc [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_db.sqlalchemy.engines [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88803) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 10 12:45:07 devstack cinder-volume[88803]: INFO cinder.volume.manager [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] Determined volume DB was empty at startup. Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG cinder.volume.manager [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88803) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 10 12:45:07 devstack cinder-volume[88803]: WARNING stevedore.named [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 10 12:45:07 devstack cinder-volume[88803]: WARNING castellan.key_manager [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 10 12:45:07 devstack cinder-volume[88803]: WARNING cinder.keymgr.conf_key_mgr [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 10 12:45:07 devstack cinder-volume[88803]: INFO cinder.volume.manager [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_db.sqlalchemy.engines [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88803) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 10 12:45:07 devstack cinder-volume[88803]: INFO oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] Starting 1 workers Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] Started child 89096 {{(pid=88803) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] Full set of CONF: {{(pid=88803) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] ******************************************************************************** {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] Configuration options gathered from: {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 10 12:45:07 devstack cinder-volume[89096]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] ================================================================================ {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] allow_availability_zone_fallback = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] allow_compression_on_image_upload = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] allowed_direct_url_schemes = [] {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] api_rate_limit = True {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] auth_strategy = keystone {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_availability_zone = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_host = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_name = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_stats_polling_interval = 60 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backup_api_class = cinder.backup.api.API {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backup_name_template = backup-%s {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backup_use_same_host = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backup_use_temp_snapshot = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] chap_password = **** {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] chap_username = {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cinder_internal_tenant_project_id = ea84f4a607c841beacde60600ce5c17e {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cinder_internal_tenant_user_id = 3eb77fdd72604c27a77d80086e2fd98c {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cluster = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] compression_format = gzip {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] compute_api_class = cinder.compute.nova.API {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] config_dir = [] {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] config_source = [] {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] control_exchange = openstack {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] debug = True {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] default_availability_zone = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] default_group_type = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] default_volume_type = QuobyteHD {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] disk_geometry = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] driver_client_cert = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] driver_client_cert_key = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] driver_data_namespace = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] driver_ssl_cert_path = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] driver_ssl_cert_verify = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] driver_use_ssl = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] enable_new_services = True {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] enable_unsupported_driver = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] enabled_backends = ['QuobyteHD'] {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] enforce_multipath_for_image_xfer = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] filter_function = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] glance_api_insecure = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] glance_api_servers = ['http://192.168.122.96/image'] {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] glance_api_ssl_compression = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] glance_ca_certificates_file = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] glance_catalog_info = image:glance:publicURL {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] glance_certfile = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] glance_keyfile = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] glance_num_retries = 3 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] glance_request_timeout = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] goodness_function = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] graceful_shutdown_timeout = 5 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] group_api_class = cinder.group.api.API {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] host = devstack {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] image_compress_on_upload = True {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] image_conversion_address_space_limit = 1 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] image_conversion_cpu_limit = 60 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] image_conversion_disable = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] image_upload_use_cinder_backend = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] image_upload_use_internal_tenant = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] image_volume_cache_enabled = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] image_volume_cache_max_count = 0 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] image_volume_cache_max_size_gb = 0 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] init_host_max_objects_retrieval = 0 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] instance_format = [instance: %(uuid)s] {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] iscsi_target_flags = {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] iscsi_write_cache = on {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] iser_helper = tgtadm {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] iser_ip_address = 192.168.122.96 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] iser_port = 3260 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] log_color = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] log_config_append = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] log_dir = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] log_file = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] log_options = True {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] Starting volume driver QuobyteDriver (1.2) Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] log_rotate_interval = 1 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=89096) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] log_rotate_interval_type = days {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] log_rotation_type = none {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] max_age = 0 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] max_logfile_count = 30 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] max_logfile_size_mb = 200 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] max_over_subscription_ratio = 20.0 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] message_reap_interval = 86400 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] message_ttl = 2592000 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] migration_create_volume_timeout_secs = 300 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] monkey_patch = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] monkey_patch_modules = [] {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] my_ip = 192.168.122.96 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] no_snapshot_gb_quota = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] num_iser_scan_tries = 3 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] num_shell_tries = 3 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] num_volume_device_scan_tries = 3 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] nvmeof_conn_info_version = 1 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] nvmet_ns_id = 10 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] nvmet_port_id = 1 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] osapi_max_limit = 1000 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] osapi_volume_ext_list = [] {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] osapi_volume_listen_port = 8776 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] osapi_volume_use_ssl = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] osapi_volume_workers = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] per_volume_size_limit = -1 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] periodic_fuzzy_delay = 60 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] periodic_interval = 60 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] public_endpoint = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] publish_errors = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] quota_backup_gigabytes = 1000 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] quota_backups = 10 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] quota_gigabytes = 1000 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] quota_groups = 10 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] quota_snapshots = 10 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] quota_volumes = 10 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] rate_limit_burst = 0 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] rate_limit_except_level = CRITICAL {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] rate_limit_interval = 0 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] reinit_driver_count = 3 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] replication_device = **** {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] report_discard_supported = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] report_interval = 120 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] reservation_clean_interval = 86400 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] reservation_expire = 86400 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] reserved_image_namespaces = [] {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] reserved_percentage = 0 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] rpc_response_timeout = 120 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] run_external_periodic_tasks = True {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] scst_target_driver = iscsi {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] scst_target_iqn_name = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] service_down_time = 720 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] shell_completion = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] snapshot_name_template = snapshot-%s {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] split_loggers = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] state_path = /opt/stack/data/cinder {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] storage_availability_zone = nova {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] storage_protocol = iSCSI {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] syslog_log_facility = LOG_USER {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] target_helper = lioadm {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] target_ip_address = 192.168.122.96 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] target_port = 3260 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] target_protocol = iscsi {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] target_secondary_ip_addresses = [] {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] trace_flags = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] transport_url = **** {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] until_refresh = 0 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] use_chap_auth = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] use_default_quota_class = True {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] use_journal = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] use_json = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] use_multipath_for_image_xfer = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] use_stderr = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] use_syslog = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] verify_glance_signatures = enabled {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] volume_api_class = cinder.volume.api.API {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] volume_backend_name = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] volume_clear = zero {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] volume_clear_ionice = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] volume_clear_size = 0 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] volume_copy_bps_limit = 0 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] volume_dd_blocksize = 1M {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] volume_name_template = volume-%s {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] volume_service_inithost_offload = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] volume_usage_audit_period = month {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] zoning_mode = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_concurrency.disable_process_locking = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] keystone_authtoken.auth_section = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] keystone_authtoken.auth_type = password {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] keystone_authtoken.auth_version = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] keystone_authtoken.cache = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] keystone_authtoken.certfile = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] keystone_authtoken.include_service_catalog = True {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] keystone_authtoken.insecure = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] keystone_authtoken.interface = public {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] keystone_authtoken.keyfile = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] keystone_authtoken.memcache_password = {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] keystone_authtoken.memcache_username = {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] keystone_authtoken.region_name = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] keystone_authtoken.service_type = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.96/identity {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cache.backend = dogpile.cache.null {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cache.backend_argument = **** {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cache.backend_expiration_time = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cache.config_prefix = cache.oslo {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cache.debug_cache_backend = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cache.enable_retry_client = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cache.enable_socket_keepalive = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cache.enabled = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cache.expiration_time = 600 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cache.hashclient_retry_attempts = 2 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cache.memcache_dead_retry = 300 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cache.memcache_pool_maxsize = 10 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cache.memcache_sasl_enabled = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cache.password = **** {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cache.proxies = [] {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cache.redis_db = 0 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cache.redis_server = localhost:6379 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cache.retry_attempts = 2 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cache.retry_delay = 0.0 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cache.socket_keepalive_count = 1 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cache.socket_keepalive_idle = 1 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cache.socket_keepalive_interval = 1 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cache.socket_timeout = 1.0 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cache.tls_allowed_ciphers = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=89096) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cache.tls_cafile = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cache.tls_certfile = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cache.tls_enabled = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.quobyte [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 10 12:45:07 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.quobyte [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cache.tls_keyfile = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] Running cmd (subprocess): mount.quobyte {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cache.username = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] coordination.backend_url = **** {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] database.asyncio_connection = **** {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] database.asyncio_slave_connection = **** {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] database.backend = sqlalchemy {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] database.connection = **** {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] database.connection_debug = 0 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] database.connection_parameters = {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] database.connection_recycle_time = 3600 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] database.connection_trace = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] database.db_inc_retry_interval = True {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] database.db_max_retries = 20 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] database.db_max_retry_interval = 10 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] database.db_retry_interval = 1 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] database.max_overflow = 50 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] database.max_pool_size = 5 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] database.max_retries = 10 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] database.mysql_wsrep_sync_wait = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] database.pool_timeout = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] database.retry_interval = 10 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] database.slave_connection = **** {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] database.sqlite_synchronous = True {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] database.synchronous_reader = True {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] database.use_db_reconnect = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] profiler.connection_string = messaging:// {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] profiler.enabled = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] profiler.es_doc_type = notification {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] profiler.es_scroll_size = 10000 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] profiler.es_scroll_time = 2m {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] profiler.filter_error_trace = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] profiler.hmac_keys = **** {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] profiler.sentinel_service_name = mymaster {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] profiler.socket_timeout = 0.1 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] profiler.trace_requests = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] profiler.trace_sqlalchemy = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] profiler_jaeger.process_tags = {} {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] profiler_jaeger.service_name_prefix = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] profiler_otlp.service_name_prefix = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_policy.enforce_new_defaults = True {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_policy.policy_default_rule = default {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_policy.policy_file = policy.yaml {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] privsep_osbrick.group = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] privsep_osbrick.helper_command = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] privsep_osbrick.user = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cinder_sys_admin.group = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cinder_sys_admin.helper_command = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] cinder_sys_admin.user = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] service_user.auth_section = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] service_user.auth_type = password {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] service_user.cafile = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] service_user.certfile = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] service_user.collect_timing = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] service_user.insecure = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] service_user.keyfile = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] service_user.send_service_user_token = True {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] service_user.split_loggers = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] service_user.timeout = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] glance.auth_section = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] glance.auth_type = password {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] glance.certfile = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] glance.collect_timing = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] glance.insecure = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] glance.keyfile = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] glance.region_name = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] glance.split_loggers = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] glance.timeout = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.backend_availability_zone = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.chap_password = **** {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.chap_username = {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.disk_geometry = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.driver_client_cert = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.driver_client_cert_key = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.driver_data_namespace = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.driver_use_ssl = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.extra_capabilities = {} {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.filter_function = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.goodness_function = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.iscsi_target_flags = {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.iscsi_write_cache = on {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.iser_helper = tgtadm {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.iser_ip_address = 192.168.122.96 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.iser_port = 3260 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.nas_host = {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.nas_login = admin {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.nas_mount_options = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.nas_password = **** {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.nas_private_key = {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.nas_share_path = {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.nas_ssh_port = 22 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.num_shell_tries = 3 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.quobyte_client_cfg = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.quobyte_volume_url = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.replication_device = **** {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.report_discard_supported = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.reserved_percentage = 0 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.target_helper = tgtadm {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.target_ip_address = 192.168.122.96 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.target_port = 3260 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.target_protocol = iscsi {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.trace_flags = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.unique_fqdn_network = True {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.use_chap_auth = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.volume_backend_name = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.volume_clear = zero {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.volume_clear_ionice = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.volume_clear_size = 0 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_reports.file_event_handler = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_reports.log_dir = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.backend_availability_zone = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack quobyte-client[89097]: Reading configuration file: /etc/quobyte/client.cfg Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.backend_host = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.chap_password = **** {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.chap_username = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.chiscsi_conf = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.disk_geometry = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack quobyte-client[89097]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.driver_client_cert = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.driver_client_cert_key = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.driver_data_namespace = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] CMD "mount.quobyte" returned: 1 in 0.066s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.driver_use_ssl = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.extra_capabilities = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.filter_function = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.goodness_function = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.iscsi_target_flags = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.iscsi_write_cache = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.iser_helper = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.iser_ip_address = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.iser_port = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.iser_target_prefix = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.nas_host = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.nas_login = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.nas_mount_options = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.nas_password = **** {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.nas_private_key = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.nas_share_path = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.nas_ssh_port = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.num_shell_tries = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.nvmet_ns_id = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.nvmet_port_id = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.replication_device = **** {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.report_discard_supported = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.reserved_percentage = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.scst_target_driver = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.storage_protocol = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.target_helper = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.target_ip_address = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.target_port = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.target_prefix = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.target_protocol = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.trace_flags = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.unique_fqdn_network = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.use_chap_auth = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.volume_clear = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.volume_clear_ionice = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.volume_clear_size = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] QuobyteHD.volumes_dir = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_rabbit.ssl = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_notifications.driver = [] {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_notifications.retry = -1 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] key_manager.fixed_key = **** {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] barbican.barbican_api_version = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] barbican.barbican_endpoint = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] barbican.barbican_endpoint_type = public {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] barbican.barbican_region_name = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] barbican.cafile = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] barbican.certfile = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] barbican.collect_timing = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] barbican.insecure = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] barbican.keyfile = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] barbican.number_of_retries = 60 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] barbican.retry_delay = 1 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] barbican.send_service_user_token = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] barbican.split_loggers = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] barbican.timeout = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] barbican.verify_ssl = True {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] barbican.verify_ssl_path = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] barbican_service_user.auth_section = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] barbican_service_user.auth_type = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] barbican_service_user.cafile = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack sudo[89101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] barbican_service_user.certfile = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] barbican_service_user.collect_timing = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] barbican_service_user.insecure = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] barbican_service_user.keyfile = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] barbican_service_user.split_loggers = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] barbican_service_user.timeout = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] vault.approle_role_id = **** {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] vault.approle_secret_id = **** {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] vault.auth_method = approle {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] vault.auth_path = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] vault.kv_mountpoint = secret {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] vault.kv_path = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] vault.kv_version = 2 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] vault.namespace = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] vault.root_token_id = **** {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] vault.ssl_ca_crt_file = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] vault.timeout = 60.0 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] vault.token_file = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] vault.token_role = None {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] vault.use_ssl = False {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 12:45:07 devstack cinder-volume[88803]: DEBUG oslo_service.backend._eventlet.service [None req-efea1a9e-7b02-4eca-a10d-495116df89a7 None None] ******************************************************************************** {{(pid=88803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 10 12:45:08 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root Aug 10 12:45:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.249s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:45:08 devstack cinder-volume[89096]: INFO cinder.volume.driver [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] Driver hasn't implemented _init_vendor_properties() Aug 10 12:45:08 devstack cinder-volume[89096]: DEBUG cinder.volume.driver [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576522827148, 'free_capacity_gb': 1775.7576522827148, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89096) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 10 12:45:08 devstack cinder-volume[89096]: DEBUG oslo_db.sqlalchemy.engines [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89096) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 10 12:45:08 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writer thread running {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 10 12:45:08 devstack cinder-volume[89096]: DEBUG cinder.db.api [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] Building query based on filter {{(pid=89096) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 10 12:45:08 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=89096) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 10 12:45:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:45:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:45:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:45:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:45:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:45:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:45:08 devstack cinder-volume[89096]: INFO cinder.keymgr.migration [None req-b2b3665a-4036-4671-bcb6-ffcd043544e5 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 10 12:45:08 devstack sudo[89109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:45:08 devstack sudo[89109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:45:08 devstack sudo[89109]: pam_unix(sudo:session): session closed for user root Aug 10 12:45:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.241s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:45:08 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:45:08 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] Driver initialization completed successfully. Aug 10 12:45:08 devstack cinder-volume[89096]: INFO cinder.manager [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] Initiating service 3 cleanup Aug 10 12:45:08 devstack cinder-volume[89096]: INFO cinder.manager [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] Service 3 cleanup completed. Aug 10 12:45:08 devstack cinder-volume[89096]: DEBUG cinder.service [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] Creating RPC server for service cinder-volume {{(pid=89096) start /opt/stack/cinder/cinder/service.py:231}} Aug 10 12:45:08 devstack cinder-volume[89096]: DEBUG cinder.service [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=89096) start /opt/stack/cinder/cinder/service.py:237}} Aug 10 12:45:08 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 10 12:45:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:45:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:45:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:45:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:45:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:45:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:45:08 devstack sudo[89122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:45:08 devstack sudo[89122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:45:08 devstack sudo[89122]: pam_unix(sudo:session): session closed for user root Aug 10 12:45:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.256s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:45:08 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-c259e2f6-aa76-4561-a26f-2939f7522a23 None None] Driver post RPC initialization completed successfully. Aug 10 12:45:17 devstack cinder-volume[88803]: DEBUG dbcounter [-] [88803] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:45:18 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=3 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:45:18 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:46:03 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager._thread_info {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 12:46:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread count: 6 {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 12:46:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread info: [<_MainThread(MainThread, started 130607683133568)>, , , , , ] {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Aug 10 12:46:08 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2145739-d67b-4bed-8b27-209def56666c tempest-TaggedAttachmentsTest-1987457885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:46:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c2145739-d67b-4bed-8b27-209def56666c tempest-TaggedAttachmentsTest-1987457885 None] Flow 'volume_create_manager' (f318eb94-ff04-48f8-a3a4-3ab551499265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:46:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c2145739-d67b-4bed-8b27-209def56666c tempest-TaggedAttachmentsTest-1987457885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29a81152-161e-476e-a1a1-37612b9add51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:46:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c2145739-d67b-4bed-8b27-209def56666c tempest-TaggedAttachmentsTest-1987457885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29a81152-161e-476e-a1a1-37612b9add51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-652781662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16bc3e14-8d3f-4162-ab96-966a9621c17d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7903eba74ed243d7bee08bce3bd4a7a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:46:08Z,use_quota=True,user_id='a26989eead3c4139ad191c6ca43ef014',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:46:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c2145739-d67b-4bed-8b27-209def56666c tempest-TaggedAttachmentsTest-1987457885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f56697-e979-4eb6-b254-0757365bcb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:46:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c2145739-d67b-4bed-8b27-209def56666c tempest-TaggedAttachmentsTest-1987457885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f56697-e979-4eb6-b254-0757365bcb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:46:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c2145739-d67b-4bed-8b27-209def56666c tempest-TaggedAttachmentsTest-1987457885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46a1e762-5610-4639-824a-e833a92e46ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:46:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c2145739-d67b-4bed-8b27-209def56666c tempest-TaggedAttachmentsTest-1987457885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46a1e762-5610-4639-824a-e833a92e46ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16bc3e14-8d3f-4162-ab96-966a9621c17d', 'volume_name': 'volume-16bc3e14-8d3f-4162-ab96-966a9621c17d', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:46:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c2145739-d67b-4bed-8b27-209def56666c tempest-TaggedAttachmentsTest-1987457885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d84fba-af8a-414a-a02c-170b71d231d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:46:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c2145739-d67b-4bed-8b27-209def56666c tempest-TaggedAttachmentsTest-1987457885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d84fba-af8a-414a-a02c-170b71d231d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:46:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c2145739-d67b-4bed-8b27-209def56666c tempest-TaggedAttachmentsTest-1987457885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49022f60-8414-4329-a23c-a26d22e990ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:46:08 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-c2145739-d67b-4bed-8b27-209def56666c tempest-TaggedAttachmentsTest-1987457885 None] Volume 16bc3e14-8d3f-4162-ab96-966a9621c17d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16bc3e14-8d3f-4162-ab96-966a9621c17d', 'volume_size': 1} Aug 10 12:46:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c2145739-d67b-4bed-8b27-209def56666c tempest-TaggedAttachmentsTest-1987457885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:46:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c2145739-d67b-4bed-8b27-209def56666c tempest-TaggedAttachmentsTest-1987457885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:46:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c2145739-d67b-4bed-8b27-209def56666c tempest-TaggedAttachmentsTest-1987457885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-652781662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16bc3e14-8d3f-4162-ab96-966a9621c17d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7903eba74ed243d7bee08bce3bd4a7a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:46:08Z,use_quota=True,user_id='a26989eead3c4139ad191c6ca43ef014',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:46:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-c2145739-d67b-4bed-8b27-209def56666c tempest-TaggedAttachmentsTest-1987457885 None] Creating volume 16bc3e14-8d3f-4162-ab96-966a9621c17d {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:46:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c2145739-d67b-4bed-8b27-209def56666c tempest-TaggedAttachmentsTest-1987457885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:46:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c2145739-d67b-4bed-8b27-209def56666c tempest-TaggedAttachmentsTest-1987457885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:46:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c2145739-d67b-4bed-8b27-209def56666c tempest-TaggedAttachmentsTest-1987457885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:46:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c2145739-d67b-4bed-8b27-209def56666c tempest-TaggedAttachmentsTest-1987457885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:46:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c2145739-d67b-4bed-8b27-209def56666c tempest-TaggedAttachmentsTest-1987457885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:46:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c2145739-d67b-4bed-8b27-209def56666c tempest-TaggedAttachmentsTest-1987457885 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:46:08 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-c2145739-d67b-4bed-8b27-209def56666c tempest-TaggedAttachmentsTest-1987457885 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:46:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c2145739-d67b-4bed-8b27-209def56666c tempest-TaggedAttachmentsTest-1987457885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-16bc3e14-8d3f-4162-ab96-966a9621c17d 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:46:08 devstack sudo[89406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-16bc3e14-8d3f-4162-ab96-966a9621c17d 1073741824 Aug 10 12:46:08 devstack sudo[89406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:46:08 devstack sudo[89406]: pam_unix(sudo:session): session closed for user root Aug 10 12:46:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c2145739-d67b-4bed-8b27-209def56666c tempest-TaggedAttachmentsTest-1987457885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-16bc3e14-8d3f-4162-ab96-966a9621c17d 1073741824" returned: 0 in 0.782s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:46:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c2145739-d67b-4bed-8b27-209def56666c tempest-TaggedAttachmentsTest-1987457885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-16bc3e14-8d3f-4162-ab96-966a9621c17d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:46:09 devstack sudo[89733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-16bc3e14-8d3f-4162-ab96-966a9621c17d Aug 10 12:46:09 devstack sudo[89733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:46:09 devstack sudo[89733]: pam_unix(sudo:session): session closed for user root Aug 10 12:46:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c2145739-d67b-4bed-8b27-209def56666c tempest-TaggedAttachmentsTest-1987457885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-16bc3e14-8d3f-4162-ab96-966a9621c17d" returned: 0 in 0.298s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:46:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c2145739-d67b-4bed-8b27-209def56666c tempest-TaggedAttachmentsTest-1987457885 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:46:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c2145739-d67b-4bed-8b27-209def56666c tempest-TaggedAttachmentsTest-1987457885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:46:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c2145739-d67b-4bed-8b27-209def56666c tempest-TaggedAttachmentsTest-1987457885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49022f60-8414-4329-a23c-a26d22e990ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16bc3e14-8d3f-4162-ab96-966a9621c17d', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:46:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c2145739-d67b-4bed-8b27-209def56666c tempest-TaggedAttachmentsTest-1987457885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50aee069-1a36-4469-aa50-e83ff72966e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:46:09 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-c2145739-d67b-4bed-8b27-209def56666c tempest-TaggedAttachmentsTest-1987457885 None] Volume volume-16bc3e14-8d3f-4162-ab96-966a9621c17d (16bc3e14-8d3f-4162-ab96-966a9621c17d): created successfully Aug 10 12:46:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c2145739-d67b-4bed-8b27-209def56666c tempest-TaggedAttachmentsTest-1987457885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50aee069-1a36-4469-aa50-e83ff72966e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:46:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c2145739-d67b-4bed-8b27-209def56666c tempest-TaggedAttachmentsTest-1987457885 None] Flow 'volume_create_manager' (f318eb94-ff04-48f8-a3a4-3ab551499265) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:46:09 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-c2145739-d67b-4bed-8b27-209def56666c tempest-TaggedAttachmentsTest-1987457885 None] Created volume successfully. Aug 10 12:46:19 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:UPDATE=3 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:46:19 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:46:36 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-213a6ff1-edd2-41d8-a578-aeefe80c63fd tempest-VolumesAdminNegativeTest-1040722083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:46:36 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-213a6ff1-edd2-41d8-a578-aeefe80c63fd tempest-VolumesAdminNegativeTest-1040722083 None] Flow 'volume_create_manager' (80565d2c-c17c-4334-b966-53d1b2e9b083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:46:36 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-213a6ff1-edd2-41d8-a578-aeefe80c63fd tempest-VolumesAdminNegativeTest-1040722083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad1243ae-426e-4d33-a154-b116ece3b21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:46:36 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-213a6ff1-edd2-41d8-a578-aeefe80c63fd tempest-VolumesAdminNegativeTest-1040722083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad1243ae-426e-4d33-a154-b116ece3b21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1686621219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d83c306-92e0-459d-9c67-f37609bafa52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90fccbdd38b74ab28e9beb543a3aa216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:46:37Z,use_quota=True,user_id='8213e838ffc2448ba80900dd59b7b039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:46:36 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-213a6ff1-edd2-41d8-a578-aeefe80c63fd tempest-VolumesAdminNegativeTest-1040722083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9534e0a0-27bb-4c15-a49e-6b38fed3c799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:46:36 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-213a6ff1-edd2-41d8-a578-aeefe80c63fd tempest-VolumesAdminNegativeTest-1040722083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9534e0a0-27bb-4c15-a49e-6b38fed3c799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:46:36 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-213a6ff1-edd2-41d8-a578-aeefe80c63fd tempest-VolumesAdminNegativeTest-1040722083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001e4a74-20c8-499a-9beb-40b073f7dbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:46:36 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-213a6ff1-edd2-41d8-a578-aeefe80c63fd tempest-VolumesAdminNegativeTest-1040722083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001e4a74-20c8-499a-9beb-40b073f7dbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d83c306-92e0-459d-9c67-f37609bafa52', 'volume_name': 'volume-6d83c306-92e0-459d-9c67-f37609bafa52', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:46:36 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-213a6ff1-edd2-41d8-a578-aeefe80c63fd tempest-VolumesAdminNegativeTest-1040722083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fb1fc9e-442e-44ca-8aeb-da679dae25dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:46:36 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-213a6ff1-edd2-41d8-a578-aeefe80c63fd tempest-VolumesAdminNegativeTest-1040722083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fb1fc9e-442e-44ca-8aeb-da679dae25dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:46:36 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-213a6ff1-edd2-41d8-a578-aeefe80c63fd tempest-VolumesAdminNegativeTest-1040722083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (205dd78b-02bb-4bf8-a670-a5a4623ce63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:46:36 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-213a6ff1-edd2-41d8-a578-aeefe80c63fd tempest-VolumesAdminNegativeTest-1040722083 None] Volume 6d83c306-92e0-459d-9c67-f37609bafa52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d83c306-92e0-459d-9c67-f37609bafa52', 'volume_size': 1} Aug 10 12:46:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-213a6ff1-edd2-41d8-a578-aeefe80c63fd tempest-VolumesAdminNegativeTest-1040722083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:46:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-213a6ff1-edd2-41d8-a578-aeefe80c63fd tempest-VolumesAdminNegativeTest-1040722083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:46:36 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-213a6ff1-edd2-41d8-a578-aeefe80c63fd tempest-VolumesAdminNegativeTest-1040722083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1686621219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d83c306-92e0-459d-9c67-f37609bafa52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90fccbdd38b74ab28e9beb543a3aa216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:46:37Z,use_quota=True,user_id='8213e838ffc2448ba80900dd59b7b039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:46:36 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-213a6ff1-edd2-41d8-a578-aeefe80c63fd tempest-VolumesAdminNegativeTest-1040722083 None] Creating volume 6d83c306-92e0-459d-9c67-f37609bafa52 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:46:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-213a6ff1-edd2-41d8-a578-aeefe80c63fd tempest-VolumesAdminNegativeTest-1040722083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:46:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-213a6ff1-edd2-41d8-a578-aeefe80c63fd tempest-VolumesAdminNegativeTest-1040722083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:46:36 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-213a6ff1-edd2-41d8-a578-aeefe80c63fd tempest-VolumesAdminNegativeTest-1040722083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:46:36 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-213a6ff1-edd2-41d8-a578-aeefe80c63fd tempest-VolumesAdminNegativeTest-1040722083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:46:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-213a6ff1-edd2-41d8-a578-aeefe80c63fd tempest-VolumesAdminNegativeTest-1040722083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:46:36 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-213a6ff1-edd2-41d8-a578-aeefe80c63fd tempest-VolumesAdminNegativeTest-1040722083 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:46:36 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-213a6ff1-edd2-41d8-a578-aeefe80c63fd tempest-VolumesAdminNegativeTest-1040722083 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:46:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-213a6ff1-edd2-41d8-a578-aeefe80c63fd tempest-VolumesAdminNegativeTest-1040722083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6d83c306-92e0-459d-9c67-f37609bafa52 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:46:36 devstack sudo[90286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6d83c306-92e0-459d-9c67-f37609bafa52 1073741824 Aug 10 12:46:36 devstack sudo[90286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:46:37 devstack sudo[90286]: pam_unix(sudo:session): session closed for user root Aug 10 12:46:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-213a6ff1-edd2-41d8-a578-aeefe80c63fd tempest-VolumesAdminNegativeTest-1040722083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6d83c306-92e0-459d-9c67-f37609bafa52 1073741824" returned: 0 in 1.190s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:46:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-213a6ff1-edd2-41d8-a578-aeefe80c63fd tempest-VolumesAdminNegativeTest-1040722083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6d83c306-92e0-459d-9c67-f37609bafa52 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:46:38 devstack sudo[90294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6d83c306-92e0-459d-9c67-f37609bafa52 Aug 10 12:46:38 devstack sudo[90294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:46:38 devstack sudo[90294]: pam_unix(sudo:session): session closed for user root Aug 10 12:46:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-213a6ff1-edd2-41d8-a578-aeefe80c63fd tempest-VolumesAdminNegativeTest-1040722083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6d83c306-92e0-459d-9c67-f37609bafa52" returned: 0 in 0.455s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:46:38 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-213a6ff1-edd2-41d8-a578-aeefe80c63fd tempest-VolumesAdminNegativeTest-1040722083 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:46:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-213a6ff1-edd2-41d8-a578-aeefe80c63fd tempest-VolumesAdminNegativeTest-1040722083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:46:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-213a6ff1-edd2-41d8-a578-aeefe80c63fd tempest-VolumesAdminNegativeTest-1040722083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (205dd78b-02bb-4bf8-a670-a5a4623ce63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d83c306-92e0-459d-9c67-f37609bafa52', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:46:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-213a6ff1-edd2-41d8-a578-aeefe80c63fd tempest-VolumesAdminNegativeTest-1040722083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6228b69-aba4-4c00-94cd-2de9d1543915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:46:38 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-213a6ff1-edd2-41d8-a578-aeefe80c63fd tempest-VolumesAdminNegativeTest-1040722083 None] Volume volume-6d83c306-92e0-459d-9c67-f37609bafa52 (6d83c306-92e0-459d-9c67-f37609bafa52): created successfully Aug 10 12:46:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-213a6ff1-edd2-41d8-a578-aeefe80c63fd tempest-VolumesAdminNegativeTest-1040722083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6228b69-aba4-4c00-94cd-2de9d1543915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:46:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-213a6ff1-edd2-41d8-a578-aeefe80c63fd tempest-VolumesAdminNegativeTest-1040722083 None] Flow 'volume_create_manager' (80565d2c-c17c-4334-b966-53d1b2e9b083) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:46:38 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-213a6ff1-edd2-41d8-a578-aeefe80c63fd tempest-VolumesAdminNegativeTest-1040722083 None] Created volume successfully. Aug 10 12:46:41 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2f520323-de30-48d0-9306-8a3fb68e62b0 tempest-VolumesAdminNegativeTest-1040722083 None] Acquiring lock "cinder-6d83c306-92e0-459d-9c67-f37609bafa52-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:46:41 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2f520323-de30-48d0-9306-8a3fb68e62b0 tempest-VolumesAdminNegativeTest-1040722083 None] Lock "cinder-6d83c306-92e0-459d-9c67-f37609bafa52-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:46:41 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2f520323-de30-48d0-9306-8a3fb68e62b0 tempest-VolumesAdminNegativeTest-1040722083 None] Acquiring lock "cinder-quobyte-6d83c306-92e0-459d-9c67-f37609bafa52" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:46:41 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2f520323-de30-48d0-9306-8a3fb68e62b0 tempest-VolumesAdminNegativeTest-1040722083 None] Lock "cinder-quobyte-6d83c306-92e0-459d-9c67-f37609bafa52" acquired by "delete_volume" :: waited 0.050s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:46:41 devstack cinder-volume[89096]: INFO oslo.privsep.daemon [None req-2f520323-de30-48d0-9306-8a3fb68e62b0 tempest-VolumesAdminNegativeTest-1040722083 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp2hw3ezaa/privsep.sock'] Aug 10 12:46:41 devstack sudo[90299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp2hw3ezaa/privsep.sock Aug 10 12:46:41 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:46:42 devstack cinder-volume[89096]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Aug 10 12:46:42 devstack cinder-volume[89096]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 10 12:46:42 devstack cinder-volume[89096]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Aug 10 12:46:42 devstack cinder-volume[89096]: WARNING oslo.privsep.daemon [-] privsep log: Aug 10 12:46:42 devstack cinder-volume[89096]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Aug 10 12:46:42 devstack cinder-volume[89096]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Aug 10 12:46:42 devstack cinder-volume[89096]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 10 12:46:42 devstack cinder-volume[89096]: WARNING oslo.privsep.daemon [-] privsep log: Aug 10 12:46:42 devstack cinder-volume[89096]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Aug 10 12:46:43 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root Aug 10 12:46:43 devstack cinder-volume[89096]: INFO oslo.privsep.daemon [None req-2f520323-de30-48d0-9306-8a3fb68e62b0 tempest-VolumesAdminNegativeTest-1040722083 None] Spawned new privsep daemon via rootwrap Aug 10 12:46:43 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [None req-2f520323-de30-48d0-9306-8a3fb68e62b0 tempest-VolumesAdminNegativeTest-1040722083 None] Accepted privsep connection to /tmp/tmp2hw3ezaa/privsep.sock {{(pid=89096) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Aug 10 12:46:43 devstack cinder-volume[89096]: INFO oslo.privsep.daemon [-] privsep daemon starting Aug 10 12:46:43 devstack cinder-volume[89096]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Aug 10 12:46:43 devstack cinder-volume[89096]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Aug 10 12:46:43 devstack cinder-volume[89096]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 90342 Aug 10 12:46:43 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3eb06ae-263a-49f8-9e5a-d8ce0176376a]: (2,) {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:46:43 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0d26d2-b3da-4b8b-b027-f71405768ba3]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:46:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2f520323-de30-48d0-9306-8a3fb68e62b0 tempest-VolumesAdminNegativeTest-1040722083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6d83c306-92e0-459d-9c67-f37609bafa52 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:46:43 devstack sudo[90344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6d83c306-92e0-459d-9c67-f37609bafa52 Aug 10 12:46:43 devstack sudo[90344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:46:43 devstack sudo[90344]: pam_unix(sudo:session): session closed for user root Aug 10 12:46:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2f520323-de30-48d0-9306-8a3fb68e62b0 tempest-VolumesAdminNegativeTest-1040722083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6d83c306-92e0-459d-9c67-f37609bafa52" returned: 0 in 0.467s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:46:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2f520323-de30-48d0-9306-8a3fb68e62b0 tempest-VolumesAdminNegativeTest-1040722083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6d83c306-92e0-459d-9c67-f37609bafa52 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:46:43 devstack sudo[90349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6d83c306-92e0-459d-9c67-f37609bafa52 Aug 10 12:46:43 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:46:44 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root Aug 10 12:46:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2f520323-de30-48d0-9306-8a3fb68e62b0 tempest-VolumesAdminNegativeTest-1040722083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6d83c306-92e0-459d-9c67-f37609bafa52" returned: 0 in 0.315s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:46:44 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2f520323-de30-48d0-9306-8a3fb68e62b0 tempest-VolumesAdminNegativeTest-1040722083 None] Lock "cinder-quobyte-6d83c306-92e0-459d-9c67-f37609bafa52" released by "delete_volume" :: held 2.748s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:46:44 devstack cinder-volume[89096]: WARNING cinder.quota [None req-2f520323-de30-48d0-9306-8a3fb68e62b0 tempest-VolumesAdminNegativeTest-1040722083 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 10 12:46:44 devstack cinder-volume[89096]: WARNING cinder.quota [None req-2f520323-de30-48d0-9306-8a3fb68e62b0 tempest-VolumesAdminNegativeTest-1040722083 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 10 12:46:44 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-2f520323-de30-48d0-9306-8a3fb68e62b0 tempest-VolumesAdminNegativeTest-1040722083 None] Created reservations ['a61b82d6-6abe-48c6-a928-a05865ed82ab', 'af94e908-2d3c-4155-8ebc-992607ca206f', 'd81e1526-082e-4f28-9887-ff747281be23', '724d6224-0fa7-4490-8521-4e06a64fa092'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:46:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2f520323-de30-48d0-9306-8a3fb68e62b0 tempest-VolumesAdminNegativeTest-1040722083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:46:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2f520323-de30-48d0-9306-8a3fb68e62b0 tempest-VolumesAdminNegativeTest-1040722083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:46:44 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-2f520323-de30-48d0-9306-8a3fb68e62b0 tempest-VolumesAdminNegativeTest-1040722083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:46:44 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-2f520323-de30-48d0-9306-8a3fb68e62b0 tempest-VolumesAdminNegativeTest-1040722083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:46:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2f520323-de30-48d0-9306-8a3fb68e62b0 tempest-VolumesAdminNegativeTest-1040722083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:46:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2f520323-de30-48d0-9306-8a3fb68e62b0 tempest-VolumesAdminNegativeTest-1040722083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:46:44 devstack sudo[90352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:46:44 devstack sudo[90352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:46:44 devstack sudo[90352]: pam_unix(sudo:session): session closed for user root Aug 10 12:46:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2f520323-de30-48d0-9306-8a3fb68e62b0 tempest-VolumesAdminNegativeTest-1040722083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.327s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:46:44 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-2f520323-de30-48d0-9306-8a3fb68e62b0 tempest-VolumesAdminNegativeTest-1040722083 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:46:44 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-2f520323-de30-48d0-9306-8a3fb68e62b0 tempest-VolumesAdminNegativeTest-1040722083 None] Deleted volume successfully. Aug 10 12:46:44 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2f520323-de30-48d0-9306-8a3fb68e62b0 tempest-VolumesAdminNegativeTest-1040722083 None] Lock "cinder-6d83c306-92e0-459d-9c67-f37609bafa52-delete_volume" released by "delete_volume" :: held 3.568s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:46:54 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=4,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:46:54 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=10,cinder:UPDATE=13,cinder:INSERT=3,cinder:DELETE=1 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:46:57 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8d3a75f-9a9c-46e3-88f6-9e21684c5d3a tempest-ServerActionsTestOtherA-1564634914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:46:57 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f8d3a75f-9a9c-46e3-88f6-9e21684c5d3a tempest-ServerActionsTestOtherA-1564634914 None] Flow 'volume_create_manager' (e4f62e70-4787-4cf8-ac9e-c35b4a4cda20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:46:57 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f8d3a75f-9a9c-46e3-88f6-9e21684c5d3a tempest-ServerActionsTestOtherA-1564634914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aa409ca-44aa-457a-a55b-e080d077f23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:46:57 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f8d3a75f-9a9c-46e3-88f6-9e21684c5d3a tempest-ServerActionsTestOtherA-1564634914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aa409ca-44aa-457a-a55b-e080d077f23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-996108626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad92b852-0a48-47c4-b10d-75132382bb76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2f89a9500294060a4f1ed028640544d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:46:58Z,use_quota=True,user_id='ad51f666b1fb4067abd4007228955299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:46:57 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f8d3a75f-9a9c-46e3-88f6-9e21684c5d3a tempest-ServerActionsTestOtherA-1564634914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83bb4723-92ca-4e23-8334-95084a297a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:46:57 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f8d3a75f-9a9c-46e3-88f6-9e21684c5d3a tempest-ServerActionsTestOtherA-1564634914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83bb4723-92ca-4e23-8334-95084a297a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:46:57 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f8d3a75f-9a9c-46e3-88f6-9e21684c5d3a tempest-ServerActionsTestOtherA-1564634914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c482ef-4bcd-4afd-94a0-af317e4c1461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:46:57 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f8d3a75f-9a9c-46e3-88f6-9e21684c5d3a tempest-ServerActionsTestOtherA-1564634914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c482ef-4bcd-4afd-94a0-af317e4c1461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad92b852-0a48-47c4-b10d-75132382bb76', 'volume_name': 'volume-ad92b852-0a48-47c4-b10d-75132382bb76', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:46:57 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f8d3a75f-9a9c-46e3-88f6-9e21684c5d3a tempest-ServerActionsTestOtherA-1564634914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (745fc467-ad22-4d7c-9e76-2fb75519a4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:46:57 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f8d3a75f-9a9c-46e3-88f6-9e21684c5d3a tempest-ServerActionsTestOtherA-1564634914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (745fc467-ad22-4d7c-9e76-2fb75519a4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:46:57 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f8d3a75f-9a9c-46e3-88f6-9e21684c5d3a tempest-ServerActionsTestOtherA-1564634914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6aa52d-be92-48a2-9e3c-6a13eb0d14ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:46:57 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-f8d3a75f-9a9c-46e3-88f6-9e21684c5d3a tempest-ServerActionsTestOtherA-1564634914 None] Volume ad92b852-0a48-47c4-b10d-75132382bb76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad92b852-0a48-47c4-b10d-75132382bb76', 'volume_size': 1} Aug 10 12:46:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f8d3a75f-9a9c-46e3-88f6-9e21684c5d3a tempest-ServerActionsTestOtherA-1564634914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:46:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f8d3a75f-9a9c-46e3-88f6-9e21684c5d3a tempest-ServerActionsTestOtherA-1564634914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:46:57 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f8d3a75f-9a9c-46e3-88f6-9e21684c5d3a tempest-ServerActionsTestOtherA-1564634914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-996108626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad92b852-0a48-47c4-b10d-75132382bb76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2f89a9500294060a4f1ed028640544d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:46:58Z,use_quota=True,user_id='ad51f666b1fb4067abd4007228955299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:46:57 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-f8d3a75f-9a9c-46e3-88f6-9e21684c5d3a tempest-ServerActionsTestOtherA-1564634914 None] Creating volume ad92b852-0a48-47c4-b10d-75132382bb76 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:46:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f8d3a75f-9a9c-46e3-88f6-9e21684c5d3a tempest-ServerActionsTestOtherA-1564634914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:46:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f8d3a75f-9a9c-46e3-88f6-9e21684c5d3a tempest-ServerActionsTestOtherA-1564634914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:46:57 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f8d3a75f-9a9c-46e3-88f6-9e21684c5d3a tempest-ServerActionsTestOtherA-1564634914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:46:57 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f8d3a75f-9a9c-46e3-88f6-9e21684c5d3a tempest-ServerActionsTestOtherA-1564634914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:46:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f8d3a75f-9a9c-46e3-88f6-9e21684c5d3a tempest-ServerActionsTestOtherA-1564634914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:46:57 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f8d3a75f-9a9c-46e3-88f6-9e21684c5d3a tempest-ServerActionsTestOtherA-1564634914 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:46:57 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-f8d3a75f-9a9c-46e3-88f6-9e21684c5d3a tempest-ServerActionsTestOtherA-1564634914 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:46:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f8d3a75f-9a9c-46e3-88f6-9e21684c5d3a tempest-ServerActionsTestOtherA-1564634914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ad92b852-0a48-47c4-b10d-75132382bb76 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:46:57 devstack sudo[90409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ad92b852-0a48-47c4-b10d-75132382bb76 1073741824 Aug 10 12:46:57 devstack sudo[90409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:46:58 devstack sudo[90409]: pam_unix(sudo:session): session closed for user root Aug 10 12:46:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f8d3a75f-9a9c-46e3-88f6-9e21684c5d3a tempest-ServerActionsTestOtherA-1564634914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ad92b852-0a48-47c4-b10d-75132382bb76 1073741824" returned: 0 in 0.618s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:46:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f8d3a75f-9a9c-46e3-88f6-9e21684c5d3a tempest-ServerActionsTestOtherA-1564634914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ad92b852-0a48-47c4-b10d-75132382bb76 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:46:58 devstack sudo[90416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ad92b852-0a48-47c4-b10d-75132382bb76 Aug 10 12:46:58 devstack sudo[90416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:46:58 devstack sudo[90416]: pam_unix(sudo:session): session closed for user root Aug 10 12:46:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f8d3a75f-9a9c-46e3-88f6-9e21684c5d3a tempest-ServerActionsTestOtherA-1564634914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ad92b852-0a48-47c4-b10d-75132382bb76" returned: 0 in 0.284s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:46:58 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f8d3a75f-9a9c-46e3-88f6-9e21684c5d3a tempest-ServerActionsTestOtherA-1564634914 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:46:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f8d3a75f-9a9c-46e3-88f6-9e21684c5d3a tempest-ServerActionsTestOtherA-1564634914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:46:58 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f8d3a75f-9a9c-46e3-88f6-9e21684c5d3a tempest-ServerActionsTestOtherA-1564634914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6aa52d-be92-48a2-9e3c-6a13eb0d14ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad92b852-0a48-47c4-b10d-75132382bb76', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:46:58 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f8d3a75f-9a9c-46e3-88f6-9e21684c5d3a tempest-ServerActionsTestOtherA-1564634914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0830782-052d-42fb-a393-bd5c9af7fd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:46:58 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-f8d3a75f-9a9c-46e3-88f6-9e21684c5d3a tempest-ServerActionsTestOtherA-1564634914 None] Volume volume-ad92b852-0a48-47c4-b10d-75132382bb76 (ad92b852-0a48-47c4-b10d-75132382bb76): created successfully Aug 10 12:46:58 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f8d3a75f-9a9c-46e3-88f6-9e21684c5d3a tempest-ServerActionsTestOtherA-1564634914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0830782-052d-42fb-a393-bd5c9af7fd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:46:58 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f8d3a75f-9a9c-46e3-88f6-9e21684c5d3a tempest-ServerActionsTestOtherA-1564634914 None] Flow 'volume_create_manager' (e4f62e70-4787-4cf8-ac9e-c35b4a4cda20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:46:58 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-f8d3a75f-9a9c-46e3-88f6-9e21684c5d3a tempest-ServerActionsTestOtherA-1564634914 None] Created volume successfully. Aug 10 12:47:03 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 12:47:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:47:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:47:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:47:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:47:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:47:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:47:03 devstack sudo[90473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:47:03 devstack sudo[90473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:47:04 devstack sudo[90473]: pam_unix(sudo:session): session closed for user root Aug 10 12:47:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.288s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:47:04 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:47:04 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager._thread_info {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 12:47:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread count: 8 {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 12:47:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread info: [<_MainThread(MainThread, started 130607683133568)>, , , , , , , ] {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Aug 10 12:47:08 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:47:08 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:47:18 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=1 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:47:18 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:UPDATE=1 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:47:20 devstack cinder-volume[89096]: WARNING py.warnings [req-089e6c4e-2b51-40a4-8ccb-6fa744d440cf req-52452069-8c15-49bc-8476-3795e0dcd82f tempest-TaggedAttachmentsTest-1987457885 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Aug 10 12:47:20 devstack cinder-volume[89096]: .first() Aug 10 12:47:20 devstack cinder-volume[89096]: Aug 10 12:47:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-089e6c4e-2b51-40a4-8ccb-6fa744d440cf req-52452069-8c15-49bc-8476-3795e0dcd82f tempest-TaggedAttachmentsTest-1987457885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:47:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-089e6c4e-2b51-40a4-8ccb-6fa744d440cf req-52452069-8c15-49bc-8476-3795e0dcd82f tempest-TaggedAttachmentsTest-1987457885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:47:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-089e6c4e-2b51-40a4-8ccb-6fa744d440cf req-52452069-8c15-49bc-8476-3795e0dcd82f tempest-TaggedAttachmentsTest-1987457885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.056s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:47:21 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-089e6c4e-2b51-40a4-8ccb-6fa744d440cf req-52452069-8c15-49bc-8476-3795e0dcd82f tempest-TaggedAttachmentsTest-1987457885 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d', 'name': 'volume-16bc3e14-8d3f-4162-ab96-966a9621c17d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9500d09d-fb58-4fbc-a81c-c4be9f79b310', 'enforce_multipath': True} {{(pid=89096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Aug 10 12:47:21 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-089e6c4e-2b51-40a4-8ccb-6fa744d440cf req-52452069-8c15-49bc-8476-3795e0dcd82f tempest-TaggedAttachmentsTest-1987457885 None] attachment_update completed successfully. Aug 10 12:47:27 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-cc9afd30-1cd4-476d-bd6a-da9d7d783c8e req-61a1d1f8-2ef7-4e82-b8f6-1c2b5f21b509 tempest-TaggedAttachmentsTest-1987457885 None] Terminate volume connection completed successfully. Aug 10 12:47:27 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-cc9afd30-1cd4-476d-bd6a-da9d7d783c8e req-61a1d1f8-2ef7-4e82-b8f6-1c2b5f21b509 tempest-TaggedAttachmentsTest-1987457885 None] Deleting attachment 9500d09d-fb58-4fbc-a81c-c4be9f79b310. {{(pid=89096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Aug 10 12:47:37 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:47:37 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=8 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:47:40 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9d8a8f8-745d-486c-b6f4-f4b542ef5042 tempest-ServersNegativeTestJSON-1408826686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:47:40 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c9d8a8f8-745d-486c-b6f4-f4b542ef5042 tempest-ServersNegativeTestJSON-1408826686 None] Flow 'volume_create_manager' (445c79b6-1d91-47f8-ad76-707fa565c099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:47:40 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c9d8a8f8-745d-486c-b6f4-f4b542ef5042 tempest-ServersNegativeTestJSON-1408826686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a9dbda4-0eca-4d12-b9a6-a172933a2966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:47:40 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c9d8a8f8-745d-486c-b6f4-f4b542ef5042 tempest-ServersNegativeTestJSON-1408826686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a9dbda4-0eca-4d12-b9a6-a172933a2966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:47:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1740827117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08e61745-c99d-4051-b7c5-9823821164d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8309c0ddab4bd681d37b453b0a058f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:47:40Z,use_quota=True,user_id='aab97332f25a497289bd0630cf3fcbc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:47:40 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c9d8a8f8-745d-486c-b6f4-f4b542ef5042 tempest-ServersNegativeTestJSON-1408826686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe5a554-2185-45d3-8671-35b88bf34727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:47:40 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c9d8a8f8-745d-486c-b6f4-f4b542ef5042 tempest-ServersNegativeTestJSON-1408826686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe5a554-2185-45d3-8671-35b88bf34727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:47:40 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c9d8a8f8-745d-486c-b6f4-f4b542ef5042 tempest-ServersNegativeTestJSON-1408826686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69dc8843-0b89-4648-9901-704d7fed4844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:47:40 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c9d8a8f8-745d-486c-b6f4-f4b542ef5042 tempest-ServersNegativeTestJSON-1408826686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69dc8843-0b89-4648-9901-704d7fed4844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08e61745-c99d-4051-b7c5-9823821164d1', 'volume_name': 'volume-08e61745-c99d-4051-b7c5-9823821164d1', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:47:40 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c9d8a8f8-745d-486c-b6f4-f4b542ef5042 tempest-ServersNegativeTestJSON-1408826686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d559dc9b-7496-4702-b234-3da6e548f455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:47:40 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c9d8a8f8-745d-486c-b6f4-f4b542ef5042 tempest-ServersNegativeTestJSON-1408826686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d559dc9b-7496-4702-b234-3da6e548f455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:47:40 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c9d8a8f8-745d-486c-b6f4-f4b542ef5042 tempest-ServersNegativeTestJSON-1408826686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (942b74ae-5950-4a3a-8179-a784512684b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:47:40 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-c9d8a8f8-745d-486c-b6f4-f4b542ef5042 tempest-ServersNegativeTestJSON-1408826686 None] Volume 08e61745-c99d-4051-b7c5-9823821164d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08e61745-c99d-4051-b7c5-9823821164d1', 'volume_size': 1} Aug 10 12:47:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c9d8a8f8-745d-486c-b6f4-f4b542ef5042 tempest-ServersNegativeTestJSON-1408826686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:47:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c9d8a8f8-745d-486c-b6f4-f4b542ef5042 tempest-ServersNegativeTestJSON-1408826686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:47:40 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c9d8a8f8-745d-486c-b6f4-f4b542ef5042 tempest-ServersNegativeTestJSON-1408826686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:47:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1740827117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08e61745-c99d-4051-b7c5-9823821164d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8309c0ddab4bd681d37b453b0a058f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:47:40Z,use_quota=True,user_id='aab97332f25a497289bd0630cf3fcbc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:47:40 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-c9d8a8f8-745d-486c-b6f4-f4b542ef5042 tempest-ServersNegativeTestJSON-1408826686 None] Creating volume 08e61745-c99d-4051-b7c5-9823821164d1 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:47:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c9d8a8f8-745d-486c-b6f4-f4b542ef5042 tempest-ServersNegativeTestJSON-1408826686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:47:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c9d8a8f8-745d-486c-b6f4-f4b542ef5042 tempest-ServersNegativeTestJSON-1408826686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:47:40 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c9d8a8f8-745d-486c-b6f4-f4b542ef5042 tempest-ServersNegativeTestJSON-1408826686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:47:40 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c9d8a8f8-745d-486c-b6f4-f4b542ef5042 tempest-ServersNegativeTestJSON-1408826686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:47:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c9d8a8f8-745d-486c-b6f4-f4b542ef5042 tempest-ServersNegativeTestJSON-1408826686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:47:40 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c9d8a8f8-745d-486c-b6f4-f4b542ef5042 tempest-ServersNegativeTestJSON-1408826686 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:47:40 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-c9d8a8f8-745d-486c-b6f4-f4b542ef5042 tempest-ServersNegativeTestJSON-1408826686 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:47:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c9d8a8f8-745d-486c-b6f4-f4b542ef5042 tempest-ServersNegativeTestJSON-1408826686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-08e61745-c99d-4051-b7c5-9823821164d1 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:47:40 devstack sudo[91423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-08e61745-c99d-4051-b7c5-9823821164d1 1073741824 Aug 10 12:47:40 devstack sudo[91423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:47:40 devstack sudo[91423]: pam_unix(sudo:session): session closed for user root Aug 10 12:47:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c9d8a8f8-745d-486c-b6f4-f4b542ef5042 tempest-ServersNegativeTestJSON-1408826686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-08e61745-c99d-4051-b7c5-9823821164d1 1073741824" returned: 0 in 0.571s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:47:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c9d8a8f8-745d-486c-b6f4-f4b542ef5042 tempest-ServersNegativeTestJSON-1408826686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-08e61745-c99d-4051-b7c5-9823821164d1 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:47:40 devstack sudo[91431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-08e61745-c99d-4051-b7c5-9823821164d1 Aug 10 12:47:41 devstack sudo[91431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:47:41 devstack sudo[91431]: pam_unix(sudo:session): session closed for user root Aug 10 12:47:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c9d8a8f8-745d-486c-b6f4-f4b542ef5042 tempest-ServersNegativeTestJSON-1408826686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-08e61745-c99d-4051-b7c5-9823821164d1" returned: 0 in 0.317s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:47:41 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c9d8a8f8-745d-486c-b6f4-f4b542ef5042 tempest-ServersNegativeTestJSON-1408826686 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:47:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c9d8a8f8-745d-486c-b6f4-f4b542ef5042 tempest-ServersNegativeTestJSON-1408826686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:47:41 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c9d8a8f8-745d-486c-b6f4-f4b542ef5042 tempest-ServersNegativeTestJSON-1408826686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (942b74ae-5950-4a3a-8179-a784512684b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08e61745-c99d-4051-b7c5-9823821164d1', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:47:41 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c9d8a8f8-745d-486c-b6f4-f4b542ef5042 tempest-ServersNegativeTestJSON-1408826686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2710218b-bc2d-4d6b-96d1-f7836feb7803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:47:41 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-c9d8a8f8-745d-486c-b6f4-f4b542ef5042 tempest-ServersNegativeTestJSON-1408826686 None] Volume volume-08e61745-c99d-4051-b7c5-9823821164d1 (08e61745-c99d-4051-b7c5-9823821164d1): created successfully Aug 10 12:47:41 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c9d8a8f8-745d-486c-b6f4-f4b542ef5042 tempest-ServersNegativeTestJSON-1408826686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2710218b-bc2d-4d6b-96d1-f7836feb7803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:47:41 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c9d8a8f8-745d-486c-b6f4-f4b542ef5042 tempest-ServersNegativeTestJSON-1408826686 None] Flow 'volume_create_manager' (445c79b6-1d91-47f8-ad76-707fa565c099) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:47:41 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-c9d8a8f8-745d-486c-b6f4-f4b542ef5042 tempest-ServersNegativeTestJSON-1408826686 None] Created volume successfully. Aug 10 12:47:44 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d7b39326-6512-48cc-be1a-c5caa59f319e tempest-TaggedAttachmentsTest-1987457885 None] Acquiring lock "cinder-16bc3e14-8d3f-4162-ab96-966a9621c17d-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:47:44 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d7b39326-6512-48cc-be1a-c5caa59f319e tempest-TaggedAttachmentsTest-1987457885 None] Lock "cinder-16bc3e14-8d3f-4162-ab96-966a9621c17d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:47:44 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d7b39326-6512-48cc-be1a-c5caa59f319e tempest-TaggedAttachmentsTest-1987457885 None] Acquiring lock "cinder-quobyte-16bc3e14-8d3f-4162-ab96-966a9621c17d" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:47:44 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d7b39326-6512-48cc-be1a-c5caa59f319e tempest-TaggedAttachmentsTest-1987457885 None] Lock "cinder-quobyte-16bc3e14-8d3f-4162-ab96-966a9621c17d" acquired by "delete_volume" :: waited 0.028s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:47:44 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b30282-76f5-406b-9fb1-736dfbf2dc14]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:47:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d7b39326-6512-48cc-be1a-c5caa59f319e tempest-TaggedAttachmentsTest-1987457885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-16bc3e14-8d3f-4162-ab96-966a9621c17d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:47:44 devstack sudo[91532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-16bc3e14-8d3f-4162-ab96-966a9621c17d Aug 10 12:47:44 devstack sudo[91532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:47:45 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-03e55a54-1aa8-4a42-ad12-6640cce6743b tempest-ServersNegativeTestJSON-1408826686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:47:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-03e55a54-1aa8-4a42-ad12-6640cce6743b tempest-ServersNegativeTestJSON-1408826686 None] Flow 'volume_create_manager' (30000713-5bef-43ec-a541-81e04b3c0d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:47:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-03e55a54-1aa8-4a42-ad12-6640cce6743b tempest-ServersNegativeTestJSON-1408826686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76507af0-f46f-4ee5-82f0-038c8616633c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:47:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-03e55a54-1aa8-4a42-ad12-6640cce6743b tempest-ServersNegativeTestJSON-1408826686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76507af0-f46f-4ee5-82f0-038c8616633c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2047766968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4a48324-70cf-422d-992f-ea3aec3fd6fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8309c0ddab4bd681d37b453b0a058f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:47:45Z,use_quota=True,user_id='aab97332f25a497289bd0630cf3fcbc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:47:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-03e55a54-1aa8-4a42-ad12-6640cce6743b tempest-ServersNegativeTestJSON-1408826686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (645f4129-3bc1-4031-a709-50f79074cbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:47:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-03e55a54-1aa8-4a42-ad12-6640cce6743b tempest-ServersNegativeTestJSON-1408826686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (645f4129-3bc1-4031-a709-50f79074cbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:47:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-03e55a54-1aa8-4a42-ad12-6640cce6743b tempest-ServersNegativeTestJSON-1408826686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1258201-ee5e-48c1-8138-49e57dec711c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:47:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-03e55a54-1aa8-4a42-ad12-6640cce6743b tempest-ServersNegativeTestJSON-1408826686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1258201-ee5e-48c1-8138-49e57dec711c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4a48324-70cf-422d-992f-ea3aec3fd6fa', 'volume_name': 'volume-c4a48324-70cf-422d-992f-ea3aec3fd6fa', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:47:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-03e55a54-1aa8-4a42-ad12-6640cce6743b tempest-ServersNegativeTestJSON-1408826686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3933863-db8f-4d57-b74c-8769a27d8c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:47:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-03e55a54-1aa8-4a42-ad12-6640cce6743b tempest-ServersNegativeTestJSON-1408826686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3933863-db8f-4d57-b74c-8769a27d8c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:47:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-03e55a54-1aa8-4a42-ad12-6640cce6743b tempest-ServersNegativeTestJSON-1408826686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f09d23ae-4708-4dde-a3ef-53385535a1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:47:45 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-03e55a54-1aa8-4a42-ad12-6640cce6743b tempest-ServersNegativeTestJSON-1408826686 None] Volume c4a48324-70cf-422d-992f-ea3aec3fd6fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4a48324-70cf-422d-992f-ea3aec3fd6fa', 'volume_size': 1} Aug 10 12:47:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-03e55a54-1aa8-4a42-ad12-6640cce6743b tempest-ServersNegativeTestJSON-1408826686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:47:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-03e55a54-1aa8-4a42-ad12-6640cce6743b tempest-ServersNegativeTestJSON-1408826686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:47:45 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-03e55a54-1aa8-4a42-ad12-6640cce6743b tempest-ServersNegativeTestJSON-1408826686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2047766968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4a48324-70cf-422d-992f-ea3aec3fd6fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8309c0ddab4bd681d37b453b0a058f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:47:45Z,use_quota=True,user_id='aab97332f25a497289bd0630cf3fcbc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:47:45 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-03e55a54-1aa8-4a42-ad12-6640cce6743b tempest-ServersNegativeTestJSON-1408826686 None] Creating volume c4a48324-70cf-422d-992f-ea3aec3fd6fa {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:47:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-03e55a54-1aa8-4a42-ad12-6640cce6743b tempest-ServersNegativeTestJSON-1408826686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:47:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-03e55a54-1aa8-4a42-ad12-6640cce6743b tempest-ServersNegativeTestJSON-1408826686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:47:45 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-03e55a54-1aa8-4a42-ad12-6640cce6743b tempest-ServersNegativeTestJSON-1408826686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:47:45 devstack sudo[91532]: pam_unix(sudo:session): session closed for user root Aug 10 12:47:45 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-03e55a54-1aa8-4a42-ad12-6640cce6743b tempest-ServersNegativeTestJSON-1408826686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:47:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-03e55a54-1aa8-4a42-ad12-6640cce6743b tempest-ServersNegativeTestJSON-1408826686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:47:45 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-03e55a54-1aa8-4a42-ad12-6640cce6743b tempest-ServersNegativeTestJSON-1408826686 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:47:45 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-03e55a54-1aa8-4a42-ad12-6640cce6743b tempest-ServersNegativeTestJSON-1408826686 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:47:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-03e55a54-1aa8-4a42-ad12-6640cce6743b tempest-ServersNegativeTestJSON-1408826686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c4a48324-70cf-422d-992f-ea3aec3fd6fa 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:47:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d7b39326-6512-48cc-be1a-c5caa59f319e tempest-TaggedAttachmentsTest-1987457885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-16bc3e14-8d3f-4162-ab96-966a9621c17d" returned: 0 in 0.798s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:47:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d7b39326-6512-48cc-be1a-c5caa59f319e tempest-TaggedAttachmentsTest-1987457885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-16bc3e14-8d3f-4162-ab96-966a9621c17d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:47:45 devstack sudo[91548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c4a48324-70cf-422d-992f-ea3aec3fd6fa 1073741824 Aug 10 12:47:45 devstack sudo[91548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:47:45 devstack sudo[91550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-16bc3e14-8d3f-4162-ab96-966a9621c17d Aug 10 12:47:45 devstack sudo[91550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:47:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-f82d6e34-2fd0-42e3-a9ae-0c6829e61fda req-4605ab23-7edb-4096-8f98-cfeb3c7c7ff8 tempest-ServerActionsTestOtherA-1564634914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:47:45 devstack sudo[91550]: pam_unix(sudo:session): session closed for user root Aug 10 12:47:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d7b39326-6512-48cc-be1a-c5caa59f319e tempest-TaggedAttachmentsTest-1987457885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-16bc3e14-8d3f-4162-ab96-966a9621c17d" returned: 0 in 0.376s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:47:45 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d7b39326-6512-48cc-be1a-c5caa59f319e tempest-TaggedAttachmentsTest-1987457885 None] Lock "cinder-quobyte-16bc3e14-8d3f-4162-ab96-966a9621c17d" released by "delete_volume" :: held 1.236s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:47:45 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-d7b39326-6512-48cc-be1a-c5caa59f319e tempest-TaggedAttachmentsTest-1987457885 None] Created reservations ['c811e359-6d50-411e-a4de-bd5846437ff3', '23563faf-12a4-4b99-901b-392d2a9aec20', '82781ae6-1bdd-4e5b-aef6-e13636b95d55', '09bde4dd-ea52-4393-8287-d1731732491b'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:47:46 devstack sudo[91548]: pam_unix(sudo:session): session closed for user root Aug 10 12:47:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-03e55a54-1aa8-4a42-ad12-6640cce6743b tempest-ServersNegativeTestJSON-1408826686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c4a48324-70cf-422d-992f-ea3aec3fd6fa 1073741824" returned: 0 in 0.593s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:47:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d7b39326-6512-48cc-be1a-c5caa59f319e tempest-TaggedAttachmentsTest-1987457885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:47:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d7b39326-6512-48cc-be1a-c5caa59f319e tempest-TaggedAttachmentsTest-1987457885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:47:46 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-d7b39326-6512-48cc-be1a-c5caa59f319e tempest-TaggedAttachmentsTest-1987457885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:47:46 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-d7b39326-6512-48cc-be1a-c5caa59f319e tempest-TaggedAttachmentsTest-1987457885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:47:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d7b39326-6512-48cc-be1a-c5caa59f319e tempest-TaggedAttachmentsTest-1987457885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:47:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d7b39326-6512-48cc-be1a-c5caa59f319e tempest-TaggedAttachmentsTest-1987457885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:47:46 devstack sudo[91560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:47:46 devstack sudo[91560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:47:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-03e55a54-1aa8-4a42-ad12-6640cce6743b tempest-ServersNegativeTestJSON-1408826686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c4a48324-70cf-422d-992f-ea3aec3fd6fa {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:47:46 devstack sudo[91562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c4a48324-70cf-422d-992f-ea3aec3fd6fa Aug 10 12:47:46 devstack sudo[91562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:47:46 devstack sudo[91560]: pam_unix(sudo:session): session closed for user root Aug 10 12:47:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d7b39326-6512-48cc-be1a-c5caa59f319e tempest-TaggedAttachmentsTest-1987457885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.266s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:47:46 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-d7b39326-6512-48cc-be1a-c5caa59f319e tempest-TaggedAttachmentsTest-1987457885 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:47:46 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-d7b39326-6512-48cc-be1a-c5caa59f319e tempest-TaggedAttachmentsTest-1987457885 None] Deleted volume successfully. Aug 10 12:47:46 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d7b39326-6512-48cc-be1a-c5caa59f319e tempest-TaggedAttachmentsTest-1987457885 None] Lock "cinder-16bc3e14-8d3f-4162-ab96-966a9621c17d-delete_volume" released by "delete_volume" :: held 1.886s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:47:46 devstack sudo[91562]: pam_unix(sudo:session): session closed for user root Aug 10 12:47:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-03e55a54-1aa8-4a42-ad12-6640cce6743b tempest-ServersNegativeTestJSON-1408826686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c4a48324-70cf-422d-992f-ea3aec3fd6fa" returned: 0 in 0.283s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:47:46 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-03e55a54-1aa8-4a42-ad12-6640cce6743b tempest-ServersNegativeTestJSON-1408826686 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:47:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-03e55a54-1aa8-4a42-ad12-6640cce6743b tempest-ServersNegativeTestJSON-1408826686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:47:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-f82d6e34-2fd0-42e3-a9ae-0c6829e61fda req-4605ab23-7edb-4096-8f98-cfeb3c7c7ff8 tempest-ServerActionsTestOtherA-1564634914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.708s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:47:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-03e55a54-1aa8-4a42-ad12-6640cce6743b tempest-ServersNegativeTestJSON-1408826686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f09d23ae-4708-4dde-a3ef-53385535a1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4a48324-70cf-422d-992f-ea3aec3fd6fa', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:47:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-03e55a54-1aa8-4a42-ad12-6640cce6743b tempest-ServersNegativeTestJSON-1408826686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6115e0e-5bc6-4cc2-90a6-36803dcdb78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:47:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-f82d6e34-2fd0-42e3-a9ae-0c6829e61fda req-4605ab23-7edb-4096-8f98-cfeb3c7c7ff8 tempest-ServerActionsTestOtherA-1564634914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:47:46 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-03e55a54-1aa8-4a42-ad12-6640cce6743b tempest-ServersNegativeTestJSON-1408826686 None] Volume volume-c4a48324-70cf-422d-992f-ea3aec3fd6fa (c4a48324-70cf-422d-992f-ea3aec3fd6fa): created successfully Aug 10 12:47:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-03e55a54-1aa8-4a42-ad12-6640cce6743b tempest-ServersNegativeTestJSON-1408826686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6115e0e-5bc6-4cc2-90a6-36803dcdb78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:47:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-03e55a54-1aa8-4a42-ad12-6640cce6743b tempest-ServersNegativeTestJSON-1408826686 None] Flow 'volume_create_manager' (30000713-5bef-43ec-a541-81e04b3c0d9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:47:46 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-03e55a54-1aa8-4a42-ad12-6640cce6743b tempest-ServersNegativeTestJSON-1408826686 None] Created volume successfully. Aug 10 12:47:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-f82d6e34-2fd0-42e3-a9ae-0c6829e61fda req-4605ab23-7edb-4096-8f98-cfeb3c7c7ff8 tempest-ServerActionsTestOtherA-1564634914 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d', 'name': 'volume-ad92b852-0a48-47c4-b10d-75132382bb76', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '971aadab-6882-41ef-832e-102786a4ff31', 'enforce_multipath': True} {{(pid=89096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Aug 10 12:47:46 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-f82d6e34-2fd0-42e3-a9ae-0c6829e61fda req-4605ab23-7edb-4096-8f98-cfeb3c7c7ff8 tempest-ServerActionsTestOtherA-1564634914 None] attachment_update completed successfully. Aug 10 12:47:47 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-54a11993-a164-49c9-949c-5c0248f883ac tempest-ServersNegativeTestJSON-1408826686 None] Acquiring lock "cinder-c4a48324-70cf-422d-992f-ea3aec3fd6fa-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:47:47 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-54a11993-a164-49c9-949c-5c0248f883ac tempest-ServersNegativeTestJSON-1408826686 None] Lock "cinder-c4a48324-70cf-422d-992f-ea3aec3fd6fa-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:47:47 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-54a11993-a164-49c9-949c-5c0248f883ac tempest-ServersNegativeTestJSON-1408826686 None] Acquiring lock "cinder-quobyte-c4a48324-70cf-422d-992f-ea3aec3fd6fa" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:47:47 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-54a11993-a164-49c9-949c-5c0248f883ac tempest-ServersNegativeTestJSON-1408826686 None] Lock "cinder-quobyte-c4a48324-70cf-422d-992f-ea3aec3fd6fa" acquired by "delete_volume" :: waited 0.061s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:47:48 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f2e24b-6e93-4990-833c-e1d0525e3356]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:47:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-54a11993-a164-49c9-949c-5c0248f883ac tempest-ServersNegativeTestJSON-1408826686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c4a48324-70cf-422d-992f-ea3aec3fd6fa {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:47:48 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fb3111e-eb43-4442-b822-078902754fbe tempest-DeleteServersTestJSON-754230276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:47:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3fb3111e-eb43-4442-b822-078902754fbe tempest-DeleteServersTestJSON-754230276 None] Flow 'volume_create_manager' (0ece5f20-7275-4eae-8158-2e694a150fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:47:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3fb3111e-eb43-4442-b822-078902754fbe tempest-DeleteServersTestJSON-754230276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3670d246-d160-4fee-9179-9c5c569f345b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:47:48 devstack sudo[91952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c4a48324-70cf-422d-992f-ea3aec3fd6fa Aug 10 12:47:48 devstack sudo[91952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:47:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3fb3111e-eb43-4442-b822-078902754fbe tempest-DeleteServersTestJSON-754230276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3670d246-d160-4fee-9179-9c5c569f345b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-14502629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca44d138-dfde-46d4-bd72-a84161b9a906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='979b7d3091bc4600ba6c78ca0e43a4dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:47:48Z,use_quota=True,user_id='8ae0903a637948a8bc7614900d3c3daa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:47:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3fb3111e-eb43-4442-b822-078902754fbe tempest-DeleteServersTestJSON-754230276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc2559f2-e82d-4cc0-bd65-d7d8c08bc236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:47:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3fb3111e-eb43-4442-b822-078902754fbe tempest-DeleteServersTestJSON-754230276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc2559f2-e82d-4cc0-bd65-d7d8c08bc236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:47:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3fb3111e-eb43-4442-b822-078902754fbe tempest-DeleteServersTestJSON-754230276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4fae4c7-5892-4962-b286-c196b1307eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:47:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3fb3111e-eb43-4442-b822-078902754fbe tempest-DeleteServersTestJSON-754230276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4fae4c7-5892-4962-b286-c196b1307eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca44d138-dfde-46d4-bd72-a84161b9a906', 'volume_name': 'volume-ca44d138-dfde-46d4-bd72-a84161b9a906', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:47:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3fb3111e-eb43-4442-b822-078902754fbe tempest-DeleteServersTestJSON-754230276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2695212b-e551-426c-ba98-86ceeb150ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:47:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3fb3111e-eb43-4442-b822-078902754fbe tempest-DeleteServersTestJSON-754230276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2695212b-e551-426c-ba98-86ceeb150ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:47:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3fb3111e-eb43-4442-b822-078902754fbe tempest-DeleteServersTestJSON-754230276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3789d098-82fa-4c8a-ac4b-894d52256b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:47:48 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-3fb3111e-eb43-4442-b822-078902754fbe tempest-DeleteServersTestJSON-754230276 None] Volume ca44d138-dfde-46d4-bd72-a84161b9a906: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca44d138-dfde-46d4-bd72-a84161b9a906', 'volume_size': 1} Aug 10 12:47:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3fb3111e-eb43-4442-b822-078902754fbe tempest-DeleteServersTestJSON-754230276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:47:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3fb3111e-eb43-4442-b822-078902754fbe tempest-DeleteServersTestJSON-754230276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:47:48 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3fb3111e-eb43-4442-b822-078902754fbe tempest-DeleteServersTestJSON-754230276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-14502629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca44d138-dfde-46d4-bd72-a84161b9a906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='979b7d3091bc4600ba6c78ca0e43a4dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:47:48Z,use_quota=True,user_id='8ae0903a637948a8bc7614900d3c3daa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:47:48 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-3fb3111e-eb43-4442-b822-078902754fbe tempest-DeleteServersTestJSON-754230276 None] Creating volume ca44d138-dfde-46d4-bd72-a84161b9a906 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:47:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3fb3111e-eb43-4442-b822-078902754fbe tempest-DeleteServersTestJSON-754230276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:47:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3fb3111e-eb43-4442-b822-078902754fbe tempest-DeleteServersTestJSON-754230276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:47:48 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3fb3111e-eb43-4442-b822-078902754fbe tempest-DeleteServersTestJSON-754230276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:47:48 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3fb3111e-eb43-4442-b822-078902754fbe tempest-DeleteServersTestJSON-754230276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:47:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3fb3111e-eb43-4442-b822-078902754fbe tempest-DeleteServersTestJSON-754230276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:47:48 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3fb3111e-eb43-4442-b822-078902754fbe tempest-DeleteServersTestJSON-754230276 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:47:48 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-3fb3111e-eb43-4442-b822-078902754fbe tempest-DeleteServersTestJSON-754230276 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:47:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3fb3111e-eb43-4442-b822-078902754fbe tempest-DeleteServersTestJSON-754230276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ca44d138-dfde-46d4-bd72-a84161b9a906 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:47:48 devstack sudo[91954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ca44d138-dfde-46d4-bd72-a84161b9a906 1073741824 Aug 10 12:47:48 devstack sudo[91954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:47:48 devstack sudo[91952]: pam_unix(sudo:session): session closed for user root Aug 10 12:47:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-54a11993-a164-49c9-949c-5c0248f883ac tempest-ServersNegativeTestJSON-1408826686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c4a48324-70cf-422d-992f-ea3aec3fd6fa" returned: 0 in 0.596s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:47:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-54a11993-a164-49c9-949c-5c0248f883ac tempest-ServersNegativeTestJSON-1408826686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c4a48324-70cf-422d-992f-ea3aec3fd6fa {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:47:48 devstack sudo[91959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c4a48324-70cf-422d-992f-ea3aec3fd6fa Aug 10 12:47:48 devstack sudo[91959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:47:48 devstack sudo[91959]: pam_unix(sudo:session): session closed for user root Aug 10 12:47:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-54a11993-a164-49c9-949c-5c0248f883ac tempest-ServersNegativeTestJSON-1408826686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c4a48324-70cf-422d-992f-ea3aec3fd6fa" returned: 0 in 0.382s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:47:48 devstack sudo[91954]: pam_unix(sudo:session): session closed for user root Aug 10 12:47:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3fb3111e-eb43-4442-b822-078902754fbe tempest-DeleteServersTestJSON-754230276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ca44d138-dfde-46d4-bd72-a84161b9a906 1073741824" returned: 0 in 0.724s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:47:49 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-54a11993-a164-49c9-949c-5c0248f883ac tempest-ServersNegativeTestJSON-1408826686 None] Lock "cinder-quobyte-c4a48324-70cf-422d-992f-ea3aec3fd6fa" released by "delete_volume" :: held 1.074s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:47:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3fb3111e-eb43-4442-b822-078902754fbe tempest-DeleteServersTestJSON-754230276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ca44d138-dfde-46d4-bd72-a84161b9a906 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:47:49 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-54a11993-a164-49c9-949c-5c0248f883ac tempest-ServersNegativeTestJSON-1408826686 None] Created reservations ['fd9cf7e7-c3bd-4bed-83a1-699fce38ffab', '76fb90de-c914-43f1-9fb4-4bbe66b9d686', 'e41f5a6d-6d05-4c3d-82dc-8f79e5ac21de', '3e7c1c19-4c53-47de-a26e-f61afad63ebf'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:47:49 devstack sudo[91966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ca44d138-dfde-46d4-bd72-a84161b9a906 Aug 10 12:47:49 devstack sudo[91966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:47:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-54a11993-a164-49c9-949c-5c0248f883ac tempest-ServersNegativeTestJSON-1408826686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:47:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-54a11993-a164-49c9-949c-5c0248f883ac tempest-ServersNegativeTestJSON-1408826686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:47:49 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-54a11993-a164-49c9-949c-5c0248f883ac tempest-ServersNegativeTestJSON-1408826686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:47:49 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-54a11993-a164-49c9-949c-5c0248f883ac tempest-ServersNegativeTestJSON-1408826686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:47:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-54a11993-a164-49c9-949c-5c0248f883ac tempest-ServersNegativeTestJSON-1408826686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:47:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-54a11993-a164-49c9-949c-5c0248f883ac tempest-ServersNegativeTestJSON-1408826686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:47:49 devstack sudo[91968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:47:49 devstack sudo[91968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:47:49 devstack sudo[91966]: pam_unix(sudo:session): session closed for user root Aug 10 12:47:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3fb3111e-eb43-4442-b822-078902754fbe tempest-DeleteServersTestJSON-754230276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ca44d138-dfde-46d4-bd72-a84161b9a906" returned: 0 in 0.503s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:47:49 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3fb3111e-eb43-4442-b822-078902754fbe tempest-DeleteServersTestJSON-754230276 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:47:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3fb3111e-eb43-4442-b822-078902754fbe tempest-DeleteServersTestJSON-754230276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:47:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3fb3111e-eb43-4442-b822-078902754fbe tempest-DeleteServersTestJSON-754230276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3789d098-82fa-4c8a-ac4b-894d52256b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca44d138-dfde-46d4-bd72-a84161b9a906', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:47:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3fb3111e-eb43-4442-b822-078902754fbe tempest-DeleteServersTestJSON-754230276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd77b7b4-20f9-4f29-8d08-f3ddfa427abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:47:49 devstack sudo[91968]: pam_unix(sudo:session): session closed for user root Aug 10 12:47:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-54a11993-a164-49c9-949c-5c0248f883ac tempest-ServersNegativeTestJSON-1408826686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.456s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:47:49 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-54a11993-a164-49c9-949c-5c0248f883ac tempest-ServersNegativeTestJSON-1408826686 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:47:49 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-54a11993-a164-49c9-949c-5c0248f883ac tempest-ServersNegativeTestJSON-1408826686 None] Deleted volume successfully. Aug 10 12:47:49 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-3fb3111e-eb43-4442-b822-078902754fbe tempest-DeleteServersTestJSON-754230276 None] Volume volume-ca44d138-dfde-46d4-bd72-a84161b9a906 (ca44d138-dfde-46d4-bd72-a84161b9a906): created successfully Aug 10 12:47:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3fb3111e-eb43-4442-b822-078902754fbe tempest-DeleteServersTestJSON-754230276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd77b7b4-20f9-4f29-8d08-f3ddfa427abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:47:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3fb3111e-eb43-4442-b822-078902754fbe tempest-DeleteServersTestJSON-754230276 None] Flow 'volume_create_manager' (0ece5f20-7275-4eae-8158-2e694a150fa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:47:49 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-54a11993-a164-49c9-949c-5c0248f883ac tempest-ServersNegativeTestJSON-1408826686 None] Lock "cinder-c4a48324-70cf-422d-992f-ea3aec3fd6fa-delete_volume" released by "delete_volume" :: held 1.978s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:47:49 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-3fb3111e-eb43-4442-b822-078902754fbe tempest-DeleteServersTestJSON-754230276 None] Created volume successfully. Aug 10 12:47:50 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8f0c894a-e8b7-4886-bd1f-2912f7081d4a tempest-ServersNegativeTestJSON-1408826686 None] Acquiring lock "cinder-08e61745-c99d-4051-b7c5-9823821164d1-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:47:50 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8f0c894a-e8b7-4886-bd1f-2912f7081d4a tempest-ServersNegativeTestJSON-1408826686 None] Lock "cinder-08e61745-c99d-4051-b7c5-9823821164d1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:47:50 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8f0c894a-e8b7-4886-bd1f-2912f7081d4a tempest-ServersNegativeTestJSON-1408826686 None] Acquiring lock "cinder-quobyte-08e61745-c99d-4051-b7c5-9823821164d1" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:47:50 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8f0c894a-e8b7-4886-bd1f-2912f7081d4a tempest-ServersNegativeTestJSON-1408826686 None] Lock "cinder-quobyte-08e61745-c99d-4051-b7c5-9823821164d1" acquired by "delete_volume" :: waited 0.041s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:47:50 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b991f08-5494-475e-9b7d-ed5f51a091ec]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:47:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8f0c894a-e8b7-4886-bd1f-2912f7081d4a tempest-ServersNegativeTestJSON-1408826686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-08e61745-c99d-4051-b7c5-9823821164d1 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:47:50 devstack sudo[91977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-08e61745-c99d-4051-b7c5-9823821164d1 Aug 10 12:47:50 devstack sudo[91977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:47:50 devstack sudo[91977]: pam_unix(sudo:session): session closed for user root Aug 10 12:47:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8f0c894a-e8b7-4886-bd1f-2912f7081d4a tempest-ServersNegativeTestJSON-1408826686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-08e61745-c99d-4051-b7c5-9823821164d1" returned: 0 in 0.609s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:47:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8f0c894a-e8b7-4886-bd1f-2912f7081d4a tempest-ServersNegativeTestJSON-1408826686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-08e61745-c99d-4051-b7c5-9823821164d1 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:47:51 devstack sudo[91986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-08e61745-c99d-4051-b7c5-9823821164d1 Aug 10 12:47:51 devstack sudo[91986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:47:51 devstack sudo[91986]: pam_unix(sudo:session): session closed for user root Aug 10 12:47:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8f0c894a-e8b7-4886-bd1f-2912f7081d4a tempest-ServersNegativeTestJSON-1408826686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-08e61745-c99d-4051-b7c5-9823821164d1" returned: 0 in 0.448s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:47:51 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8f0c894a-e8b7-4886-bd1f-2912f7081d4a tempest-ServersNegativeTestJSON-1408826686 None] Lock "cinder-quobyte-08e61745-c99d-4051-b7c5-9823821164d1" released by "delete_volume" :: held 1.129s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:47:51 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-8f0c894a-e8b7-4886-bd1f-2912f7081d4a tempest-ServersNegativeTestJSON-1408826686 None] Created reservations ['81d1b87a-ca05-467f-bb30-7f8c1a399990', 'd729573c-7109-401f-ac13-5f52d0cd288a', '3306fbec-6449-4a34-b1db-cba9bc4354ef', 'b8c048c1-5195-47d7-8e74-11a7a38016e2'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:47:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8f0c894a-e8b7-4886-bd1f-2912f7081d4a tempest-ServersNegativeTestJSON-1408826686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:47:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8f0c894a-e8b7-4886-bd1f-2912f7081d4a tempest-ServersNegativeTestJSON-1408826686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:47:51 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8f0c894a-e8b7-4886-bd1f-2912f7081d4a tempest-ServersNegativeTestJSON-1408826686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:47:51 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8f0c894a-e8b7-4886-bd1f-2912f7081d4a tempest-ServersNegativeTestJSON-1408826686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:47:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8f0c894a-e8b7-4886-bd1f-2912f7081d4a tempest-ServersNegativeTestJSON-1408826686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:47:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8f0c894a-e8b7-4886-bd1f-2912f7081d4a tempest-ServersNegativeTestJSON-1408826686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:47:51 devstack sudo[92002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:47:51 devstack sudo[92002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:47:52 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-4806e85c-de82-4e6b-b723-a93f9f6d3f50 req-8ef5f3de-e177-4af7-988b-528062af63e7 tempest-ServerActionsTestOtherA-1564634914 None] Terminate volume connection completed successfully. Aug 10 12:47:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-4806e85c-de82-4e6b-b723-a93f9f6d3f50 req-8ef5f3de-e177-4af7-988b-528062af63e7 tempest-ServerActionsTestOtherA-1564634914 None] Deleting attachment 971aadab-6882-41ef-832e-102786a4ff31. {{(pid=89096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Aug 10 12:47:52 devstack sudo[92002]: pam_unix(sudo:session): session closed for user root Aug 10 12:47:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8f0c894a-e8b7-4886-bd1f-2912f7081d4a tempest-ServersNegativeTestJSON-1408826686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.568s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:47:52 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-8f0c894a-e8b7-4886-bd1f-2912f7081d4a tempest-ServersNegativeTestJSON-1408826686 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:47:52 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-8f0c894a-e8b7-4886-bd1f-2912f7081d4a tempest-ServersNegativeTestJSON-1408826686 None] Deleted volume successfully. Aug 10 12:47:52 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8f0c894a-e8b7-4886-bd1f-2912f7081d4a tempest-ServersNegativeTestJSON-1408826686 None] Lock "cinder-08e61745-c99d-4051-b7c5-9823821164d1-delete_volume" released by "delete_volume" :: held 2.231s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:47:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-d577649e-44e4-4e1f-9843-64ef5e642d40 req-bee68f27-3f1e-49ac-ae1e-864388a95cce tempest-DeleteServersTestJSON-754230276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:47:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-d577649e-44e4-4e1f-9843-64ef5e642d40 req-bee68f27-3f1e-49ac-ae1e-864388a95cce tempest-DeleteServersTestJSON-754230276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:47:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-d577649e-44e4-4e1f-9843-64ef5e642d40 req-bee68f27-3f1e-49ac-ae1e-864388a95cce tempest-DeleteServersTestJSON-754230276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.075s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:47:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-d577649e-44e4-4e1f-9843-64ef5e642d40 req-bee68f27-3f1e-49ac-ae1e-864388a95cce tempest-DeleteServersTestJSON-754230276 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d', 'name': 'volume-ca44d138-dfde-46d4-bd72-a84161b9a906', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'db7298d9-8810-4420-9157-6dcbfd6c4c32', 'enforce_multipath': True} {{(pid=89096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Aug 10 12:47:53 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-d577649e-44e4-4e1f-9843-64ef5e642d40 req-bee68f27-3f1e-49ac-ae1e-864388a95cce tempest-DeleteServersTestJSON-754230276 None] attachment_update completed successfully. Aug 10 12:47:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-4806e85c-de82-4e6b-b723-a93f9f6d3f50 req-22ccd4b2-eb4d-4fbb-816a-c558151943a7 tempest-ServerActionsTestOtherA-1564634914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:47:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-4806e85c-de82-4e6b-b723-a93f9f6d3f50 req-22ccd4b2-eb4d-4fbb-816a-c558151943a7 tempest-ServerActionsTestOtherA-1564634914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:47:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-4806e85c-de82-4e6b-b723-a93f9f6d3f50 req-22ccd4b2-eb4d-4fbb-816a-c558151943a7 tempest-ServerActionsTestOtherA-1564634914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:47:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-4806e85c-de82-4e6b-b723-a93f9f6d3f50 req-22ccd4b2-eb4d-4fbb-816a-c558151943a7 tempest-ServerActionsTestOtherA-1564634914 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d', 'name': 'volume-ad92b852-0a48-47c4-b10d-75132382bb76', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6cf7ec8f-2bd8-497a-864c-396c9bc97d88', 'enforce_multipath': True} {{(pid=89096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Aug 10 12:47:54 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-4806e85c-de82-4e6b-b723-a93f9f6d3f50 req-22ccd4b2-eb4d-4fbb-816a-c558151943a7 tempest-ServerActionsTestOtherA-1564634914 None] attachment_update completed successfully. Aug 10 12:48:02 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-92a46414-21e7-45ea-b6d9-d8e090553086 req-8ffbc4ce-cc5e-402d-bde0-c8dc2a991247 tempest-DeleteServersTestJSON-754230276 None] Terminate volume connection completed successfully. Aug 10 12:48:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-92a46414-21e7-45ea-b6d9-d8e090553086 req-8ffbc4ce-cc5e-402d-bde0-c8dc2a991247 tempest-DeleteServersTestJSON-754230276 None] Deleting attachment db7298d9-8810-4420-9157-6dcbfd6c4c32. {{(pid=89096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Aug 10 12:48:03 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 12:48:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:48:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:48:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:48:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:48:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:48:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:03 devstack sudo[92625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:48:03 devstack sudo[92625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:04 devstack sudo[92625]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.361s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:04 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:48:04 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-53bef2f1-aac6-456e-8c41-82de0f027b09 tempest-DeleteServersTestJSON-754230276 None] Acquiring lock "cinder-ca44d138-dfde-46d4-bd72-a84161b9a906-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:48:04 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-53bef2f1-aac6-456e-8c41-82de0f027b09 tempest-DeleteServersTestJSON-754230276 None] Lock "cinder-ca44d138-dfde-46d4-bd72-a84161b9a906-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:48:04 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-53bef2f1-aac6-456e-8c41-82de0f027b09 tempest-DeleteServersTestJSON-754230276 None] Acquiring lock "cinder-quobyte-ca44d138-dfde-46d4-bd72-a84161b9a906" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:48:04 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-53bef2f1-aac6-456e-8c41-82de0f027b09 tempest-DeleteServersTestJSON-754230276 None] Lock "cinder-quobyte-ca44d138-dfde-46d4-bd72-a84161b9a906" acquired by "delete_volume" :: waited 0.021s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:48:04 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7c5f82-d623-4cd0-9505-70c8376ebc80]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:48:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-53bef2f1-aac6-456e-8c41-82de0f027b09 tempest-DeleteServersTestJSON-754230276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ca44d138-dfde-46d4-bd72-a84161b9a906 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:05 devstack sudo[92638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ca44d138-dfde-46d4-bd72-a84161b9a906 Aug 10 12:48:05 devstack sudo[92638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:05 devstack sudo[92638]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-53bef2f1-aac6-456e-8c41-82de0f027b09 tempest-DeleteServersTestJSON-754230276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ca44d138-dfde-46d4-bd72-a84161b9a906" returned: 0 in 0.444s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-53bef2f1-aac6-456e-8c41-82de0f027b09 tempest-DeleteServersTestJSON-754230276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ca44d138-dfde-46d4-bd72-a84161b9a906 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:05 devstack sudo[92644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ca44d138-dfde-46d4-bd72-a84161b9a906 Aug 10 12:48:05 devstack sudo[92644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:05 devstack sudo[92644]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-53bef2f1-aac6-456e-8c41-82de0f027b09 tempest-DeleteServersTestJSON-754230276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ca44d138-dfde-46d4-bd72-a84161b9a906" returned: 0 in 0.274s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:05 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-53bef2f1-aac6-456e-8c41-82de0f027b09 tempest-DeleteServersTestJSON-754230276 None] Lock "cinder-quobyte-ca44d138-dfde-46d4-bd72-a84161b9a906" released by "delete_volume" :: held 0.764s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:48:05 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-53bef2f1-aac6-456e-8c41-82de0f027b09 tempest-DeleteServersTestJSON-754230276 None] Created reservations ['35c997c1-ad66-446b-9052-e678eefa21c2', '65e29432-9c4d-4fd0-9a03-f33e39224b53', 'd903f874-4b4c-4402-8940-5571df21ab8f', '758fadb9-7361-44e8-9e18-22f0dd94c117'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:48:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-53bef2f1-aac6-456e-8c41-82de0f027b09 tempest-DeleteServersTestJSON-754230276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:48:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-53bef2f1-aac6-456e-8c41-82de0f027b09 tempest-DeleteServersTestJSON-754230276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:48:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-53bef2f1-aac6-456e-8c41-82de0f027b09 tempest-DeleteServersTestJSON-754230276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:48:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-53bef2f1-aac6-456e-8c41-82de0f027b09 tempest-DeleteServersTestJSON-754230276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:48:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-53bef2f1-aac6-456e-8c41-82de0f027b09 tempest-DeleteServersTestJSON-754230276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:48:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-53bef2f1-aac6-456e-8c41-82de0f027b09 tempest-DeleteServersTestJSON-754230276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:05 devstack sudo[92647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:48:05 devstack sudo[92647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:06 devstack sudo[92647]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-53bef2f1-aac6-456e-8c41-82de0f027b09 tempest-DeleteServersTestJSON-754230276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.376s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:06 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-53bef2f1-aac6-456e-8c41-82de0f027b09 tempest-DeleteServersTestJSON-754230276 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:48:06 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-53bef2f1-aac6-456e-8c41-82de0f027b09 tempest-DeleteServersTestJSON-754230276 None] Deleted volume successfully. Aug 10 12:48:06 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-53bef2f1-aac6-456e-8c41-82de0f027b09 tempest-DeleteServersTestJSON-754230276 None] Lock "cinder-ca44d138-dfde-46d4-bd72-a84161b9a906-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:48:08 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [req-2f3341fc-fea6-44be-af1f-660b1e883e0a req-d574d579-1757-4001-802d-3e9aa1c5cf3b tempest-VolumesSnapshotsTestJSON-556712319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:48:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-2f3341fc-fea6-44be-af1f-660b1e883e0a req-d574d579-1757-4001-802d-3e9aa1c5cf3b tempest-VolumesSnapshotsTestJSON-556712319 None] Flow 'volume_create_manager' (e7fada7c-d5e5-4d59-b2e9-4c805247311b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:48:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-2f3341fc-fea6-44be-af1f-660b1e883e0a req-d574d579-1757-4001-802d-3e9aa1c5cf3b tempest-VolumesSnapshotsTestJSON-556712319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff17e1b-6b3c-445a-a5c3-915401b43abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-2f3341fc-fea6-44be-af1f-660b1e883e0a req-d574d579-1757-4001-802d-3e9aa1c5cf3b tempest-VolumesSnapshotsTestJSON-556712319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff17e1b-6b3c-445a-a5c3-915401b43abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-301389678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b20092d0-d98a-4fc9-ae80-487c0748a3cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='658ddb5910aa4ea8b52dd9587317643b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:48:08Z,use_quota=True,user_id='ad8ab52546a2436ba3f7619ffdae898d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-2f3341fc-fea6-44be-af1f-660b1e883e0a req-d574d579-1757-4001-802d-3e9aa1c5cf3b tempest-VolumesSnapshotsTestJSON-556712319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28b15283-bc05-4e0e-99b9-41112f3e9fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-2f3341fc-fea6-44be-af1f-660b1e883e0a req-d574d579-1757-4001-802d-3e9aa1c5cf3b tempest-VolumesSnapshotsTestJSON-556712319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28b15283-bc05-4e0e-99b9-41112f3e9fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-2f3341fc-fea6-44be-af1f-660b1e883e0a req-d574d579-1757-4001-802d-3e9aa1c5cf3b tempest-VolumesSnapshotsTestJSON-556712319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (846053d6-f407-479e-97e6-249214f27f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-2f3341fc-fea6-44be-af1f-660b1e883e0a req-d574d579-1757-4001-802d-3e9aa1c5cf3b tempest-VolumesSnapshotsTestJSON-556712319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (846053d6-f407-479e-97e6-249214f27f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b20092d0-d98a-4fc9-ae80-487c0748a3cc', 'volume_name': 'volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-2f3341fc-fea6-44be-af1f-660b1e883e0a req-d574d579-1757-4001-802d-3e9aa1c5cf3b tempest-VolumesSnapshotsTestJSON-556712319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (530732fe-829b-4e12-82d4-b2445ad32bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-2f3341fc-fea6-44be-af1f-660b1e883e0a req-d574d579-1757-4001-802d-3e9aa1c5cf3b tempest-VolumesSnapshotsTestJSON-556712319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (530732fe-829b-4e12-82d4-b2445ad32bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-2f3341fc-fea6-44be-af1f-660b1e883e0a req-d574d579-1757-4001-802d-3e9aa1c5cf3b tempest-VolumesSnapshotsTestJSON-556712319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1fdbc78-458d-4ae3-a60d-b0deb9a14671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:08 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [req-2f3341fc-fea6-44be-af1f-660b1e883e0a req-d574d579-1757-4001-802d-3e9aa1c5cf3b tempest-VolumesSnapshotsTestJSON-556712319 None] Volume b20092d0-d98a-4fc9-ae80-487c0748a3cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc', 'volume_size': 1} Aug 10 12:48:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-2f3341fc-fea6-44be-af1f-660b1e883e0a req-d574d579-1757-4001-802d-3e9aa1c5cf3b tempest-VolumesSnapshotsTestJSON-556712319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:48:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-2f3341fc-fea6-44be-af1f-660b1e883e0a req-d574d579-1757-4001-802d-3e9aa1c5cf3b tempest-VolumesSnapshotsTestJSON-556712319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:48:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [req-2f3341fc-fea6-44be-af1f-660b1e883e0a req-d574d579-1757-4001-802d-3e9aa1c5cf3b tempest-VolumesSnapshotsTestJSON-556712319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-301389678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b20092d0-d98a-4fc9-ae80-487c0748a3cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='658ddb5910aa4ea8b52dd9587317643b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:48:08Z,use_quota=True,user_id='ad8ab52546a2436ba3f7619ffdae898d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:48:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [req-2f3341fc-fea6-44be-af1f-660b1e883e0a req-d574d579-1757-4001-802d-3e9aa1c5cf3b tempest-VolumesSnapshotsTestJSON-556712319 None] Creating volume b20092d0-d98a-4fc9-ae80-487c0748a3cc {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:48:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-2f3341fc-fea6-44be-af1f-660b1e883e0a req-d574d579-1757-4001-802d-3e9aa1c5cf3b tempest-VolumesSnapshotsTestJSON-556712319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:48:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-2f3341fc-fea6-44be-af1f-660b1e883e0a req-d574d579-1757-4001-802d-3e9aa1c5cf3b tempest-VolumesSnapshotsTestJSON-556712319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:48:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [req-2f3341fc-fea6-44be-af1f-660b1e883e0a req-d574d579-1757-4001-802d-3e9aa1c5cf3b tempest-VolumesSnapshotsTestJSON-556712319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:48:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [req-2f3341fc-fea6-44be-af1f-660b1e883e0a req-d574d579-1757-4001-802d-3e9aa1c5cf3b tempest-VolumesSnapshotsTestJSON-556712319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:48:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-2f3341fc-fea6-44be-af1f-660b1e883e0a req-d574d579-1757-4001-802d-3e9aa1c5cf3b tempest-VolumesSnapshotsTestJSON-556712319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:48:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [req-2f3341fc-fea6-44be-af1f-660b1e883e0a req-d574d579-1757-4001-802d-3e9aa1c5cf3b tempest-VolumesSnapshotsTestJSON-556712319 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:48:08 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [req-2f3341fc-fea6-44be-af1f-660b1e883e0a req-d574d579-1757-4001-802d-3e9aa1c5cf3b tempest-VolumesSnapshotsTestJSON-556712319 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:48:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-2f3341fc-fea6-44be-af1f-660b1e883e0a req-d574d579-1757-4001-802d-3e9aa1c5cf3b tempest-VolumesSnapshotsTestJSON-556712319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:08 devstack sudo[92652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc 1073741824 Aug 10 12:48:08 devstack sudo[92652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:08 devstack sudo[92652]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-2f3341fc-fea6-44be-af1f-660b1e883e0a req-d574d579-1757-4001-802d-3e9aa1c5cf3b tempest-VolumesSnapshotsTestJSON-556712319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc 1073741824" returned: 0 in 0.503s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-2f3341fc-fea6-44be-af1f-660b1e883e0a req-d574d579-1757-4001-802d-3e9aa1c5cf3b tempest-VolumesSnapshotsTestJSON-556712319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:08 devstack sudo[92658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc Aug 10 12:48:08 devstack sudo[92658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:08 devstack sudo[92658]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-2f3341fc-fea6-44be-af1f-660b1e883e0a req-d574d579-1757-4001-802d-3e9aa1c5cf3b tempest-VolumesSnapshotsTestJSON-556712319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc" returned: 0 in 0.324s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [req-2f3341fc-fea6-44be-af1f-660b1e883e0a req-d574d579-1757-4001-802d-3e9aa1c5cf3b tempest-VolumesSnapshotsTestJSON-556712319 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:48:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-2f3341fc-fea6-44be-af1f-660b1e883e0a req-d574d579-1757-4001-802d-3e9aa1c5cf3b tempest-VolumesSnapshotsTestJSON-556712319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:48:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-2f3341fc-fea6-44be-af1f-660b1e883e0a req-d574d579-1757-4001-802d-3e9aa1c5cf3b tempest-VolumesSnapshotsTestJSON-556712319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1fdbc78-458d-4ae3-a60d-b0deb9a14671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-2f3341fc-fea6-44be-af1f-660b1e883e0a req-d574d579-1757-4001-802d-3e9aa1c5cf3b tempest-VolumesSnapshotsTestJSON-556712319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e6ae396-016e-4fe3-a984-00faa19f1373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:09 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [req-2f3341fc-fea6-44be-af1f-660b1e883e0a req-d574d579-1757-4001-802d-3e9aa1c5cf3b tempest-VolumesSnapshotsTestJSON-556712319 None] Volume volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc (b20092d0-d98a-4fc9-ae80-487c0748a3cc): created successfully Aug 10 12:48:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-2f3341fc-fea6-44be-af1f-660b1e883e0a req-d574d579-1757-4001-802d-3e9aa1c5cf3b tempest-VolumesSnapshotsTestJSON-556712319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e6ae396-016e-4fe3-a984-00faa19f1373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-2f3341fc-fea6-44be-af1f-660b1e883e0a req-d574d579-1757-4001-802d-3e9aa1c5cf3b tempest-VolumesSnapshotsTestJSON-556712319 None] Flow 'volume_create_manager' (e7fada7c-d5e5-4d59-b2e9-4c805247311b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:48:09 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-2f3341fc-fea6-44be-af1f-660b1e883e0a req-d574d579-1757-4001-802d-3e9aa1c5cf3b tempest-VolumesSnapshotsTestJSON-556712319 None] Created volume successfully. Aug 10 12:48:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-0cd216ab-2108-4c6b-9988-e58f26d3e4cd req-657ac290-2b2e-4d68-a655-99c7e5668dc6 tempest-VolumesSnapshotsTestJSON-556712319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:48:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-0cd216ab-2108-4c6b-9988-e58f26d3e4cd req-657ac290-2b2e-4d68-a655-99c7e5668dc6 tempest-VolumesSnapshotsTestJSON-556712319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:48:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [req-0cd216ab-2108-4c6b-9988-e58f26d3e4cd req-657ac290-2b2e-4d68-a655-99c7e5668dc6 tempest-VolumesSnapshotsTestJSON-556712319 None] Creating offline snapshot 8f160621-e321-4345-b758-2ec1237472ae of volume b20092d0-d98a-4fc9-ae80-487c0748a3cc {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 12:48:10 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69510dd-caa2-4ad5-a251-6b2282ba836a]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:48:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-0cd216ab-2108-4c6b-9988-e58f26d3e4cd req-657ac290-2b2e-4d68-a655-99c7e5668dc6 tempest-VolumesSnapshotsTestJSON-556712319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:10 devstack sudo[92661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc Aug 10 12:48:10 devstack sudo[92661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:11 devstack sudo[92661]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-0cd216ab-2108-4c6b-9988-e58f26d3e4cd req-657ac290-2b2e-4d68-a655-99c7e5668dc6 tempest-VolumesSnapshotsTestJSON-556712319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc" returned: 0 in 0.469s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-0cd216ab-2108-4c6b-9988-e58f26d3e4cd req-657ac290-2b2e-4d68-a655-99c7e5668dc6 tempest-VolumesSnapshotsTestJSON-556712319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc.8f160621-e321-4345-b758-2ec1237472ae 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:11 devstack sudo[92667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc.8f160621-e321-4345-b758-2ec1237472ae 1G Aug 10 12:48:11 devstack sudo[92667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:11 devstack sudo[92667]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-0cd216ab-2108-4c6b-9988-e58f26d3e4cd req-657ac290-2b2e-4d68-a655-99c7e5668dc6 tempest-VolumesSnapshotsTestJSON-556712319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc.8f160621-e321-4345-b758-2ec1237472ae 1G" returned: 0 in 0.489s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-0cd216ab-2108-4c6b-9988-e58f26d3e4cd req-657ac290-2b2e-4d68-a655-99c7e5668dc6 tempest-VolumesSnapshotsTestJSON-556712319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc.8f160621-e321-4345-b758-2ec1237472ae {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:11 devstack sudo[92673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc.8f160621-e321-4345-b758-2ec1237472ae Aug 10 12:48:11 devstack sudo[92673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:11 devstack sudo[92673]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-0cd216ab-2108-4c6b-9988-e58f26d3e4cd req-657ac290-2b2e-4d68-a655-99c7e5668dc6 tempest-VolumesSnapshotsTestJSON-556712319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc.8f160621-e321-4345-b758-2ec1237472ae" returned: 0 in 0.341s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:11 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [req-0cd216ab-2108-4c6b-9988-e58f26d3e4cd req-657ac290-2b2e-4d68-a655-99c7e5668dc6 tempest-VolumesSnapshotsTestJSON-556712319 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc.8f160621-e321-4345-b758-2ec1237472ae is being set with open permissions: ugo+rw Aug 10 12:48:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-0cd216ab-2108-4c6b-9988-e58f26d3e4cd req-657ac290-2b2e-4d68-a655-99c7e5668dc6 tempest-VolumesSnapshotsTestJSON-556712319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc.8f160621-e321-4345-b758-2ec1237472ae {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:11 devstack sudo[92678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc.8f160621-e321-4345-b758-2ec1237472ae Aug 10 12:48:11 devstack sudo[92678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:12 devstack sudo[92678]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-0cd216ab-2108-4c6b-9988-e58f26d3e4cd req-657ac290-2b2e-4d68-a655-99c7e5668dc6 tempest-VolumesSnapshotsTestJSON-556712319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc.8f160621-e321-4345-b758-2ec1237472ae" returned: 0 in 0.315s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-0cd216ab-2108-4c6b-9988-e58f26d3e4cd req-657ac290-2b2e-4d68-a655-99c7e5668dc6 tempest-VolumesSnapshotsTestJSON-556712319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:12 devstack sudo[92681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc.info Aug 10 12:48:12 devstack sudo[92681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:12 devstack sudo[92681]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-0cd216ab-2108-4c6b-9988-e58f26d3e4cd req-657ac290-2b2e-4d68-a655-99c7e5668dc6 tempest-VolumesSnapshotsTestJSON-556712319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc.info" returned: 0 in 0.277s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:12 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [req-0cd216ab-2108-4c6b-9988-e58f26d3e4cd req-657ac290-2b2e-4d68-a655-99c7e5668dc6 tempest-VolumesSnapshotsTestJSON-556712319 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc.info is being set with open permissions: ugo+rw Aug 10 12:48:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-0cd216ab-2108-4c6b-9988-e58f26d3e4cd req-657ac290-2b2e-4d68-a655-99c7e5668dc6 tempest-VolumesSnapshotsTestJSON-556712319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:12 devstack sudo[92684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc.info Aug 10 12:48:12 devstack sudo[92684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:12 devstack sudo[92684]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-0cd216ab-2108-4c6b-9988-e58f26d3e4cd req-657ac290-2b2e-4d68-a655-99c7e5668dc6 tempest-VolumesSnapshotsTestJSON-556712319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc.info" returned: 0 in 0.271s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-0cd216ab-2108-4c6b-9988-e58f26d3e4cd req-657ac290-2b2e-4d68-a655-99c7e5668dc6 tempest-VolumesSnapshotsTestJSON-556712319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.283s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:48:12 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-0cd216ab-2108-4c6b-9988-e58f26d3e4cd req-657ac290-2b2e-4d68-a655-99c7e5668dc6 tempest-VolumesSnapshotsTestJSON-556712319 None] Create snapshot completed successfully Aug 10 12:48:13 devstack cinder-volume[89096]: DEBUG cinder.coordination [req-cc8dd539-2a9b-4b2d-b417-ed3a004b5e3b req-92dfcce2-6a63-4c42-a363-62324ea4d3aa tempest-VolumesSnapshotsTestJSON-556712319 None] Acquiring lock "cinder-8f160621-e321-4345-b758-2ec1237472ae-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:48:13 devstack cinder-volume[89096]: DEBUG cinder.coordination [req-cc8dd539-2a9b-4b2d-b417-ed3a004b5e3b req-92dfcce2-6a63-4c42-a363-62324ea4d3aa tempest-VolumesSnapshotsTestJSON-556712319 None] Lock "cinder-8f160621-e321-4345-b758-2ec1237472ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:48:13 devstack cinder-volume[89096]: DEBUG cinder.coordination [req-cc8dd539-2a9b-4b2d-b417-ed3a004b5e3b req-92dfcce2-6a63-4c42-a363-62324ea4d3aa tempest-VolumesSnapshotsTestJSON-556712319 None] Acquiring lock "cinder-quobyte-b20092d0-d98a-4fc9-ae80-487c0748a3cc" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:48:13 devstack cinder-volume[89096]: DEBUG cinder.coordination [req-cc8dd539-2a9b-4b2d-b417-ed3a004b5e3b req-92dfcce2-6a63-4c42-a363-62324ea4d3aa tempest-VolumesSnapshotsTestJSON-556712319 None] Lock "cinder-quobyte-b20092d0-d98a-4fc9-ae80-487c0748a3cc" acquired by "delete_snapshot" :: waited 0.029s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:48:13 devstack cinder-volume[89096]: DEBUG cinder.coordination [req-cc8dd539-2a9b-4b2d-b417-ed3a004b5e3b req-92dfcce2-6a63-4c42-a363-62324ea4d3aa tempest-VolumesSnapshotsTestJSON-556712319 None] Acquiring lock "cinder-quobyte-8f160621-e321-4345-b758-2ec1237472ae" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:48:13 devstack cinder-volume[89096]: DEBUG cinder.coordination [req-cc8dd539-2a9b-4b2d-b417-ed3a004b5e3b req-92dfcce2-6a63-4c42-a363-62324ea4d3aa tempest-VolumesSnapshotsTestJSON-556712319 None] Lock "cinder-quobyte-8f160621-e321-4345-b758-2ec1237472ae" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:48:13 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [req-cc8dd539-2a9b-4b2d-b417-ed3a004b5e3b req-92dfcce2-6a63-4c42-a363-62324ea4d3aa tempest-VolumesSnapshotsTestJSON-556712319 None] Deleting offline snapshot 8f160621-e321-4345-b758-2ec1237472ae of volume b20092d0-d98a-4fc9-ae80-487c0748a3cc {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 12:48:13 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [req-cc8dd539-2a9b-4b2d-b417-ed3a004b5e3b req-92dfcce2-6a63-4c42-a363-62324ea4d3aa tempest-VolumesSnapshotsTestJSON-556712319 None] snapshot_file for this snap is: volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc.8f160621-e321-4345-b758-2ec1237472ae {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 12:48:13 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33af41b-3c10-42a2-8a6e-ee60449df8c9]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:48:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-cc8dd539-2a9b-4b2d-b417-ed3a004b5e3b req-92dfcce2-6a63-4c42-a363-62324ea4d3aa tempest-VolumesSnapshotsTestJSON-556712319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc.8f160621-e321-4345-b758-2ec1237472ae {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:13 devstack sudo[92687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc.8f160621-e321-4345-b758-2ec1237472ae Aug 10 12:48:13 devstack sudo[92687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:13 devstack sudo[92687]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-cc8dd539-2a9b-4b2d-b417-ed3a004b5e3b req-92dfcce2-6a63-4c42-a363-62324ea4d3aa tempest-VolumesSnapshotsTestJSON-556712319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc.8f160621-e321-4345-b758-2ec1237472ae" returned: 0 in 0.486s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:13 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [req-cc8dd539-2a9b-4b2d-b417-ed3a004b5e3b req-92dfcce2-6a63-4c42-a363-62324ea4d3aa tempest-VolumesSnapshotsTestJSON-556712319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 12:48:13 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ec731d-f693-4b01-b776-c7056792f444]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:48:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-cc8dd539-2a9b-4b2d-b417-ed3a004b5e3b req-92dfcce2-6a63-4c42-a363-62324ea4d3aa tempest-VolumesSnapshotsTestJSON-556712319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:14 devstack sudo[92692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc Aug 10 12:48:14 devstack sudo[92692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:14 devstack sudo[92692]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-cc8dd539-2a9b-4b2d-b417-ed3a004b5e3b req-92dfcce2-6a63-4c42-a363-62324ea4d3aa tempest-VolumesSnapshotsTestJSON-556712319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc" returned: 0 in 0.474s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-cc8dd539-2a9b-4b2d-b417-ed3a004b5e3b req-92dfcce2-6a63-4c42-a363-62324ea4d3aa tempest-VolumesSnapshotsTestJSON-556712319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc.8f160621-e321-4345-b758-2ec1237472ae {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:14 devstack sudo[92697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc.8f160621-e321-4345-b758-2ec1237472ae Aug 10 12:48:14 devstack sudo[92697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:15 devstack sudo[92697]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-cc8dd539-2a9b-4b2d-b417-ed3a004b5e3b req-92dfcce2-6a63-4c42-a363-62324ea4d3aa tempest-VolumesSnapshotsTestJSON-556712319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc.8f160621-e321-4345-b758-2ec1237472ae" returned: 0 in 0.583s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-cc8dd539-2a9b-4b2d-b417-ed3a004b5e3b req-92dfcce2-6a63-4c42-a363-62324ea4d3aa tempest-VolumesSnapshotsTestJSON-556712319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc.8f160621-e321-4345-b758-2ec1237472ae {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:15 devstack sudo[92703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc.8f160621-e321-4345-b758-2ec1237472ae Aug 10 12:48:15 devstack sudo[92703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:15 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2c1ee6b-bee0-4cfc-aa47-4f17ba22b828 tempest-VolumesTestJSON-1789453559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:48:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f2c1ee6b-bee0-4cfc-aa47-4f17ba22b828 tempest-VolumesTestJSON-1789453559 None] Flow 'volume_create_manager' (7297007a-615a-42d9-9755-c0eaf3a819bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:48:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f2c1ee6b-bee0-4cfc-aa47-4f17ba22b828 tempest-VolumesTestJSON-1789453559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c4e919-8117-466d-8669-469f106ad546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f2c1ee6b-bee0-4cfc-aa47-4f17ba22b828 tempest-VolumesTestJSON-1789453559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c4e919-8117-466d-8669-469f106ad546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-954922618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39418da0-493e-4ed6-9436-d03e75f5c1c7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='189b6cea13c74ce6a125323e0576109d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:48:15Z,use_quota=True,user_id='c59b5b6d6ed547a5aea4cd561ce9363b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f2c1ee6b-bee0-4cfc-aa47-4f17ba22b828 tempest-VolumesTestJSON-1789453559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1210ca4-4b08-4975-a401-08ce8b2beb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f2c1ee6b-bee0-4cfc-aa47-4f17ba22b828 tempest-VolumesTestJSON-1789453559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1210ca4-4b08-4975-a401-08ce8b2beb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f2c1ee6b-bee0-4cfc-aa47-4f17ba22b828 tempest-VolumesTestJSON-1789453559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10e49443-ce95-4f28-94f1-f4f24e92b880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f2c1ee6b-bee0-4cfc-aa47-4f17ba22b828 tempest-VolumesTestJSON-1789453559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10e49443-ce95-4f28-94f1-f4f24e92b880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39418da0-493e-4ed6-9436-d03e75f5c1c7', 'volume_name': 'volume-39418da0-493e-4ed6-9436-d03e75f5c1c7', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f2c1ee6b-bee0-4cfc-aa47-4f17ba22b828 tempest-VolumesTestJSON-1789453559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ccf5e2a-ca42-41eb-955c-2c56c38c7356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f2c1ee6b-bee0-4cfc-aa47-4f17ba22b828 tempest-VolumesTestJSON-1789453559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ccf5e2a-ca42-41eb-955c-2c56c38c7356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f2c1ee6b-bee0-4cfc-aa47-4f17ba22b828 tempest-VolumesTestJSON-1789453559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ed728b-37e4-48e8-adb3-ff1e1d60e3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:15 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-f2c1ee6b-bee0-4cfc-aa47-4f17ba22b828 tempest-VolumesTestJSON-1789453559 None] Volume 39418da0-493e-4ed6-9436-d03e75f5c1c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39418da0-493e-4ed6-9436-d03e75f5c1c7', 'volume_size': 1} Aug 10 12:48:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f2c1ee6b-bee0-4cfc-aa47-4f17ba22b828 tempest-VolumesTestJSON-1789453559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:48:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f2c1ee6b-bee0-4cfc-aa47-4f17ba22b828 tempest-VolumesTestJSON-1789453559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:48:15 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f2c1ee6b-bee0-4cfc-aa47-4f17ba22b828 tempest-VolumesTestJSON-1789453559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-954922618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39418da0-493e-4ed6-9436-d03e75f5c1c7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='189b6cea13c74ce6a125323e0576109d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:48:15Z,use_quota=True,user_id='c59b5b6d6ed547a5aea4cd561ce9363b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:48:15 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-f2c1ee6b-bee0-4cfc-aa47-4f17ba22b828 tempest-VolumesTestJSON-1789453559 None] Creating volume 39418da0-493e-4ed6-9436-d03e75f5c1c7 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:48:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f2c1ee6b-bee0-4cfc-aa47-4f17ba22b828 tempest-VolumesTestJSON-1789453559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:48:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f2c1ee6b-bee0-4cfc-aa47-4f17ba22b828 tempest-VolumesTestJSON-1789453559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:48:15 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f2c1ee6b-bee0-4cfc-aa47-4f17ba22b828 tempest-VolumesTestJSON-1789453559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:48:15 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f2c1ee6b-bee0-4cfc-aa47-4f17ba22b828 tempest-VolumesTestJSON-1789453559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:48:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f2c1ee6b-bee0-4cfc-aa47-4f17ba22b828 tempest-VolumesTestJSON-1789453559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:48:15 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f2c1ee6b-bee0-4cfc-aa47-4f17ba22b828 tempest-VolumesTestJSON-1789453559 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:48:15 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-f2c1ee6b-bee0-4cfc-aa47-4f17ba22b828 tempest-VolumesTestJSON-1789453559 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:48:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f2c1ee6b-bee0-4cfc-aa47-4f17ba22b828 tempest-VolumesTestJSON-1789453559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-39418da0-493e-4ed6-9436-d03e75f5c1c7 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:15 devstack sudo[92707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-39418da0-493e-4ed6-9436-d03e75f5c1c7 1073741824 Aug 10 12:48:15 devstack sudo[92707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:15 devstack sudo[92703]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-cc8dd539-2a9b-4b2d-b417-ed3a004b5e3b req-92dfcce2-6a63-4c42-a363-62324ea4d3aa tempest-VolumesSnapshotsTestJSON-556712319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc.8f160621-e321-4345-b758-2ec1237472ae" returned: 0 in 0.310s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:15 devstack cinder-volume[89096]: DEBUG cinder.coordination [req-cc8dd539-2a9b-4b2d-b417-ed3a004b5e3b req-92dfcce2-6a63-4c42-a363-62324ea4d3aa tempest-VolumesSnapshotsTestJSON-556712319 None] Lock "cinder-quobyte-8f160621-e321-4345-b758-2ec1237472ae" released by "_delete_snapshot" :: held 2.053s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:48:15 devstack cinder-volume[89096]: DEBUG cinder.coordination [req-cc8dd539-2a9b-4b2d-b417-ed3a004b5e3b req-92dfcce2-6a63-4c42-a363-62324ea4d3aa tempest-VolumesSnapshotsTestJSON-556712319 None] Lock "cinder-quobyte-b20092d0-d98a-4fc9-ae80-487c0748a3cc" released by "delete_snapshot" :: held 2.092s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:48:15 devstack cinder-volume[89096]: WARNING cinder.quota [req-cc8dd539-2a9b-4b2d-b417-ed3a004b5e3b req-92dfcce2-6a63-4c42-a363-62324ea4d3aa tempest-VolumesSnapshotsTestJSON-556712319 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 10 12:48:15 devstack cinder-volume[89096]: DEBUG cinder.quota [req-cc8dd539-2a9b-4b2d-b417-ed3a004b5e3b req-92dfcce2-6a63-4c42-a363-62324ea4d3aa tempest-VolumesSnapshotsTestJSON-556712319 None] Created reservations ['ee13e352-ee3a-41a5-a044-ddaa49e6988e', '3b6d3b7b-29d5-4dbd-8665-3fbe1858ba65', 'f14462cb-0da1-4639-82b2-b193e3994302', 'fd2cdd1c-14c5-4830-a085-1dc2ce0ff744'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:48:15 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-cc8dd539-2a9b-4b2d-b417-ed3a004b5e3b req-92dfcce2-6a63-4c42-a363-62324ea4d3aa tempest-VolumesSnapshotsTestJSON-556712319 None] Delete snapshot completed successfully. Aug 10 12:48:15 devstack cinder-volume[89096]: DEBUG cinder.coordination [req-cc8dd539-2a9b-4b2d-b417-ed3a004b5e3b req-92dfcce2-6a63-4c42-a363-62324ea4d3aa tempest-VolumesSnapshotsTestJSON-556712319 None] Lock "cinder-8f160621-e321-4345-b758-2ec1237472ae-delete_snapshot" released by "delete_snapshot" :: held 2.302s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:48:15 devstack sudo[92707]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f2c1ee6b-bee0-4cfc-aa47-4f17ba22b828 tempest-VolumesTestJSON-1789453559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-39418da0-493e-4ed6-9436-d03e75f5c1c7 1073741824" returned: 0 in 0.530s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f2c1ee6b-bee0-4cfc-aa47-4f17ba22b828 tempest-VolumesTestJSON-1789453559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-39418da0-493e-4ed6-9436-d03e75f5c1c7 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:15 devstack sudo[92714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-39418da0-493e-4ed6-9436-d03e75f5c1c7 Aug 10 12:48:15 devstack sudo[92714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:16 devstack sudo[92714]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f2c1ee6b-bee0-4cfc-aa47-4f17ba22b828 tempest-VolumesTestJSON-1789453559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-39418da0-493e-4ed6-9436-d03e75f5c1c7" returned: 0 in 0.268s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:16 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f2c1ee6b-bee0-4cfc-aa47-4f17ba22b828 tempest-VolumesTestJSON-1789453559 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:48:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f2c1ee6b-bee0-4cfc-aa47-4f17ba22b828 tempest-VolumesTestJSON-1789453559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:48:16 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f2c1ee6b-bee0-4cfc-aa47-4f17ba22b828 tempest-VolumesTestJSON-1789453559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ed728b-37e4-48e8-adb3-ff1e1d60e3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39418da0-493e-4ed6-9436-d03e75f5c1c7', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:16 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f2c1ee6b-bee0-4cfc-aa47-4f17ba22b828 tempest-VolumesTestJSON-1789453559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3687ed3-a28a-44d8-b83e-0b12c59d8c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:16 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-f2c1ee6b-bee0-4cfc-aa47-4f17ba22b828 tempest-VolumesTestJSON-1789453559 None] Volume volume-39418da0-493e-4ed6-9436-d03e75f5c1c7 (39418da0-493e-4ed6-9436-d03e75f5c1c7): created successfully Aug 10 12:48:16 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f2c1ee6b-bee0-4cfc-aa47-4f17ba22b828 tempest-VolumesTestJSON-1789453559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3687ed3-a28a-44d8-b83e-0b12c59d8c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:16 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f2c1ee6b-bee0-4cfc-aa47-4f17ba22b828 tempest-VolumesTestJSON-1789453559 None] Flow 'volume_create_manager' (7297007a-615a-42d9-9755-c0eaf3a819bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:48:16 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-f2c1ee6b-bee0-4cfc-aa47-4f17ba22b828 tempest-VolumesTestJSON-1789453559 None] Created volume successfully. Aug 10 12:48:16 devstack cinder-volume[89096]: DEBUG cinder.coordination [req-42c110f8-0e94-48e0-ae6f-a6d13daf60ec req-00ade211-eced-44d7-a99f-da6d2c7daf5f tempest-VolumesSnapshotsTestJSON-556712319 None] Acquiring lock "cinder-b20092d0-d98a-4fc9-ae80-487c0748a3cc-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:48:16 devstack cinder-volume[89096]: DEBUG cinder.coordination [req-42c110f8-0e94-48e0-ae6f-a6d13daf60ec req-00ade211-eced-44d7-a99f-da6d2c7daf5f tempest-VolumesSnapshotsTestJSON-556712319 None] Lock "cinder-b20092d0-d98a-4fc9-ae80-487c0748a3cc-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:48:16 devstack cinder-volume[89096]: DEBUG cinder.coordination [req-42c110f8-0e94-48e0-ae6f-a6d13daf60ec req-00ade211-eced-44d7-a99f-da6d2c7daf5f tempest-VolumesSnapshotsTestJSON-556712319 None] Acquiring lock "cinder-quobyte-b20092d0-d98a-4fc9-ae80-487c0748a3cc" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:48:16 devstack cinder-volume[89096]: DEBUG cinder.coordination [req-42c110f8-0e94-48e0-ae6f-a6d13daf60ec req-00ade211-eced-44d7-a99f-da6d2c7daf5f tempest-VolumesSnapshotsTestJSON-556712319 None] Lock "cinder-quobyte-b20092d0-d98a-4fc9-ae80-487c0748a3cc" acquired by "delete_volume" :: waited 0.022s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:48:16 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[2805def1-1f49-45ee-85c9-388c96a022fd]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:48:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-42c110f8-0e94-48e0-ae6f-a6d13daf60ec req-00ade211-eced-44d7-a99f-da6d2c7daf5f tempest-VolumesSnapshotsTestJSON-556712319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:16 devstack sudo[92717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc Aug 10 12:48:16 devstack sudo[92717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:17 devstack sudo[92717]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-42c110f8-0e94-48e0-ae6f-a6d13daf60ec req-00ade211-eced-44d7-a99f-da6d2c7daf5f tempest-VolumesSnapshotsTestJSON-556712319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc" returned: 0 in 0.383s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-42c110f8-0e94-48e0-ae6f-a6d13daf60ec req-00ade211-eced-44d7-a99f-da6d2c7daf5f tempest-VolumesSnapshotsTestJSON-556712319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:17 devstack sudo[92722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc Aug 10 12:48:17 devstack sudo[92722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:17 devstack sudo[92722]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-42c110f8-0e94-48e0-ae6f-a6d13daf60ec req-00ade211-eced-44d7-a99f-da6d2c7daf5f tempest-VolumesSnapshotsTestJSON-556712319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b20092d0-d98a-4fc9-ae80-487c0748a3cc" returned: 0 in 0.378s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:17 devstack cinder-volume[89096]: DEBUG cinder.coordination [req-42c110f8-0e94-48e0-ae6f-a6d13daf60ec req-00ade211-eced-44d7-a99f-da6d2c7daf5f tempest-VolumesSnapshotsTestJSON-556712319 None] Lock "cinder-quobyte-b20092d0-d98a-4fc9-ae80-487c0748a3cc" released by "delete_volume" :: held 0.837s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:48:17 devstack cinder-volume[89096]: DEBUG cinder.quota [req-42c110f8-0e94-48e0-ae6f-a6d13daf60ec req-00ade211-eced-44d7-a99f-da6d2c7daf5f tempest-VolumesSnapshotsTestJSON-556712319 None] Created reservations ['366d44ae-345a-4ca5-9165-3fdbef24852f', 'd1c28ae0-e7f7-48f9-8c33-702a91f315da', '1c2dea22-f15b-4c77-990e-54542a3e2131', 'aaa32021-f27d-45e9-a986-2c791a8354dd'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:48:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-42c110f8-0e94-48e0-ae6f-a6d13daf60ec req-00ade211-eced-44d7-a99f-da6d2c7daf5f tempest-VolumesSnapshotsTestJSON-556712319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:48:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-42c110f8-0e94-48e0-ae6f-a6d13daf60ec req-00ade211-eced-44d7-a99f-da6d2c7daf5f tempest-VolumesSnapshotsTestJSON-556712319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:48:17 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [req-42c110f8-0e94-48e0-ae6f-a6d13daf60ec req-00ade211-eced-44d7-a99f-da6d2c7daf5f tempest-VolumesSnapshotsTestJSON-556712319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:48:17 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [req-42c110f8-0e94-48e0-ae6f-a6d13daf60ec req-00ade211-eced-44d7-a99f-da6d2c7daf5f tempest-VolumesSnapshotsTestJSON-556712319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:48:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-42c110f8-0e94-48e0-ae6f-a6d13daf60ec req-00ade211-eced-44d7-a99f-da6d2c7daf5f tempest-VolumesSnapshotsTestJSON-556712319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:48:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-42c110f8-0e94-48e0-ae6f-a6d13daf60ec req-00ade211-eced-44d7-a99f-da6d2c7daf5f tempest-VolumesSnapshotsTestJSON-556712319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:17 devstack sudo[92727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:48:17 devstack sudo[92727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:18 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c688fd9-af07-4a0c-bfcc-6cfb1b12c722 tempest-VolumesTestJSON-1789453559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:48:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4c688fd9-af07-4a0c-bfcc-6cfb1b12c722 tempest-VolumesTestJSON-1789453559 None] Flow 'volume_create_manager' (256f5203-1ad5-44ac-bf38-6cfbb857a563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:48:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4c688fd9-af07-4a0c-bfcc-6cfb1b12c722 tempest-VolumesTestJSON-1789453559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c64fe036-a98f-46c8-b2a3-8de9f3a43b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4c688fd9-af07-4a0c-bfcc-6cfb1b12c722 tempest-VolumesTestJSON-1789453559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c64fe036-a98f-46c8-b2a3-8de9f3a43b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2111427712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a498442-540c-4188-a3c0-2f5ad6900e18,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='189b6cea13c74ce6a125323e0576109d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:48:18Z,use_quota=True,user_id='c59b5b6d6ed547a5aea4cd561ce9363b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4c688fd9-af07-4a0c-bfcc-6cfb1b12c722 tempest-VolumesTestJSON-1789453559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84bfcd00-2067-4c2f-8540-f596a846d7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4c688fd9-af07-4a0c-bfcc-6cfb1b12c722 tempest-VolumesTestJSON-1789453559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84bfcd00-2067-4c2f-8540-f596a846d7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4c688fd9-af07-4a0c-bfcc-6cfb1b12c722 tempest-VolumesTestJSON-1789453559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b773880f-d97c-429f-a534-0cf4ff1da7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:18 devstack sudo[92727]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4c688fd9-af07-4a0c-bfcc-6cfb1b12c722 tempest-VolumesTestJSON-1789453559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b773880f-d97c-429f-a534-0cf4ff1da7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a498442-540c-4188-a3c0-2f5ad6900e18', 'volume_name': 'volume-0a498442-540c-4188-a3c0-2f5ad6900e18', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4c688fd9-af07-4a0c-bfcc-6cfb1b12c722 tempest-VolumesTestJSON-1789453559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92cfe0bf-8ee5-4be1-adb2-150039b38c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4c688fd9-af07-4a0c-bfcc-6cfb1b12c722 tempest-VolumesTestJSON-1789453559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92cfe0bf-8ee5-4be1-adb2-150039b38c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4c688fd9-af07-4a0c-bfcc-6cfb1b12c722 tempest-VolumesTestJSON-1789453559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8055feaa-e58a-4553-8a91-c4b595747c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:18 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-4c688fd9-af07-4a0c-bfcc-6cfb1b12c722 tempest-VolumesTestJSON-1789453559 None] Volume 0a498442-540c-4188-a3c0-2f5ad6900e18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a498442-540c-4188-a3c0-2f5ad6900e18', 'volume_size': 1} Aug 10 12:48:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4c688fd9-af07-4a0c-bfcc-6cfb1b12c722 tempest-VolumesTestJSON-1789453559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:48:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4c688fd9-af07-4a0c-bfcc-6cfb1b12c722 tempest-VolumesTestJSON-1789453559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:48:18 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4c688fd9-af07-4a0c-bfcc-6cfb1b12c722 tempest-VolumesTestJSON-1789453559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2111427712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a498442-540c-4188-a3c0-2f5ad6900e18,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='189b6cea13c74ce6a125323e0576109d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:48:18Z,use_quota=True,user_id='c59b5b6d6ed547a5aea4cd561ce9363b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:48:18 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-4c688fd9-af07-4a0c-bfcc-6cfb1b12c722 tempest-VolumesTestJSON-1789453559 None] Creating volume 0a498442-540c-4188-a3c0-2f5ad6900e18 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:48:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4c688fd9-af07-4a0c-bfcc-6cfb1b12c722 tempest-VolumesTestJSON-1789453559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:48:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4c688fd9-af07-4a0c-bfcc-6cfb1b12c722 tempest-VolumesTestJSON-1789453559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:48:18 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4c688fd9-af07-4a0c-bfcc-6cfb1b12c722 tempest-VolumesTestJSON-1789453559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:48:18 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4c688fd9-af07-4a0c-bfcc-6cfb1b12c722 tempest-VolumesTestJSON-1789453559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:48:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4c688fd9-af07-4a0c-bfcc-6cfb1b12c722 tempest-VolumesTestJSON-1789453559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:48:18 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4c688fd9-af07-4a0c-bfcc-6cfb1b12c722 tempest-VolumesTestJSON-1789453559 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:48:18 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-4c688fd9-af07-4a0c-bfcc-6cfb1b12c722 tempest-VolumesTestJSON-1789453559 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:48:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c688fd9-af07-4a0c-bfcc-6cfb1b12c722 tempest-VolumesTestJSON-1789453559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a498442-540c-4188-a3c0-2f5ad6900e18 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-42c110f8-0e94-48e0-ae6f-a6d13daf60ec req-00ade211-eced-44d7-a99f-da6d2c7daf5f tempest-VolumesSnapshotsTestJSON-556712319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.368s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:18 devstack cinder-volume[89096]: DEBUG cinder.manager [req-42c110f8-0e94-48e0-ae6f-a6d13daf60ec req-00ade211-eced-44d7-a99f-da6d2c7daf5f tempest-VolumesSnapshotsTestJSON-556712319 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:48:18 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-42c110f8-0e94-48e0-ae6f-a6d13daf60ec req-00ade211-eced-44d7-a99f-da6d2c7daf5f tempest-VolumesSnapshotsTestJSON-556712319 None] Deleted volume successfully. Aug 10 12:48:18 devstack sudo[92730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a498442-540c-4188-a3c0-2f5ad6900e18 1073741824 Aug 10 12:48:18 devstack sudo[92730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:18 devstack cinder-volume[89096]: DEBUG cinder.coordination [req-42c110f8-0e94-48e0-ae6f-a6d13daf60ec req-00ade211-eced-44d7-a99f-da6d2c7daf5f tempest-VolumesSnapshotsTestJSON-556712319 None] Lock "cinder-b20092d0-d98a-4fc9-ae80-487c0748a3cc-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:48:18 devstack sudo[92730]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c688fd9-af07-4a0c-bfcc-6cfb1b12c722 tempest-VolumesTestJSON-1789453559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a498442-540c-4188-a3c0-2f5ad6900e18 1073741824" returned: 0 in 0.428s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c688fd9-af07-4a0c-bfcc-6cfb1b12c722 tempest-VolumesTestJSON-1789453559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a498442-540c-4188-a3c0-2f5ad6900e18 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:18 devstack sudo[92737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a498442-540c-4188-a3c0-2f5ad6900e18 Aug 10 12:48:18 devstack sudo[92737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:18 devstack sudo[92737]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c688fd9-af07-4a0c-bfcc-6cfb1b12c722 tempest-VolumesTestJSON-1789453559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a498442-540c-4188-a3c0-2f5ad6900e18" returned: 0 in 0.291s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:18 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4c688fd9-af07-4a0c-bfcc-6cfb1b12c722 tempest-VolumesTestJSON-1789453559 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:48:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4c688fd9-af07-4a0c-bfcc-6cfb1b12c722 tempest-VolumesTestJSON-1789453559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:48:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4c688fd9-af07-4a0c-bfcc-6cfb1b12c722 tempest-VolumesTestJSON-1789453559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8055feaa-e58a-4553-8a91-c4b595747c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a498442-540c-4188-a3c0-2f5ad6900e18', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4c688fd9-af07-4a0c-bfcc-6cfb1b12c722 tempest-VolumesTestJSON-1789453559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c21ba41a-3162-4caf-9f51-220a703c754d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:19 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-4c688fd9-af07-4a0c-bfcc-6cfb1b12c722 tempest-VolumesTestJSON-1789453559 None] Volume volume-0a498442-540c-4188-a3c0-2f5ad6900e18 (0a498442-540c-4188-a3c0-2f5ad6900e18): created successfully Aug 10 12:48:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4c688fd9-af07-4a0c-bfcc-6cfb1b12c722 tempest-VolumesTestJSON-1789453559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c21ba41a-3162-4caf-9f51-220a703c754d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4c688fd9-af07-4a0c-bfcc-6cfb1b12c722 tempest-VolumesTestJSON-1789453559 None] Flow 'volume_create_manager' (256f5203-1ad5-44ac-bf38-6cfbb857a563) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:48:19 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-4c688fd9-af07-4a0c-bfcc-6cfb1b12c722 tempest-VolumesTestJSON-1789453559 None] Created volume successfully. Aug 10 12:48:20 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-432e13d2-156f-4305-b129-7f424c6f8d12 tempest-VolumesTestJSON-1789453559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:48:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-432e13d2-156f-4305-b129-7f424c6f8d12 tempest-VolumesTestJSON-1789453559 None] Flow 'volume_create_manager' (70118034-e99f-4502-af49-347369cadaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:48:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-432e13d2-156f-4305-b129-7f424c6f8d12 tempest-VolumesTestJSON-1789453559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab1bd1e0-5967-4a0e-a7de-c592069c8e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-432e13d2-156f-4305-b129-7f424c6f8d12 tempest-VolumesTestJSON-1789453559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab1bd1e0-5967-4a0e-a7de-c592069c8e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1122613193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db89b95a-228e-45ce-a5b6-a6d85c277a9e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='189b6cea13c74ce6a125323e0576109d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:48:21Z,use_quota=True,user_id='c59b5b6d6ed547a5aea4cd561ce9363b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-432e13d2-156f-4305-b129-7f424c6f8d12 tempest-VolumesTestJSON-1789453559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (052a4c33-962a-4a9a-aaea-e0ce7f9fbe6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-432e13d2-156f-4305-b129-7f424c6f8d12 tempest-VolumesTestJSON-1789453559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (052a4c33-962a-4a9a-aaea-e0ce7f9fbe6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-432e13d2-156f-4305-b129-7f424c6f8d12 tempest-VolumesTestJSON-1789453559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9d8485c-2e3e-49aa-a07d-80cbd4fe5582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-432e13d2-156f-4305-b129-7f424c6f8d12 tempest-VolumesTestJSON-1789453559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9d8485c-2e3e-49aa-a07d-80cbd4fe5582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db89b95a-228e-45ce-a5b6-a6d85c277a9e', 'volume_name': 'volume-db89b95a-228e-45ce-a5b6-a6d85c277a9e', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-432e13d2-156f-4305-b129-7f424c6f8d12 tempest-VolumesTestJSON-1789453559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (749a9ab9-e609-4a96-8afc-610813f003e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-432e13d2-156f-4305-b129-7f424c6f8d12 tempest-VolumesTestJSON-1789453559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (749a9ab9-e609-4a96-8afc-610813f003e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-432e13d2-156f-4305-b129-7f424c6f8d12 tempest-VolumesTestJSON-1789453559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a39449-9a14-4b0a-8263-b343e415f693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:20 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-432e13d2-156f-4305-b129-7f424c6f8d12 tempest-VolumesTestJSON-1789453559 None] Volume db89b95a-228e-45ce-a5b6-a6d85c277a9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db89b95a-228e-45ce-a5b6-a6d85c277a9e', 'volume_size': 1} Aug 10 12:48:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-432e13d2-156f-4305-b129-7f424c6f8d12 tempest-VolumesTestJSON-1789453559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:48:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-432e13d2-156f-4305-b129-7f424c6f8d12 tempest-VolumesTestJSON-1789453559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:48:20 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-432e13d2-156f-4305-b129-7f424c6f8d12 tempest-VolumesTestJSON-1789453559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1122613193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db89b95a-228e-45ce-a5b6-a6d85c277a9e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='189b6cea13c74ce6a125323e0576109d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:48:21Z,use_quota=True,user_id='c59b5b6d6ed547a5aea4cd561ce9363b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:48:20 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-432e13d2-156f-4305-b129-7f424c6f8d12 tempest-VolumesTestJSON-1789453559 None] Creating volume db89b95a-228e-45ce-a5b6-a6d85c277a9e {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:48:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-432e13d2-156f-4305-b129-7f424c6f8d12 tempest-VolumesTestJSON-1789453559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:48:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-432e13d2-156f-4305-b129-7f424c6f8d12 tempest-VolumesTestJSON-1789453559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:48:20 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-432e13d2-156f-4305-b129-7f424c6f8d12 tempest-VolumesTestJSON-1789453559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:48:20 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-432e13d2-156f-4305-b129-7f424c6f8d12 tempest-VolumesTestJSON-1789453559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:48:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-432e13d2-156f-4305-b129-7f424c6f8d12 tempest-VolumesTestJSON-1789453559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:48:20 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-432e13d2-156f-4305-b129-7f424c6f8d12 tempest-VolumesTestJSON-1789453559 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:48:20 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-432e13d2-156f-4305-b129-7f424c6f8d12 tempest-VolumesTestJSON-1789453559 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:48:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-432e13d2-156f-4305-b129-7f424c6f8d12 tempest-VolumesTestJSON-1789453559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-db89b95a-228e-45ce-a5b6-a6d85c277a9e 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:21 devstack sudo[92782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-db89b95a-228e-45ce-a5b6-a6d85c277a9e 1073741824 Aug 10 12:48:21 devstack sudo[92782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:21 devstack sudo[92782]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-432e13d2-156f-4305-b129-7f424c6f8d12 tempest-VolumesTestJSON-1789453559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-db89b95a-228e-45ce-a5b6-a6d85c277a9e 1073741824" returned: 0 in 0.732s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-432e13d2-156f-4305-b129-7f424c6f8d12 tempest-VolumesTestJSON-1789453559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-db89b95a-228e-45ce-a5b6-a6d85c277a9e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:21 devstack sudo[92794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-db89b95a-228e-45ce-a5b6-a6d85c277a9e Aug 10 12:48:21 devstack sudo[92794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:22 devstack sudo[92794]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-432e13d2-156f-4305-b129-7f424c6f8d12 tempest-VolumesTestJSON-1789453559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-db89b95a-228e-45ce-a5b6-a6d85c277a9e" returned: 0 in 0.407s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:22 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-432e13d2-156f-4305-b129-7f424c6f8d12 tempest-VolumesTestJSON-1789453559 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:48:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-432e13d2-156f-4305-b129-7f424c6f8d12 tempest-VolumesTestJSON-1789453559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:48:22 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-432e13d2-156f-4305-b129-7f424c6f8d12 tempest-VolumesTestJSON-1789453559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a39449-9a14-4b0a-8263-b343e415f693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db89b95a-228e-45ce-a5b6-a6d85c277a9e', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:22 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-432e13d2-156f-4305-b129-7f424c6f8d12 tempest-VolumesTestJSON-1789453559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4991391-dc9b-4beb-9096-8a8ce2bccf80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:22 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-432e13d2-156f-4305-b129-7f424c6f8d12 tempest-VolumesTestJSON-1789453559 None] Volume volume-db89b95a-228e-45ce-a5b6-a6d85c277a9e (db89b95a-228e-45ce-a5b6-a6d85c277a9e): created successfully Aug 10 12:48:22 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-432e13d2-156f-4305-b129-7f424c6f8d12 tempest-VolumesTestJSON-1789453559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4991391-dc9b-4beb-9096-8a8ce2bccf80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:22 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-432e13d2-156f-4305-b129-7f424c6f8d12 tempest-VolumesTestJSON-1789453559 None] Flow 'volume_create_manager' (70118034-e99f-4502-af49-347369cadaa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:48:22 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-432e13d2-156f-4305-b129-7f424c6f8d12 tempest-VolumesTestJSON-1789453559 None] Created volume successfully. Aug 10 12:48:24 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-911cbe16-e8fd-4dbf-a96d-b29901cce83b tempest-VolumesTestJSON-1789453559 None] Acquiring lock "cinder-db89b95a-228e-45ce-a5b6-a6d85c277a9e-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:48:24 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-911cbe16-e8fd-4dbf-a96d-b29901cce83b tempest-VolumesTestJSON-1789453559 None] Lock "cinder-db89b95a-228e-45ce-a5b6-a6d85c277a9e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:48:24 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-911cbe16-e8fd-4dbf-a96d-b29901cce83b tempest-VolumesTestJSON-1789453559 None] Acquiring lock "cinder-quobyte-db89b95a-228e-45ce-a5b6-a6d85c277a9e" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:48:24 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-911cbe16-e8fd-4dbf-a96d-b29901cce83b tempest-VolumesTestJSON-1789453559 None] Lock "cinder-quobyte-db89b95a-228e-45ce-a5b6-a6d85c277a9e" acquired by "delete_volume" :: waited 0.016s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:48:24 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e01ec6a-c491-42bc-a02b-a0a4fc43c832]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:48:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-911cbe16-e8fd-4dbf-a96d-b29901cce83b tempest-VolumesTestJSON-1789453559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-db89b95a-228e-45ce-a5b6-a6d85c277a9e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:24 devstack sudo[92830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-db89b95a-228e-45ce-a5b6-a6d85c277a9e Aug 10 12:48:24 devstack sudo[92830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:25 devstack sudo[92830]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-911cbe16-e8fd-4dbf-a96d-b29901cce83b tempest-VolumesTestJSON-1789453559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-db89b95a-228e-45ce-a5b6-a6d85c277a9e" returned: 0 in 0.406s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-911cbe16-e8fd-4dbf-a96d-b29901cce83b tempest-VolumesTestJSON-1789453559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-db89b95a-228e-45ce-a5b6-a6d85c277a9e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:25 devstack sudo[92835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-db89b95a-228e-45ce-a5b6-a6d85c277a9e Aug 10 12:48:25 devstack sudo[92835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:25 devstack sudo[92835]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-911cbe16-e8fd-4dbf-a96d-b29901cce83b tempest-VolumesTestJSON-1789453559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-db89b95a-228e-45ce-a5b6-a6d85c277a9e" returned: 0 in 0.271s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-911cbe16-e8fd-4dbf-a96d-b29901cce83b tempest-VolumesTestJSON-1789453559 None] Lock "cinder-quobyte-db89b95a-228e-45ce-a5b6-a6d85c277a9e" released by "delete_volume" :: held 0.734s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:48:25 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-911cbe16-e8fd-4dbf-a96d-b29901cce83b tempest-VolumesTestJSON-1789453559 None] Created reservations ['6d33d54b-2a6d-4849-a384-344ff34ed2b9', 'cbfc1883-c3be-4814-8230-3e32057a7bb8', '689d76a9-34c7-4144-9dc9-2cee9dcb0ab1', 'a7dedfb8-1035-4063-9503-12c9cb0c9302'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:48:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-911cbe16-e8fd-4dbf-a96d-b29901cce83b tempest-VolumesTestJSON-1789453559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:48:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-911cbe16-e8fd-4dbf-a96d-b29901cce83b tempest-VolumesTestJSON-1789453559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:48:25 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-911cbe16-e8fd-4dbf-a96d-b29901cce83b tempest-VolumesTestJSON-1789453559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:48:25 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-911cbe16-e8fd-4dbf-a96d-b29901cce83b tempest-VolumesTestJSON-1789453559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:48:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-911cbe16-e8fd-4dbf-a96d-b29901cce83b tempest-VolumesTestJSON-1789453559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:48:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-911cbe16-e8fd-4dbf-a96d-b29901cce83b tempest-VolumesTestJSON-1789453559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:25 devstack sudo[92840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:48:25 devstack sudo[92840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-22c08a8c-7960-440c-912c-c71b775a3029 tempest-VolumesTestJSON-1789453559 None] Acquiring lock "cinder-0a498442-540c-4188-a3c0-2f5ad6900e18-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:48:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-22c08a8c-7960-440c-912c-c71b775a3029 tempest-VolumesTestJSON-1789453559 None] Lock "cinder-0a498442-540c-4188-a3c0-2f5ad6900e18-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:48:26 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-22c08a8c-7960-440c-912c-c71b775a3029 tempest-VolumesTestJSON-1789453559 None] Acquiring lock "cinder-quobyte-0a498442-540c-4188-a3c0-2f5ad6900e18" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:48:26 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-22c08a8c-7960-440c-912c-c71b775a3029 tempest-VolumesTestJSON-1789453559 None] Lock "cinder-quobyte-0a498442-540c-4188-a3c0-2f5ad6900e18" acquired by "delete_volume" :: waited 0.043s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:48:26 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[633bcd7f-7b3a-43c6-b3a4-147b14921d27]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:48:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-22c08a8c-7960-440c-912c-c71b775a3029 tempest-VolumesTestJSON-1789453559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a498442-540c-4188-a3c0-2f5ad6900e18 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:26 devstack sudo[92840]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-911cbe16-e8fd-4dbf-a96d-b29901cce83b tempest-VolumesTestJSON-1789453559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.788s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:26 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-911cbe16-e8fd-4dbf-a96d-b29901cce83b tempest-VolumesTestJSON-1789453559 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:48:26 devstack sudo[92857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a498442-540c-4188-a3c0-2f5ad6900e18 Aug 10 12:48:26 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-911cbe16-e8fd-4dbf-a96d-b29901cce83b tempest-VolumesTestJSON-1789453559 None] Deleted volume successfully. Aug 10 12:48:26 devstack sudo[92857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:26 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-911cbe16-e8fd-4dbf-a96d-b29901cce83b tempest-VolumesTestJSON-1789453559 None] Lock "cinder-db89b95a-228e-45ce-a5b6-a6d85c277a9e-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:48:26 devstack sudo[92857]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-22c08a8c-7960-440c-912c-c71b775a3029 tempest-VolumesTestJSON-1789453559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a498442-540c-4188-a3c0-2f5ad6900e18" returned: 0 in 0.559s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-22c08a8c-7960-440c-912c-c71b775a3029 tempest-VolumesTestJSON-1789453559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a498442-540c-4188-a3c0-2f5ad6900e18 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:26 devstack sudo[92891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a498442-540c-4188-a3c0-2f5ad6900e18 Aug 10 12:48:26 devstack sudo[92891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:27 devstack sudo[92891]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-22c08a8c-7960-440c-912c-c71b775a3029 tempest-VolumesTestJSON-1789453559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a498442-540c-4188-a3c0-2f5ad6900e18" returned: 0 in 0.575s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:27 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-22c08a8c-7960-440c-912c-c71b775a3029 tempest-VolumesTestJSON-1789453559 None] Lock "cinder-quobyte-0a498442-540c-4188-a3c0-2f5ad6900e18" released by "delete_volume" :: held 1.230s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:48:27 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-22c08a8c-7960-440c-912c-c71b775a3029 tempest-VolumesTestJSON-1789453559 None] Created reservations ['f6ccee4a-f200-478f-839f-22f43b9a0da7', '5a4eec90-694b-4a70-b49f-ae8abac81d44', 'b632a324-6b52-4a70-9b65-39d668e5c52f', '54956584-3eb9-4976-ac29-22ee0b76c01a'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:48:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-22c08a8c-7960-440c-912c-c71b775a3029 tempest-VolumesTestJSON-1789453559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:48:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-22c08a8c-7960-440c-912c-c71b775a3029 tempest-VolumesTestJSON-1789453559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:48:27 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-22c08a8c-7960-440c-912c-c71b775a3029 tempest-VolumesTestJSON-1789453559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:48:27 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-22c08a8c-7960-440c-912c-c71b775a3029 tempest-VolumesTestJSON-1789453559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:48:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-22c08a8c-7960-440c-912c-c71b775a3029 tempest-VolumesTestJSON-1789453559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:48:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-22c08a8c-7960-440c-912c-c71b775a3029 tempest-VolumesTestJSON-1789453559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:27 devstack sudo[92924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:48:27 devstack sudo[92924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:27 devstack sudo[92924]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-22c08a8c-7960-440c-912c-c71b775a3029 tempest-VolumesTestJSON-1789453559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.350s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:27 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-22c08a8c-7960-440c-912c-c71b775a3029 tempest-VolumesTestJSON-1789453559 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:48:27 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-22c08a8c-7960-440c-912c-c71b775a3029 tempest-VolumesTestJSON-1789453559 None] Deleted volume successfully. Aug 10 12:48:27 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-22c08a8c-7960-440c-912c-c71b775a3029 tempest-VolumesTestJSON-1789453559 None] Lock "cinder-0a498442-540c-4188-a3c0-2f5ad6900e18-delete_volume" released by "delete_volume" :: held 2.115s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:48:28 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a7a3a018-39ef-4d18-aa74-bbd81e67a616 tempest-VolumesTestJSON-1789453559 None] Acquiring lock "cinder-39418da0-493e-4ed6-9436-d03e75f5c1c7-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:48:28 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a7a3a018-39ef-4d18-aa74-bbd81e67a616 tempest-VolumesTestJSON-1789453559 None] Lock "cinder-39418da0-493e-4ed6-9436-d03e75f5c1c7-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:48:28 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a7a3a018-39ef-4d18-aa74-bbd81e67a616 tempest-VolumesTestJSON-1789453559 None] Acquiring lock "cinder-quobyte-39418da0-493e-4ed6-9436-d03e75f5c1c7" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:48:28 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a7a3a018-39ef-4d18-aa74-bbd81e67a616 tempest-VolumesTestJSON-1789453559 None] Lock "cinder-quobyte-39418da0-493e-4ed6-9436-d03e75f5c1c7" acquired by "delete_volume" :: waited 0.030s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:48:28 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[887ab240-32fb-4e48-8723-4a348ae67934]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:48:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a7a3a018-39ef-4d18-aa74-bbd81e67a616 tempest-VolumesTestJSON-1789453559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-39418da0-493e-4ed6-9436-d03e75f5c1c7 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:28 devstack sudo[92962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-39418da0-493e-4ed6-9436-d03e75f5c1c7 Aug 10 12:48:28 devstack sudo[92962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:29 devstack sudo[92962]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a7a3a018-39ef-4d18-aa74-bbd81e67a616 tempest-VolumesTestJSON-1789453559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-39418da0-493e-4ed6-9436-d03e75f5c1c7" returned: 0 in 0.927s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a7a3a018-39ef-4d18-aa74-bbd81e67a616 tempest-VolumesTestJSON-1789453559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-39418da0-493e-4ed6-9436-d03e75f5c1c7 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:29 devstack sudo[92983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-39418da0-493e-4ed6-9436-d03e75f5c1c7 Aug 10 12:48:29 devstack sudo[92983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:30 devstack sudo[92983]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a7a3a018-39ef-4d18-aa74-bbd81e67a616 tempest-VolumesTestJSON-1789453559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-39418da0-493e-4ed6-9436-d03e75f5c1c7" returned: 0 in 0.501s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:30 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a7a3a018-39ef-4d18-aa74-bbd81e67a616 tempest-VolumesTestJSON-1789453559 None] Lock "cinder-quobyte-39418da0-493e-4ed6-9436-d03e75f5c1c7" released by "delete_volume" :: held 1.526s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:48:30 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-a7a3a018-39ef-4d18-aa74-bbd81e67a616 tempest-VolumesTestJSON-1789453559 None] Created reservations ['1734a2db-ee01-4dd3-99b1-975693b7163f', '6de09b4f-9649-442d-afa6-eb12552f7664', '2f43d2cb-7adc-4a34-8b86-0254fe555f77', 'ab03e98b-52b4-4c8f-96bf-e04ed83d3288'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:48:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a7a3a018-39ef-4d18-aa74-bbd81e67a616 tempest-VolumesTestJSON-1789453559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:48:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a7a3a018-39ef-4d18-aa74-bbd81e67a616 tempest-VolumesTestJSON-1789453559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:48:30 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a7a3a018-39ef-4d18-aa74-bbd81e67a616 tempest-VolumesTestJSON-1789453559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:48:30 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a7a3a018-39ef-4d18-aa74-bbd81e67a616 tempest-VolumesTestJSON-1789453559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:48:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a7a3a018-39ef-4d18-aa74-bbd81e67a616 tempest-VolumesTestJSON-1789453559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:48:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a7a3a018-39ef-4d18-aa74-bbd81e67a616 tempest-VolumesTestJSON-1789453559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:30 devstack sudo[93003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:48:30 devstack sudo[93003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:30 devstack sudo[93003]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a7a3a018-39ef-4d18-aa74-bbd81e67a616 tempest-VolumesTestJSON-1789453559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.409s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:30 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-a7a3a018-39ef-4d18-aa74-bbd81e67a616 tempest-VolumesTestJSON-1789453559 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:48:30 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-a7a3a018-39ef-4d18-aa74-bbd81e67a616 tempest-VolumesTestJSON-1789453559 None] Deleted volume successfully. Aug 10 12:48:30 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a7a3a018-39ef-4d18-aa74-bbd81e67a616 tempest-VolumesTestJSON-1789453559 None] Lock "cinder-39418da0-493e-4ed6-9436-d03e75f5c1c7-delete_volume" released by "delete_volume" :: held 2.362s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:48:33 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-7bca3686-28e8-4d52-a7b3-03ae67f21ec5 tempest-GroupsV314Test-766606565 None] Group tempest-GroupsV314Test-Group-2136833628: creating Aug 10 12:48:33 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-7bca3686-28e8-4d52-a7b3-03ae67f21ec5 tempest-GroupsV314Test-766606565 None] Group tempest-GroupsV314Test-Group-2136833628: created successfully Aug 10 12:48:33 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-7bca3686-28e8-4d52-a7b3-03ae67f21ec5 tempest-GroupsV314Test-766606565 None] Create group completed successfully. Aug 10 12:48:35 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-228fe524-9509-4c11-81a5-888a02cb2a96 tempest-GroupsV314Test-766606565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:48:35 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-228fe524-9509-4c11-81a5-888a02cb2a96 tempest-GroupsV314Test-766606565 None] Flow 'volume_create_manager' (010c1e1a-872e-4d8e-a01c-d5faaa953fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:48:35 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-228fe524-9509-4c11-81a5-888a02cb2a96 tempest-GroupsV314Test-766606565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (871769a6-250f-4ede-9071-9090e59e2070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:35 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-228fe524-9509-4c11-81a5-888a02cb2a96 tempest-GroupsV314Test-766606565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (871769a6-250f-4ede-9071-9090e59e2070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2017690780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d8d34296-6808-4d83-8a44-d1fa42fcb17c,host='devstack@QuobyteHD#QuobyteHD',id=e3b130bc-1898-47ca-b941-39cf8b69798d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99f7ae0b66074bf8b631a354c15f1e8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:48:35Z,use_quota=True,user_id='eb82c84509724e8fa276162f1f61372d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8349e631-3e5b-43bd-8482-d039a0bafc18),volume_type_id=8349e631-3e5b-43bd-8482-d039a0bafc18)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:35 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-228fe524-9509-4c11-81a5-888a02cb2a96 tempest-GroupsV314Test-766606565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73ea760a-e606-4f1a-a23a-eee11a7991fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:35 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-228fe524-9509-4c11-81a5-888a02cb2a96 tempest-GroupsV314Test-766606565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73ea760a-e606-4f1a-a23a-eee11a7991fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:35 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-228fe524-9509-4c11-81a5-888a02cb2a96 tempest-GroupsV314Test-766606565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b25292ed-ef28-42c4-b491-7954404e78c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:35 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-228fe524-9509-4c11-81a5-888a02cb2a96 tempest-GroupsV314Test-766606565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b25292ed-ef28-42c4-b491-7954404e78c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3b130bc-1898-47ca-b941-39cf8b69798d', 'volume_name': 'volume-e3b130bc-1898-47ca-b941-39cf8b69798d', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:35 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-228fe524-9509-4c11-81a5-888a02cb2a96 tempest-GroupsV314Test-766606565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4119bbe7-1275-41f1-a87d-0768335947fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:35 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-228fe524-9509-4c11-81a5-888a02cb2a96 tempest-GroupsV314Test-766606565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4119bbe7-1275-41f1-a87d-0768335947fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:35 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-228fe524-9509-4c11-81a5-888a02cb2a96 tempest-GroupsV314Test-766606565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acdba4c9-f637-4960-be96-239cdb055298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:35 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-228fe524-9509-4c11-81a5-888a02cb2a96 tempest-GroupsV314Test-766606565 None] Volume e3b130bc-1898-47ca-b941-39cf8b69798d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3b130bc-1898-47ca-b941-39cf8b69798d', 'volume_size': 1} Aug 10 12:48:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-228fe524-9509-4c11-81a5-888a02cb2a96 tempest-GroupsV314Test-766606565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:48:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-228fe524-9509-4c11-81a5-888a02cb2a96 tempest-GroupsV314Test-766606565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:48:35 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-228fe524-9509-4c11-81a5-888a02cb2a96 tempest-GroupsV314Test-766606565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d8d34296-6808-4d83-8a44-d1fa42fcb17c,created_at=2026-08-10T10:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2017690780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d8d34296-6808-4d83-8a44-d1fa42fcb17c,host='devstack@QuobyteHD#QuobyteHD',id=e3b130bc-1898-47ca-b941-39cf8b69798d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99f7ae0b66074bf8b631a354c15f1e8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:48:35Z,use_quota=True,user_id='eb82c84509724e8fa276162f1f61372d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8349e631-3e5b-43bd-8482-d039a0bafc18),volume_type_id=8349e631-3e5b-43bd-8482-d039a0bafc18)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:48:35 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-228fe524-9509-4c11-81a5-888a02cb2a96 tempest-GroupsV314Test-766606565 None] Creating volume e3b130bc-1898-47ca-b941-39cf8b69798d {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:48:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-228fe524-9509-4c11-81a5-888a02cb2a96 tempest-GroupsV314Test-766606565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:48:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-228fe524-9509-4c11-81a5-888a02cb2a96 tempest-GroupsV314Test-766606565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:48:35 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-228fe524-9509-4c11-81a5-888a02cb2a96 tempest-GroupsV314Test-766606565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:48:35 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-228fe524-9509-4c11-81a5-888a02cb2a96 tempest-GroupsV314Test-766606565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:48:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-228fe524-9509-4c11-81a5-888a02cb2a96 tempest-GroupsV314Test-766606565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:48:35 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-228fe524-9509-4c11-81a5-888a02cb2a96 tempest-GroupsV314Test-766606565 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:48:35 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-228fe524-9509-4c11-81a5-888a02cb2a96 tempest-GroupsV314Test-766606565 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:48:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-228fe524-9509-4c11-81a5-888a02cb2a96 tempest-GroupsV314Test-766606565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:35 devstack sudo[93020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d 1073741824 Aug 10 12:48:35 devstack sudo[93020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:36 devstack sudo[93020]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-228fe524-9509-4c11-81a5-888a02cb2a96 tempest-GroupsV314Test-766606565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d 1073741824" returned: 0 in 0.568s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-228fe524-9509-4c11-81a5-888a02cb2a96 tempest-GroupsV314Test-766606565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:36 devstack sudo[93037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d Aug 10 12:48:36 devstack sudo[93037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:36 devstack sudo[93037]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-228fe524-9509-4c11-81a5-888a02cb2a96 tempest-GroupsV314Test-766606565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d" returned: 0 in 0.381s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:36 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-228fe524-9509-4c11-81a5-888a02cb2a96 tempest-GroupsV314Test-766606565 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:48:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-228fe524-9509-4c11-81a5-888a02cb2a96 tempest-GroupsV314Test-766606565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:48:36 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-228fe524-9509-4c11-81a5-888a02cb2a96 tempest-GroupsV314Test-766606565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acdba4c9-f637-4960-be96-239cdb055298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3b130bc-1898-47ca-b941-39cf8b69798d', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:36 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-228fe524-9509-4c11-81a5-888a02cb2a96 tempest-GroupsV314Test-766606565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (525b51e2-de83-4d44-a51d-ffbd5b84b551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:36 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-228fe524-9509-4c11-81a5-888a02cb2a96 tempest-GroupsV314Test-766606565 None] Volume volume-e3b130bc-1898-47ca-b941-39cf8b69798d (e3b130bc-1898-47ca-b941-39cf8b69798d): created successfully Aug 10 12:48:36 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-228fe524-9509-4c11-81a5-888a02cb2a96 tempest-GroupsV314Test-766606565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (525b51e2-de83-4d44-a51d-ffbd5b84b551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:36 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-228fe524-9509-4c11-81a5-888a02cb2a96 tempest-GroupsV314Test-766606565 None] Flow 'volume_create_manager' (010c1e1a-872e-4d8e-a01c-d5faaa953fdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:48:36 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-228fe524-9509-4c11-81a5-888a02cb2a96 tempest-GroupsV314Test-766606565 None] Created volume successfully. Aug 10 12:48:39 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:UPDATE=105,cinder:SELECT=81,cinder:DELETE=9,cinder:INSERT=24 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:48:39 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=97,cinder:INSERT=21,cinder:UPDATE=96,cinder:DELETE=8 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:48:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:48:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:48:39 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] Cloning volume e3b130bc-1898-47ca-b941-39cf8b69798d to volume 873bdf3d-ca8f-4c3b-b91f-510aabedc476 Aug 10 12:48:39 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] Creating offline snapshot b687b9c7-0b0f-42b5-b366-41dc968ccdde of volume e3b130bc-1898-47ca-b941-39cf8b69798d {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 12:48:39 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[18230d50-516f-4087-a066-4e5609e3aee7]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:48:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:39 devstack sudo[93076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d Aug 10 12:48:39 devstack sudo[93076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:40 devstack sudo[93076]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d" returned: 0 in 0.526s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d.b687b9c7-0b0f-42b5-b366-41dc968ccdde 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:40 devstack sudo[93081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d.b687b9c7-0b0f-42b5-b366-41dc968ccdde 1G Aug 10 12:48:40 devstack sudo[93081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:40 devstack sudo[93081]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d.b687b9c7-0b0f-42b5-b366-41dc968ccdde 1G" returned: 0 in 0.615s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3b130bc-1898-47ca-b941-39cf8b69798d -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d.b687b9c7-0b0f-42b5-b366-41dc968ccdde {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:40 devstack sudo[93087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3b130bc-1898-47ca-b941-39cf8b69798d -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d.b687b9c7-0b0f-42b5-b366-41dc968ccdde Aug 10 12:48:40 devstack sudo[93087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:41 devstack sudo[93087]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3b130bc-1898-47ca-b941-39cf8b69798d -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d.b687b9c7-0b0f-42b5-b366-41dc968ccdde" returned: 0 in 0.412s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:41 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d.b687b9c7-0b0f-42b5-b366-41dc968ccdde is being set with open permissions: ugo+rw: NotImplementedError Aug 10 12:48:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d.b687b9c7-0b0f-42b5-b366-41dc968ccdde {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:41 devstack sudo[93092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d.b687b9c7-0b0f-42b5-b366-41dc968ccdde Aug 10 12:48:41 devstack sudo[93092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:41 devstack sudo[93092]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d.b687b9c7-0b0f-42b5-b366-41dc968ccdde" returned: 0 in 0.518s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:41 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a62232c-e43c-4cb6-a27a-d3f006e9eb38 tempest-ServerRescueNegativeTestJSON-1882419362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:48:41 devstack sudo[93095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d.info Aug 10 12:48:41 devstack sudo[93095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:41 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a62232c-e43c-4cb6-a27a-d3f006e9eb38 tempest-ServerRescueNegativeTestJSON-1882419362 None] Flow 'volume_create_manager' (48b1743b-4fbf-4df3-8832-0ce6036808f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:48:41 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a62232c-e43c-4cb6-a27a-d3f006e9eb38 tempest-ServerRescueNegativeTestJSON-1882419362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78afa725-caa6-4fb5-9d2c-c4689511830e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:41 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a62232c-e43c-4cb6-a27a-d3f006e9eb38 tempest-ServerRescueNegativeTestJSON-1882419362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78afa725-caa6-4fb5-9d2c-c4689511830e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1299188769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5abc28c6-0f89-4d2c-9727-ceb961a57759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be31c63f85dd4fd69d7bf72559c31696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:48:42Z,use_quota=True,user_id='7331640a2d89455cb4260774a1f6e458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:41 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a62232c-e43c-4cb6-a27a-d3f006e9eb38 tempest-ServerRescueNegativeTestJSON-1882419362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e121865-9b4c-4075-9081-6c93b642857a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:41 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a62232c-e43c-4cb6-a27a-d3f006e9eb38 tempest-ServerRescueNegativeTestJSON-1882419362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e121865-9b4c-4075-9081-6c93b642857a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:42 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a62232c-e43c-4cb6-a27a-d3f006e9eb38 tempest-ServerRescueNegativeTestJSON-1882419362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00e63a9e-ac0e-4391-bf39-8dec2f6068d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:42 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a62232c-e43c-4cb6-a27a-d3f006e9eb38 tempest-ServerRescueNegativeTestJSON-1882419362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00e63a9e-ac0e-4391-bf39-8dec2f6068d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5abc28c6-0f89-4d2c-9727-ceb961a57759', 'volume_name': 'volume-5abc28c6-0f89-4d2c-9727-ceb961a57759', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:42 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a62232c-e43c-4cb6-a27a-d3f006e9eb38 tempest-ServerRescueNegativeTestJSON-1882419362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7268f7e5-0ad6-484c-a609-ef5f387218c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:42 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a62232c-e43c-4cb6-a27a-d3f006e9eb38 tempest-ServerRescueNegativeTestJSON-1882419362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7268f7e5-0ad6-484c-a609-ef5f387218c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:42 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a62232c-e43c-4cb6-a27a-d3f006e9eb38 tempest-ServerRescueNegativeTestJSON-1882419362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb8b12fc-2ece-46f5-a8f4-e60c68d2f602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:42 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-1a62232c-e43c-4cb6-a27a-d3f006e9eb38 tempest-ServerRescueNegativeTestJSON-1882419362 None] Volume 5abc28c6-0f89-4d2c-9727-ceb961a57759: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5abc28c6-0f89-4d2c-9727-ceb961a57759', 'volume_size': 1} Aug 10 12:48:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1a62232c-e43c-4cb6-a27a-d3f006e9eb38 tempest-ServerRescueNegativeTestJSON-1882419362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:48:42 devstack sudo[93095]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d.info" returned: 0 in 0.348s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:42 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d.info is being set with open permissions: ugo+rw: NotImplementedError Aug 10 12:48:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:42 devstack sudo[93104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d.info Aug 10 12:48:42 devstack sudo[93104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:42 devstack sudo[93104]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d.info" returned: 0 in 0.325s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:42 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] Acquiring lock "cinder-quobyte-873bdf3d-ca8f-4c3b-b91f-510aabedc476" by "_copy_volume_from_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:48:42 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] Lock "cinder-quobyte-873bdf3d-ca8f-4c3b-b91f-510aabedc476" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:48:42 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] snapshot: b687b9c7-0b0f-42b5-b366-41dc968ccdde, volume: 873bdf3d-ca8f-4c3b-b91f-510aabedc476, {{(pid=89096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 10 12:48:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:48:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:48:42 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:48:42 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:48:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:48:42 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c710be80-90ba-4607-aa27-61d2fff22f97]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:48:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d.b687b9c7-0b0f-42b5-b366-41dc968ccdde {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:42 devstack sudo[93107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d.b687b9c7-0b0f-42b5-b366-41dc968ccdde Aug 10 12:48:42 devstack sudo[93107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:43 devstack sudo[93107]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d.b687b9c7-0b0f-42b5-b366-41dc968ccdde" returned: 0 in 0.592s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:43 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3b130bc-1898-47ca-b941-39cf8b69798d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 12:48:43 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad66163e-def2-42e9-b58f-d56246718dd1]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:48:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:43 devstack sudo[93126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d Aug 10 12:48:43 devstack sudo[93126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:43 devstack sudo[93126]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d" returned: 0 in 0.449s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:43 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d {{(pid=89096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 10 12:48:43 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] Creating direct copy from snapshot {{(pid=89096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 10 12:48:43 devstack cinder-volume[89096]: DEBUG cinder.utils [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] Path /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-873bdf3d-ca8f-4c3b-b91f-510aabedc476 not found in is_blk_device check {{(pid=89096) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 10 12:48:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-873bdf3d-ca8f-4c3b-b91f-510aabedc476 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:43 devstack sudo[93131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-873bdf3d-ca8f-4c3b-b91f-510aabedc476 Aug 10 12:48:43 devstack sudo[93131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:43 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-54d944b0-f78b-4a40-bafd-42cff1772ebe tempest-GroupSnapshotsTest-1480305479 None] Group tempest-GroupSnapshotsTest-Group-1715815334: creating Aug 10 12:48:43 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-54d944b0-f78b-4a40-bafd-42cff1772ebe tempest-GroupSnapshotsTest-1480305479 None] Group tempest-GroupSnapshotsTest-Group-1715815334: created successfully Aug 10 12:48:43 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-54d944b0-f78b-4a40-bafd-42cff1772ebe tempest-GroupSnapshotsTest-1480305479 None] Create group completed successfully. Aug 10 12:48:46 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-6607c397-7868-4d83-beba-8ba5971ae578 tempest-GroupSnapshotsTest-1480305479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:48:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6607c397-7868-4d83-beba-8ba5971ae578 tempest-GroupSnapshotsTest-1480305479 None] Flow 'volume_create_manager' (76377830-5809-47d8-bd43-154ffc5f3766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:48:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6607c397-7868-4d83-beba-8ba5971ae578 tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (688e8633-117b-4126-ad49-51c503c7b071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6607c397-7868-4d83-beba-8ba5971ae578 tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (688e8633-117b-4126-ad49-51c503c7b071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-150402231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b81530f0-73c6-4566-af32-c34bdd126218,host='devstack@QuobyteHD#QuobyteHD',id=34018968-8c90-4b3a-a4b6-903b433b786d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8989f0078d4821bad814877f45db3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:48:47Z,use_quota=True,user_id='613ed7ca0d874ceb8c808624cfbb57b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb955de5-8eb8-4da4-aba2-0d10e09abf04),volume_type_id=cb955de5-8eb8-4da4-aba2-0d10e09abf04)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6607c397-7868-4d83-beba-8ba5971ae578 tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb3bf438-1235-4175-a8da-061d8de0e2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6607c397-7868-4d83-beba-8ba5971ae578 tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb3bf438-1235-4175-a8da-061d8de0e2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6607c397-7868-4d83-beba-8ba5971ae578 tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02ba0430-d507-4258-98b8-4916044cd467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6607c397-7868-4d83-beba-8ba5971ae578 tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02ba0430-d507-4258-98b8-4916044cd467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34018968-8c90-4b3a-a4b6-903b433b786d', 'volume_name': 'volume-34018968-8c90-4b3a-a4b6-903b433b786d', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6607c397-7868-4d83-beba-8ba5971ae578 tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1742c026-5d00-434d-b8aa-1467e35f492e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6607c397-7868-4d83-beba-8ba5971ae578 tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1742c026-5d00-434d-b8aa-1467e35f492e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6607c397-7868-4d83-beba-8ba5971ae578 tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11fc105b-feca-4c65-9b52-c745adbd5c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:46 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-6607c397-7868-4d83-beba-8ba5971ae578 tempest-GroupSnapshotsTest-1480305479 None] Volume 34018968-8c90-4b3a-a4b6-903b433b786d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34018968-8c90-4b3a-a4b6-903b433b786d', 'volume_size': 1} Aug 10 12:48:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6607c397-7868-4d83-beba-8ba5971ae578 tempest-GroupSnapshotsTest-1480305479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:48:50 devstack sudo[93131]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-873bdf3d-ca8f-4c3b-b91f-510aabedc476" returned: 0 in 6.499s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:50 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] Image conversion details: src /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d, size 1024.00 MB, duration 6.50 sec, destination /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-873bdf3d-ca8f-4c3b-b91f-510aabedc476 {{(pid=89096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 12:48:50 devstack cinder-volume[89096]: INFO cinder.image.image_utils [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] Converted 1024.00 MB image at 157.53 MB/s Aug 10 12:48:50 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-873bdf3d-ca8f-4c3b-b91f-510aabedc476 is being set with open permissions: ugo+rw: NotImplementedError Aug 10 12:48:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-873bdf3d-ca8f-4c3b-b91f-510aabedc476 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:50 devstack sudo[93159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-873bdf3d-ca8f-4c3b-b91f-510aabedc476 Aug 10 12:48:50 devstack sudo[93159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:50 devstack sudo[93159]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-873bdf3d-ca8f-4c3b-b91f-510aabedc476" returned: 0 in 0.255s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:50 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] Lock "cinder-quobyte-873bdf3d-ca8f-4c3b-b91f-510aabedc476" released by "_copy_volume_from_snapshot" :: held 7.881s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:48:50 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] Acquiring lock "cinder-quobyte-b687b9c7-0b0f-42b5-b366-41dc968ccdde" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:48:50 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] Lock "cinder-quobyte-b687b9c7-0b0f-42b5-b366-41dc968ccdde" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:48:50 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] Deleting offline snapshot b687b9c7-0b0f-42b5-b366-41dc968ccdde of volume e3b130bc-1898-47ca-b941-39cf8b69798d {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 12:48:50 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] snapshot_file for this snap is: volume-e3b130bc-1898-47ca-b941-39cf8b69798d.b687b9c7-0b0f-42b5-b366-41dc968ccdde {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 12:48:50 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[9440d191-0e4d-4a7d-94c0-9247ad0ae124]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:48:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d.b687b9c7-0b0f-42b5-b366-41dc968ccdde {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:50 devstack sudo[93162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d.b687b9c7-0b0f-42b5-b366-41dc968ccdde Aug 10 12:48:50 devstack sudo[93162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:50 devstack sudo[93162]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d.b687b9c7-0b0f-42b5-b366-41dc968ccdde" returned: 0 in 0.358s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:50 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3b130bc-1898-47ca-b941-39cf8b69798d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 12:48:50 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[9baaed50-4017-44f7-bdb9-c21a9073e69b]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:48:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:50 devstack sudo[93167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d Aug 10 12:48:50 devstack sudo[93167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:51 devstack sudo[93167]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d" returned: 0 in 0.631s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d.b687b9c7-0b0f-42b5-b366-41dc968ccdde {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:51 devstack sudo[93172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d.b687b9c7-0b0f-42b5-b366-41dc968ccdde Aug 10 12:48:51 devstack sudo[93172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:51 devstack sudo[93172]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d.b687b9c7-0b0f-42b5-b366-41dc968ccdde" returned: 0 in 0.335s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d.b687b9c7-0b0f-42b5-b366-41dc968ccdde {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:51 devstack sudo[93177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d.b687b9c7-0b0f-42b5-b366-41dc968ccdde Aug 10 12:48:51 devstack sudo[93177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:52 devstack sudo[93177]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d.b687b9c7-0b0f-42b5-b366-41dc968ccdde" returned: 0 in 0.271s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:52 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] Lock "cinder-quobyte-b687b9c7-0b0f-42b5-b366-41dc968ccdde" released by "_delete_snapshot" :: held 1.692s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:48:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.680s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:48:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1a62232c-e43c-4cb6-a27a-d3f006e9eb38 tempest-ServerRescueNegativeTestJSON-1882419362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.067s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:48:52 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1a62232c-e43c-4cb6-a27a-d3f006e9eb38 tempest-ServerRescueNegativeTestJSON-1882419362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1299188769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5abc28c6-0f89-4d2c-9727-ceb961a57759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be31c63f85dd4fd69d7bf72559c31696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:48:42Z,use_quota=True,user_id='7331640a2d89455cb4260774a1f6e458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:48:52 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-1a62232c-e43c-4cb6-a27a-d3f006e9eb38 tempest-ServerRescueNegativeTestJSON-1882419362 None] Creating volume 5abc28c6-0f89-4d2c-9727-ceb961a57759 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:48:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1a62232c-e43c-4cb6-a27a-d3f006e9eb38 tempest-ServerRescueNegativeTestJSON-1882419362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:48:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1a62232c-e43c-4cb6-a27a-d3f006e9eb38 tempest-ServerRescueNegativeTestJSON-1882419362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:48:52 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1a62232c-e43c-4cb6-a27a-d3f006e9eb38 tempest-ServerRescueNegativeTestJSON-1882419362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:48:52 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1a62232c-e43c-4cb6-a27a-d3f006e9eb38 tempest-ServerRescueNegativeTestJSON-1882419362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:48:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1a62232c-e43c-4cb6-a27a-d3f006e9eb38 tempest-ServerRescueNegativeTestJSON-1882419362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:48:52 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1a62232c-e43c-4cb6-a27a-d3f006e9eb38 tempest-ServerRescueNegativeTestJSON-1882419362 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:48:52 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-1a62232c-e43c-4cb6-a27a-d3f006e9eb38 tempest-ServerRescueNegativeTestJSON-1882419362 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:48:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1a62232c-e43c-4cb6-a27a-d3f006e9eb38 tempest-ServerRescueNegativeTestJSON-1882419362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5abc28c6-0f89-4d2c-9727-ceb961a57759 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:52 devstack sudo[93180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5abc28c6-0f89-4d2c-9727-ceb961a57759 1073741824 Aug 10 12:48:52 devstack sudo[93180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:52 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-af7e44dc-3b67-483e-a4b9-0e4c043cc464 tempest-GroupsV314Test-766606565 None] Create group from source-group-d8d34296-6808-4d83-8a44-d1fa42fcb17c completed successfully. Aug 10 12:48:52 devstack sudo[93180]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1a62232c-e43c-4cb6-a27a-d3f006e9eb38 tempest-ServerRescueNegativeTestJSON-1882419362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5abc28c6-0f89-4d2c-9727-ceb961a57759 1073741824" returned: 0 in 0.513s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1a62232c-e43c-4cb6-a27a-d3f006e9eb38 tempest-ServerRescueNegativeTestJSON-1882419362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5abc28c6-0f89-4d2c-9727-ceb961a57759 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:52 devstack sudo[93198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5abc28c6-0f89-4d2c-9727-ceb961a57759 Aug 10 12:48:52 devstack sudo[93198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:52 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c764b473-05b3-4275-bf8e-49c1523c5ab9 tempest-GroupsV314Test-766606565 None] Acquiring lock "cinder-quobyte-873bdf3d-ca8f-4c3b-b91f-510aabedc476" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:48:53 devstack sudo[93198]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1a62232c-e43c-4cb6-a27a-d3f006e9eb38 tempest-ServerRescueNegativeTestJSON-1882419362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5abc28c6-0f89-4d2c-9727-ceb961a57759" returned: 0 in 0.310s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:53 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1a62232c-e43c-4cb6-a27a-d3f006e9eb38 tempest-ServerRescueNegativeTestJSON-1882419362 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:48:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1a62232c-e43c-4cb6-a27a-d3f006e9eb38 tempest-ServerRescueNegativeTestJSON-1882419362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:48:53 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c764b473-05b3-4275-bf8e-49c1523c5ab9 tempest-GroupsV314Test-766606565 None] Lock "cinder-quobyte-873bdf3d-ca8f-4c3b-b91f-510aabedc476" acquired by "delete_volume" :: waited 0.034s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:48:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6607c397-7868-4d83-beba-8ba5971ae578 tempest-GroupSnapshotsTest-1480305479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.068s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:48:53 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6607c397-7868-4d83-beba-8ba5971ae578 tempest-GroupSnapshotsTest-1480305479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b81530f0-73c6-4566-af32-c34bdd126218,created_at=2026-08-10T10:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-150402231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b81530f0-73c6-4566-af32-c34bdd126218,host='devstack@QuobyteHD#QuobyteHD',id=34018968-8c90-4b3a-a4b6-903b433b786d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8989f0078d4821bad814877f45db3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:48:47Z,use_quota=True,user_id='613ed7ca0d874ceb8c808624cfbb57b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb955de5-8eb8-4da4-aba2-0d10e09abf04),volume_type_id=cb955de5-8eb8-4da4-aba2-0d10e09abf04)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:48:53 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-6607c397-7868-4d83-beba-8ba5971ae578 tempest-GroupSnapshotsTest-1480305479 None] Creating volume 34018968-8c90-4b3a-a4b6-903b433b786d {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:48:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6607c397-7868-4d83-beba-8ba5971ae578 tempest-GroupSnapshotsTest-1480305479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:48:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6607c397-7868-4d83-beba-8ba5971ae578 tempest-GroupSnapshotsTest-1480305479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:48:53 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6607c397-7868-4d83-beba-8ba5971ae578 tempest-GroupSnapshotsTest-1480305479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:48:53 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6607c397-7868-4d83-beba-8ba5971ae578 tempest-GroupSnapshotsTest-1480305479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:48:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6607c397-7868-4d83-beba-8ba5971ae578 tempest-GroupSnapshotsTest-1480305479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:48:53 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6607c397-7868-4d83-beba-8ba5971ae578 tempest-GroupSnapshotsTest-1480305479 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:48:53 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-6607c397-7868-4d83-beba-8ba5971ae578 tempest-GroupSnapshotsTest-1480305479 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:48:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6607c397-7868-4d83-beba-8ba5971ae578 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:53 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90c04c2-35b2-4c73-b74c-8415470d1f90]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:48:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c764b473-05b3-4275-bf8e-49c1523c5ab9 tempest-GroupsV314Test-766606565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-873bdf3d-ca8f-4c3b-b91f-510aabedc476 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:53 devstack sudo[93220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d 1073741824 Aug 10 12:48:53 devstack sudo[93220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a62232c-e43c-4cb6-a27a-d3f006e9eb38 tempest-ServerRescueNegativeTestJSON-1882419362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb8b12fc-2ece-46f5-a8f4-e60c68d2f602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5abc28c6-0f89-4d2c-9727-ceb961a57759', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a62232c-e43c-4cb6-a27a-d3f006e9eb38 tempest-ServerRescueNegativeTestJSON-1882419362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (356cf099-c5bd-4681-861c-4ad1d9fa8f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:53 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-1a62232c-e43c-4cb6-a27a-d3f006e9eb38 tempest-ServerRescueNegativeTestJSON-1882419362 None] Volume volume-5abc28c6-0f89-4d2c-9727-ceb961a57759 (5abc28c6-0f89-4d2c-9727-ceb961a57759): created successfully Aug 10 12:48:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a62232c-e43c-4cb6-a27a-d3f006e9eb38 tempest-ServerRescueNegativeTestJSON-1882419362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (356cf099-c5bd-4681-861c-4ad1d9fa8f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a62232c-e43c-4cb6-a27a-d3f006e9eb38 tempest-ServerRescueNegativeTestJSON-1882419362 None] Flow 'volume_create_manager' (48b1743b-4fbf-4df3-8832-0ce6036808f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:48:53 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-1a62232c-e43c-4cb6-a27a-d3f006e9eb38 tempest-ServerRescueNegativeTestJSON-1882419362 None] Created volume successfully. Aug 10 12:48:53 devstack sudo[93221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-873bdf3d-ca8f-4c3b-b91f-510aabedc476 Aug 10 12:48:53 devstack sudo[93221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:53 devstack sudo[93221]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c764b473-05b3-4275-bf8e-49c1523c5ab9 tempest-GroupsV314Test-766606565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-873bdf3d-ca8f-4c3b-b91f-510aabedc476" returned: 0 in 0.450s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c764b473-05b3-4275-bf8e-49c1523c5ab9 tempest-GroupsV314Test-766606565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-873bdf3d-ca8f-4c3b-b91f-510aabedc476 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:53 devstack sudo[93230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-873bdf3d-ca8f-4c3b-b91f-510aabedc476 Aug 10 12:48:53 devstack sudo[93230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:53 devstack sudo[93220]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6607c397-7868-4d83-beba-8ba5971ae578 tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d 1073741824" returned: 0 in 0.549s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6607c397-7868-4d83-beba-8ba5971ae578 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:53 devstack sudo[93232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d Aug 10 12:48:53 devstack sudo[93232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:53 devstack sudo[93230]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c764b473-05b3-4275-bf8e-49c1523c5ab9 tempest-GroupsV314Test-766606565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-873bdf3d-ca8f-4c3b-b91f-510aabedc476" returned: 0 in 0.254s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:53 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c764b473-05b3-4275-bf8e-49c1523c5ab9 tempest-GroupsV314Test-766606565 None] Lock "cinder-quobyte-873bdf3d-ca8f-4c3b-b91f-510aabedc476" released by "delete_volume" :: held 0.783s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:48:53 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-c764b473-05b3-4275-bf8e-49c1523c5ab9 tempest-GroupsV314Test-766606565 None] Created reservations ['b52b415d-e6f5-43a3-99af-d2e3d7cb0ef0'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:48:53 devstack cinder-volume[89096]: WARNING cinder.quota [None req-c764b473-05b3-4275-bf8e-49c1523c5ab9 tempest-GroupsV314Test-766606565 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1282848051 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1282848051, it is now deprecated. Please use the default quota class for default quota. Aug 10 12:48:53 devstack cinder-volume[89096]: WARNING cinder.quota [None req-c764b473-05b3-4275-bf8e-49c1523c5ab9 tempest-GroupsV314Test-766606565 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1282848051 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1282848051, it is now deprecated. Please use the default quota class for default quota. Aug 10 12:48:53 devstack sudo[93232]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6607c397-7868-4d83-beba-8ba5971ae578 tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d" returned: 0 in 0.256s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:53 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6607c397-7868-4d83-beba-8ba5971ae578 tempest-GroupSnapshotsTest-1480305479 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:48:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6607c397-7868-4d83-beba-8ba5971ae578 tempest-GroupSnapshotsTest-1480305479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:48:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6607c397-7868-4d83-beba-8ba5971ae578 tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11fc105b-feca-4c65-9b52-c745adbd5c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34018968-8c90-4b3a-a4b6-903b433b786d', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6607c397-7868-4d83-beba-8ba5971ae578 tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25304763-541c-44fc-9293-f106c8defc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:48:53 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-c764b473-05b3-4275-bf8e-49c1523c5ab9 tempest-GroupsV314Test-766606565 None] Created reservations ['b34ca071-04c9-4d22-b0a8-99d9ad283f65', '8179f21c-8e3b-4830-bd01-17f612756679', '4bb2bf4f-8a68-4722-b9e9-33337e09ade4', '3fea9ec7-5344-44b1-80e1-5dfc36ef9974'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:48:53 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-6607c397-7868-4d83-beba-8ba5971ae578 tempest-GroupSnapshotsTest-1480305479 None] Volume volume-34018968-8c90-4b3a-a4b6-903b433b786d (34018968-8c90-4b3a-a4b6-903b433b786d): created successfully Aug 10 12:48:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6607c397-7868-4d83-beba-8ba5971ae578 tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25304763-541c-44fc-9293-f106c8defc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:48:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6607c397-7868-4d83-beba-8ba5971ae578 tempest-GroupSnapshotsTest-1480305479 None] Flow 'volume_create_manager' (76377830-5809-47d8-bd43-154ffc5f3766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:48:53 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-6607c397-7868-4d83-beba-8ba5971ae578 tempest-GroupSnapshotsTest-1480305479 None] Created volume successfully. Aug 10 12:48:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c764b473-05b3-4275-bf8e-49c1523c5ab9 tempest-GroupsV314Test-766606565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:48:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c764b473-05b3-4275-bf8e-49c1523c5ab9 tempest-GroupsV314Test-766606565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:48:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c764b473-05b3-4275-bf8e-49c1523c5ab9 tempest-GroupsV314Test-766606565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:48:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c764b473-05b3-4275-bf8e-49c1523c5ab9 tempest-GroupsV314Test-766606565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:48:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c764b473-05b3-4275-bf8e-49c1523c5ab9 tempest-GroupsV314Test-766606565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:48:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c764b473-05b3-4275-bf8e-49c1523c5ab9 tempest-GroupsV314Test-766606565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:54 devstack sudo[93236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:48:54 devstack sudo[93236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:54 devstack sudo[93236]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c764b473-05b3-4275-bf8e-49c1523c5ab9 tempest-GroupsV314Test-766606565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.246s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:54 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-c764b473-05b3-4275-bf8e-49c1523c5ab9 tempest-GroupsV314Test-766606565 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:48:54 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-c764b473-05b3-4275-bf8e-49c1523c5ab9 tempest-GroupsV314Test-766606565 None] Delete group completed successfully. Aug 10 12:48:54 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-13a0c786-33a2-44ca-9bb7-bf675e56958a tempest-GroupsV314Test-766606565 None] Acquiring lock "cinder-quobyte-e3b130bc-1898-47ca-b941-39cf8b69798d" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:48:54 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-13a0c786-33a2-44ca-9bb7-bf675e56958a tempest-GroupsV314Test-766606565 None] Lock "cinder-quobyte-e3b130bc-1898-47ca-b941-39cf8b69798d" acquired by "delete_volume" :: waited 0.014s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:48:54 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3a881b-b3f4-48b1-9ff8-f43d9fff9108]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:48:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-13a0c786-33a2-44ca-9bb7-bf675e56958a tempest-GroupsV314Test-766606565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:54 devstack sudo[93240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d Aug 10 12:48:54 devstack sudo[93240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:55 devstack sudo[93240]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-13a0c786-33a2-44ca-9bb7-bf675e56958a tempest-GroupsV314Test-766606565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d" returned: 0 in 0.416s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-13a0c786-33a2-44ca-9bb7-bf675e56958a tempest-GroupsV314Test-766606565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:55 devstack sudo[93246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d Aug 10 12:48:55 devstack sudo[93246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:55 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-ca4a0e3b-ce58-406a-a084-6c4342a9842d tempest-GroupSnapshotsTest-1480305479 None] GroupSnapshot 6e605b68-9808-4719-93c2-70a5ad06ec7b: creating. Aug 10 12:48:55 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ca4a0e3b-ce58-406a-a084-6c4342a9842d tempest-GroupSnapshotsTest-1480305479 None] Group snapshot 6e605b68-9808-4719-93c2-70a5ad06ec7b: creating. {{(pid=89096) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 10 12:48:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ca4a0e3b-ce58-406a-a084-6c4342a9842d tempest-GroupSnapshotsTest-1480305479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:48:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ca4a0e3b-ce58-406a-a084-6c4342a9842d tempest-GroupSnapshotsTest-1480305479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:48:55 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-ca4a0e3b-ce58-406a-a084-6c4342a9842d tempest-GroupSnapshotsTest-1480305479 None] Creating offline snapshot b2ff1ea2-7c53-4af8-8315-78c1d1bb15e4 of volume 34018968-8c90-4b3a-a4b6-903b433b786d {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 12:48:55 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e86a1b7-9eae-4670-b05b-d1f5a6c1f319]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:48:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ca4a0e3b-ce58-406a-a084-6c4342a9842d tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:55 devstack sudo[93246]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-13a0c786-33a2-44ca-9bb7-bf675e56958a tempest-GroupsV314Test-766606565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e3b130bc-1898-47ca-b941-39cf8b69798d" returned: 0 in 0.288s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:55 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-13a0c786-33a2-44ca-9bb7-bf675e56958a tempest-GroupsV314Test-766606565 None] Lock "cinder-quobyte-e3b130bc-1898-47ca-b941-39cf8b69798d" released by "delete_volume" :: held 0.770s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:48:55 devstack sudo[93251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d Aug 10 12:48:55 devstack sudo[93251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:55 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-13a0c786-33a2-44ca-9bb7-bf675e56958a tempest-GroupsV314Test-766606565 None] Created reservations ['ed6a1c3e-f1a3-4b93-9bd3-7f208b73eff8'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:48:55 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-13a0c786-33a2-44ca-9bb7-bf675e56958a tempest-GroupsV314Test-766606565 None] Created reservations ['a5d4c248-c600-492f-9d47-613beebae284', '4d536409-a133-4aca-b3f7-387caed84ae8', '7cd2355d-c4da-49e9-98e1-7126306b9f91', 'a27fb58e-6010-486c-b57c-f4567ad4ec0a'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:48:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-13a0c786-33a2-44ca-9bb7-bf675e56958a tempest-GroupsV314Test-766606565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:48:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-13a0c786-33a2-44ca-9bb7-bf675e56958a tempest-GroupsV314Test-766606565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:48:55 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-13a0c786-33a2-44ca-9bb7-bf675e56958a tempest-GroupsV314Test-766606565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:48:55 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-13a0c786-33a2-44ca-9bb7-bf675e56958a tempest-GroupsV314Test-766606565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:48:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-13a0c786-33a2-44ca-9bb7-bf675e56958a tempest-GroupsV314Test-766606565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:48:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-13a0c786-33a2-44ca-9bb7-bf675e56958a tempest-GroupsV314Test-766606565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:55 devstack sudo[93263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:48:55 devstack sudo[93263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:55 devstack sudo[93251]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ca4a0e3b-ce58-406a-a084-6c4342a9842d tempest-GroupSnapshotsTest-1480305479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d" returned: 0 in 0.394s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ca4a0e3b-ce58-406a-a084-6c4342a9842d tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d.b2ff1ea2-7c53-4af8-8315-78c1d1bb15e4 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:55 devstack sudo[93267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d.b2ff1ea2-7c53-4af8-8315-78c1d1bb15e4 1G Aug 10 12:48:55 devstack sudo[93267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-13a0c786-33a2-44ca-9bb7-bf675e56958a tempest-GroupsV314Test-766606565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.313s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:55 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-13a0c786-33a2-44ca-9bb7-bf675e56958a tempest-GroupsV314Test-766606565 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:48:55 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-13a0c786-33a2-44ca-9bb7-bf675e56958a tempest-GroupsV314Test-766606565 None] Delete group completed successfully. Aug 10 12:48:55 devstack sudo[93263]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:56 devstack sudo[93267]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ca4a0e3b-ce58-406a-a084-6c4342a9842d tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d.b2ff1ea2-7c53-4af8-8315-78c1d1bb15e4 1G" returned: 0 in 0.524s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ca4a0e3b-ce58-406a-a084-6c4342a9842d tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34018968-8c90-4b3a-a4b6-903b433b786d -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d.b2ff1ea2-7c53-4af8-8315-78c1d1bb15e4 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:56 devstack sudo[93283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34018968-8c90-4b3a-a4b6-903b433b786d -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d.b2ff1ea2-7c53-4af8-8315-78c1d1bb15e4 Aug 10 12:48:56 devstack sudo[93283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:56 devstack sudo[93283]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ca4a0e3b-ce58-406a-a084-6c4342a9842d tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34018968-8c90-4b3a-a4b6-903b433b786d -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d.b2ff1ea2-7c53-4af8-8315-78c1d1bb15e4" returned: 0 in 0.307s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:56 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-ca4a0e3b-ce58-406a-a084-6c4342a9842d tempest-GroupSnapshotsTest-1480305479 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d.b2ff1ea2-7c53-4af8-8315-78c1d1bb15e4 is being set with open permissions: ugo+rw: NotImplementedError Aug 10 12:48:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ca4a0e3b-ce58-406a-a084-6c4342a9842d tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d.b2ff1ea2-7c53-4af8-8315-78c1d1bb15e4 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:56 devstack sudo[93295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d.b2ff1ea2-7c53-4af8-8315-78c1d1bb15e4 Aug 10 12:48:56 devstack sudo[93295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:56 devstack sudo[93295]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ca4a0e3b-ce58-406a-a084-6c4342a9842d tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d.b2ff1ea2-7c53-4af8-8315-78c1d1bb15e4" returned: 0 in 0.261s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ca4a0e3b-ce58-406a-a084-6c4342a9842d tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:56 devstack sudo[93310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d.info Aug 10 12:48:56 devstack sudo[93310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:57 devstack sudo[93310]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ca4a0e3b-ce58-406a-a084-6c4342a9842d tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d.info" returned: 0 in 0.290s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:57 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-ca4a0e3b-ce58-406a-a084-6c4342a9842d tempest-GroupSnapshotsTest-1480305479 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d.info is being set with open permissions: ugo+rw: NotImplementedError Aug 10 12:48:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ca4a0e3b-ce58-406a-a084-6c4342a9842d tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:48:57 devstack sudo[93326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d.info Aug 10 12:48:57 devstack sudo[93326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:48:57 devstack sudo[93326]: pam_unix(sudo:session): session closed for user root Aug 10 12:48:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ca4a0e3b-ce58-406a-a084-6c4342a9842d tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d.info" returned: 0 in 0.307s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:48:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ca4a0e3b-ce58-406a-a084-6c4342a9842d tempest-GroupSnapshotsTest-1480305479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.178s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:48:57 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-ca4a0e3b-ce58-406a-a084-6c4342a9842d tempest-GroupSnapshotsTest-1480305479 None] group_snapshot 6e605b68-9808-4719-93c2-70a5ad06ec7b: created successfully Aug 10 12:48:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-588c974d-84e2-439d-bbd2-f01bedc38f4d tempest-GroupSnapshotsTest-1480305479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:48:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-588c974d-84e2-439d-bbd2-f01bedc38f4d tempest-GroupSnapshotsTest-1480305479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:48:59 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-588c974d-84e2-439d-bbd2-f01bedc38f4d tempest-GroupSnapshotsTest-1480305479 None] Acquiring lock "cinder-quobyte-b2ff1ea2-7c53-4af8-8315-78c1d1bb15e4-9adc68e9-c335-41be-a7d5-199c96900325" by "_create_volume_from_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:48:59 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-588c974d-84e2-439d-bbd2-f01bedc38f4d tempest-GroupSnapshotsTest-1480305479 None] Lock "cinder-quobyte-b2ff1ea2-7c53-4af8-8315-78c1d1bb15e4-9adc68e9-c335-41be-a7d5-199c96900325" acquired by "_create_volume_from_snapshot" :: waited 0.053s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:48:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-588c974d-84e2-439d-bbd2-f01bedc38f4d tempest-GroupSnapshotsTest-1480305479 None] Creating volume 9adc68e9-c335-41be-a7d5-199c96900325 from snapshot b2ff1ea2-7c53-4af8-8315-78c1d1bb15e4 {{(pid=89096) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 10 12:48:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-588c974d-84e2-439d-bbd2-f01bedc38f4d tempest-GroupSnapshotsTest-1480305479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:48:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-588c974d-84e2-439d-bbd2-f01bedc38f4d tempest-GroupSnapshotsTest-1480305479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:48:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-588c974d-84e2-439d-bbd2-f01bedc38f4d tempest-GroupSnapshotsTest-1480305479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:48:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-588c974d-84e2-439d-bbd2-f01bedc38f4d tempest-GroupSnapshotsTest-1480305479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:48:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-588c974d-84e2-439d-bbd2-f01bedc38f4d tempest-GroupSnapshotsTest-1480305479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:48:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-588c974d-84e2-439d-bbd2-f01bedc38f4d tempest-GroupSnapshotsTest-1480305479 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:48:59 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-588c974d-84e2-439d-bbd2-f01bedc38f4d tempest-GroupSnapshotsTest-1480305479 None] Acquiring lock "cinder-quobyte-9adc68e9-c335-41be-a7d5-199c96900325" by "_copy_volume_from_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:48:59 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-588c974d-84e2-439d-bbd2-f01bedc38f4d tempest-GroupSnapshotsTest-1480305479 None] Lock "cinder-quobyte-9adc68e9-c335-41be-a7d5-199c96900325" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:48:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-588c974d-84e2-439d-bbd2-f01bedc38f4d tempest-GroupSnapshotsTest-1480305479 None] snapshot: b2ff1ea2-7c53-4af8-8315-78c1d1bb15e4, volume: 9adc68e9-c335-41be-a7d5-199c96900325, {{(pid=89096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 10 12:48:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-588c974d-84e2-439d-bbd2-f01bedc38f4d tempest-GroupSnapshotsTest-1480305479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:48:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-588c974d-84e2-439d-bbd2-f01bedc38f4d tempest-GroupSnapshotsTest-1480305479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:48:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-588c974d-84e2-439d-bbd2-f01bedc38f4d tempest-GroupSnapshotsTest-1480305479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:48:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-588c974d-84e2-439d-bbd2-f01bedc38f4d tempest-GroupSnapshotsTest-1480305479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:48:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-588c974d-84e2-439d-bbd2-f01bedc38f4d tempest-GroupSnapshotsTest-1480305479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:48:59 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba56f517-6281-440f-91a3-1d3eee937a8c]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:48:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-588c974d-84e2-439d-bbd2-f01bedc38f4d tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d.b2ff1ea2-7c53-4af8-8315-78c1d1bb15e4 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:00 devstack sudo[93334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d.b2ff1ea2-7c53-4af8-8315-78c1d1bb15e4 Aug 10 12:49:00 devstack sudo[93334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:00 devstack sudo[93334]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-588c974d-84e2-439d-bbd2-f01bedc38f4d tempest-GroupSnapshotsTest-1480305479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d.b2ff1ea2-7c53-4af8-8315-78c1d1bb15e4" returned: 0 in 0.657s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:00 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-588c974d-84e2-439d-bbd2-f01bedc38f4d tempest-GroupSnapshotsTest-1480305479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34018968-8c90-4b3a-a4b6-903b433b786d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 12:49:00 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd7a831-4eb5-4e51-bb43-79f88681c75f]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:49:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-588c974d-84e2-439d-bbd2-f01bedc38f4d tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:00 devstack sudo[93339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d Aug 10 12:49:00 devstack sudo[93339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:00 devstack sudo[93339]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-588c974d-84e2-439d-bbd2-f01bedc38f4d tempest-GroupSnapshotsTest-1480305479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d" returned: 0 in 0.511s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:00 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-588c974d-84e2-439d-bbd2-f01bedc38f4d tempest-GroupSnapshotsTest-1480305479 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d {{(pid=89096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 10 12:49:00 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-588c974d-84e2-439d-bbd2-f01bedc38f4d tempest-GroupSnapshotsTest-1480305479 None] Creating direct copy from snapshot {{(pid=89096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 10 12:49:00 devstack cinder-volume[89096]: DEBUG cinder.utils [None req-588c974d-84e2-439d-bbd2-f01bedc38f4d tempest-GroupSnapshotsTest-1480305479 None] Path /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9adc68e9-c335-41be-a7d5-199c96900325 not found in is_blk_device check {{(pid=89096) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 10 12:49:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-588c974d-84e2-439d-bbd2-f01bedc38f4d tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9adc68e9-c335-41be-a7d5-199c96900325 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:01 devstack sudo[93357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9adc68e9-c335-41be-a7d5-199c96900325 Aug 10 12:49:01 devstack sudo[93357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:03 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 12:49:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:49:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:49:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:49:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:49:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:49:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:03 devstack sudo[93404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:49:03 devstack sudo[93404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:04 devstack sudo[93404]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.707s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:04 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:49:04 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager._thread_info {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 12:49:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread count: 8 {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 12:49:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread info: [<_MainThread(MainThread, started 130607683133568)>, , , , , , , ] {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Aug 10 12:49:06 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-26d34bb3-2443-4c8c-94ab-323f64c6735e tempest-ServerRescueNegativeTestJSON-1882419362 None] Acquiring lock "cinder-5abc28c6-0f89-4d2c-9727-ceb961a57759-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:49:06 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-26d34bb3-2443-4c8c-94ab-323f64c6735e tempest-ServerRescueNegativeTestJSON-1882419362 None] Lock "cinder-5abc28c6-0f89-4d2c-9727-ceb961a57759-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:49:06 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-26d34bb3-2443-4c8c-94ab-323f64c6735e tempest-ServerRescueNegativeTestJSON-1882419362 None] Acquiring lock "cinder-quobyte-5abc28c6-0f89-4d2c-9727-ceb961a57759" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:49:06 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-26d34bb3-2443-4c8c-94ab-323f64c6735e tempest-ServerRescueNegativeTestJSON-1882419362 None] Lock "cinder-quobyte-5abc28c6-0f89-4d2c-9727-ceb961a57759" acquired by "delete_volume" :: waited 0.034s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:49:06 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45573d9-d658-4a2b-8aa3-20d00297cb38]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:49:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-26d34bb3-2443-4c8c-94ab-323f64c6735e tempest-ServerRescueNegativeTestJSON-1882419362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5abc28c6-0f89-4d2c-9727-ceb961a57759 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:06 devstack sudo[93424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5abc28c6-0f89-4d2c-9727-ceb961a57759 Aug 10 12:49:06 devstack sudo[93424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:07 devstack sudo[93424]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-26d34bb3-2443-4c8c-94ab-323f64c6735e tempest-ServerRescueNegativeTestJSON-1882419362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5abc28c6-0f89-4d2c-9727-ceb961a57759" returned: 0 in 1.290s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-26d34bb3-2443-4c8c-94ab-323f64c6735e tempest-ServerRescueNegativeTestJSON-1882419362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5abc28c6-0f89-4d2c-9727-ceb961a57759 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:07 devstack sudo[93357]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-588c974d-84e2-439d-bbd2-f01bedc38f4d tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9adc68e9-c335-41be-a7d5-199c96900325" returned: 0 in 6.959s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:07 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-588c974d-84e2-439d-bbd2-f01bedc38f4d tempest-GroupSnapshotsTest-1480305479 None] Image conversion details: src /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d, size 1024.00 MB, duration 6.96 sec, destination /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9adc68e9-c335-41be-a7d5-199c96900325 {{(pid=89096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 12:49:07 devstack cinder-volume[89096]: INFO cinder.image.image_utils [None req-588c974d-84e2-439d-bbd2-f01bedc38f4d tempest-GroupSnapshotsTest-1480305479 None] Converted 1024.00 MB image at 147.13 MB/s Aug 10 12:49:07 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-588c974d-84e2-439d-bbd2-f01bedc38f4d tempest-GroupSnapshotsTest-1480305479 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9adc68e9-c335-41be-a7d5-199c96900325 is being set with open permissions: ugo+rw: NotImplementedError Aug 10 12:49:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-588c974d-84e2-439d-bbd2-f01bedc38f4d tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9adc68e9-c335-41be-a7d5-199c96900325 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:07 devstack sudo[93443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5abc28c6-0f89-4d2c-9727-ceb961a57759 Aug 10 12:49:07 devstack sudo[93443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:07 devstack sudo[93445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9adc68e9-c335-41be-a7d5-199c96900325 Aug 10 12:49:08 devstack sudo[93445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:08 devstack sudo[93445]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-588c974d-84e2-439d-bbd2-f01bedc38f4d tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9adc68e9-c335-41be-a7d5-199c96900325" returned: 0 in 0.300s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:08 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-588c974d-84e2-439d-bbd2-f01bedc38f4d tempest-GroupSnapshotsTest-1480305479 None] Lock "cinder-quobyte-9adc68e9-c335-41be-a7d5-199c96900325" released by "_copy_volume_from_snapshot" :: held 8.579s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:49:08 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-588c974d-84e2-439d-bbd2-f01bedc38f4d tempest-GroupSnapshotsTest-1480305479 None] Lock "cinder-quobyte-b2ff1ea2-7c53-4af8-8315-78c1d1bb15e4-9adc68e9-c335-41be-a7d5-199c96900325" released by "_create_volume_from_snapshot" :: held 8.709s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:49:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-588c974d-84e2-439d-bbd2-f01bedc38f4d tempest-GroupSnapshotsTest-1480305479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.763s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:49:08 devstack sudo[93443]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-26d34bb3-2443-4c8c-94ab-323f64c6735e tempest-ServerRescueNegativeTestJSON-1882419362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5abc28c6-0f89-4d2c-9727-ceb961a57759" returned: 0 in 0.529s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:08 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-26d34bb3-2443-4c8c-94ab-323f64c6735e tempest-ServerRescueNegativeTestJSON-1882419362 None] Lock "cinder-quobyte-5abc28c6-0f89-4d2c-9727-ceb961a57759" released by "delete_volume" :: held 1.961s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:49:08 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-26d34bb3-2443-4c8c-94ab-323f64c6735e tempest-ServerRescueNegativeTestJSON-1882419362 None] Created reservations ['af90b9b7-4756-496c-aa93-cc4833ee241d', '28046a85-f6bf-4084-9be1-cc6fcf1d42d0', 'd86f5c61-9f9f-49d6-afc9-1b8f585a571d', '584e5328-076b-4a99-8dab-965a4e7616fd'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:49:08 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-588c974d-84e2-439d-bbd2-f01bedc38f4d tempest-GroupSnapshotsTest-1480305479 None] Create group from source-snapshot-6e605b68-9808-4719-93c2-70a5ad06ec7b completed successfully. Aug 10 12:49:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-26d34bb3-2443-4c8c-94ab-323f64c6735e tempest-ServerRescueNegativeTestJSON-1882419362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:49:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-26d34bb3-2443-4c8c-94ab-323f64c6735e tempest-ServerRescueNegativeTestJSON-1882419362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:49:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-26d34bb3-2443-4c8c-94ab-323f64c6735e tempest-ServerRescueNegativeTestJSON-1882419362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:49:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-26d34bb3-2443-4c8c-94ab-323f64c6735e tempest-ServerRescueNegativeTestJSON-1882419362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:49:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-26d34bb3-2443-4c8c-94ab-323f64c6735e tempest-ServerRescueNegativeTestJSON-1882419362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:49:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-26d34bb3-2443-4c8c-94ab-323f64c6735e tempest-ServerRescueNegativeTestJSON-1882419362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:08 devstack sudo[93452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:49:08 devstack sudo[93452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:08 devstack sudo[93452]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-26d34bb3-2443-4c8c-94ab-323f64c6735e tempest-ServerRescueNegativeTestJSON-1882419362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.394s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:09 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-26d34bb3-2443-4c8c-94ab-323f64c6735e tempest-ServerRescueNegativeTestJSON-1882419362 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:49:09 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-26d34bb3-2443-4c8c-94ab-323f64c6735e tempest-ServerRescueNegativeTestJSON-1882419362 None] Deleted volume successfully. Aug 10 12:49:09 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-26d34bb3-2443-4c8c-94ab-323f64c6735e tempest-ServerRescueNegativeTestJSON-1882419362 None] Lock "cinder-5abc28c6-0f89-4d2c-9727-ceb961a57759-delete_volume" released by "delete_volume" :: held 2.731s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:49:09 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2f5ef308-fd02-4fb9-907c-8c92aa8fe41c tempest-GroupSnapshotsTest-1480305479 None] Acquiring lock "cinder-quobyte-9adc68e9-c335-41be-a7d5-199c96900325" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:49:09 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2f5ef308-fd02-4fb9-907c-8c92aa8fe41c tempest-GroupSnapshotsTest-1480305479 None] Lock "cinder-quobyte-9adc68e9-c335-41be-a7d5-199c96900325" acquired by "delete_volume" :: waited 0.027s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:49:09 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86a6d09-da35-4e7b-ba2c-ceb2aa723be9]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:49:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2f5ef308-fd02-4fb9-907c-8c92aa8fe41c tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9adc68e9-c335-41be-a7d5-199c96900325 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:10 devstack sudo[93480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9adc68e9-c335-41be-a7d5-199c96900325 Aug 10 12:49:10 devstack sudo[93480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:10 devstack sudo[93480]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2f5ef308-fd02-4fb9-907c-8c92aa8fe41c tempest-GroupSnapshotsTest-1480305479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9adc68e9-c335-41be-a7d5-199c96900325" returned: 0 in 0.673s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2f5ef308-fd02-4fb9-907c-8c92aa8fe41c tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9adc68e9-c335-41be-a7d5-199c96900325 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:10 devstack sudo[93491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9adc68e9-c335-41be-a7d5-199c96900325 Aug 10 12:49:10 devstack sudo[93491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:11 devstack sudo[93491]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2f5ef308-fd02-4fb9-907c-8c92aa8fe41c tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9adc68e9-c335-41be-a7d5-199c96900325" returned: 0 in 0.580s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:11 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2f5ef308-fd02-4fb9-907c-8c92aa8fe41c tempest-GroupSnapshotsTest-1480305479 None] Lock "cinder-quobyte-9adc68e9-c335-41be-a7d5-199c96900325" released by "delete_volume" :: held 1.332s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:49:11 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-2f5ef308-fd02-4fb9-907c-8c92aa8fe41c tempest-GroupSnapshotsTest-1480305479 None] Created reservations ['b3be880b-3d88-49c1-85b2-20c399d06568'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:49:11 devstack cinder-volume[89096]: WARNING cinder.quota [None req-2f5ef308-fd02-4fb9-907c-8c92aa8fe41c tempest-GroupSnapshotsTest-1480305479 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1902235260 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1902235260, it is now deprecated. Please use the default quota class for default quota. Aug 10 12:49:11 devstack cinder-volume[89096]: WARNING cinder.quota [None req-2f5ef308-fd02-4fb9-907c-8c92aa8fe41c tempest-GroupSnapshotsTest-1480305479 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1902235260 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1902235260, it is now deprecated. Please use the default quota class for default quota. Aug 10 12:49:11 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-2f5ef308-fd02-4fb9-907c-8c92aa8fe41c tempest-GroupSnapshotsTest-1480305479 None] Created reservations ['914102da-f47d-4b93-85e6-6241e1bd9b0f', '5dd2054a-c03e-4d76-9c9a-5d6ff8ef0544', '69f0c419-4992-4802-b8f9-ae292a1ee7a6', 'bfbb6b15-4ba0-4016-a39e-f5501c14159b'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:49:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2f5ef308-fd02-4fb9-907c-8c92aa8fe41c tempest-GroupSnapshotsTest-1480305479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:49:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2f5ef308-fd02-4fb9-907c-8c92aa8fe41c tempest-GroupSnapshotsTest-1480305479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:49:11 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-2f5ef308-fd02-4fb9-907c-8c92aa8fe41c tempest-GroupSnapshotsTest-1480305479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:49:11 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-2f5ef308-fd02-4fb9-907c-8c92aa8fe41c tempest-GroupSnapshotsTest-1480305479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:49:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2f5ef308-fd02-4fb9-907c-8c92aa8fe41c tempest-GroupSnapshotsTest-1480305479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:49:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2f5ef308-fd02-4fb9-907c-8c92aa8fe41c tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:11 devstack sudo[93496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:49:11 devstack sudo[93496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:11 devstack sudo[93496]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2f5ef308-fd02-4fb9-907c-8c92aa8fe41c tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.320s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:11 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-2f5ef308-fd02-4fb9-907c-8c92aa8fe41c tempest-GroupSnapshotsTest-1480305479 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:49:11 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-2f5ef308-fd02-4fb9-907c-8c92aa8fe41c tempest-GroupSnapshotsTest-1480305479 None] Delete group completed successfully. Aug 10 12:49:12 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-d7c558cc-1189-4010-8bfe-695ecfab7299 tempest-GroupSnapshotsTest-1480305479 None] group_snapshot 6e605b68-9808-4719-93c2-70a5ad06ec7b: deleting Aug 10 12:49:12 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d7c558cc-1189-4010-8bfe-695ecfab7299 tempest-GroupSnapshotsTest-1480305479 None] group_snapshot 6e605b68-9808-4719-93c2-70a5ad06ec7b: deleting {{(pid=89096) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 10 12:49:12 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d7c558cc-1189-4010-8bfe-695ecfab7299 tempest-GroupSnapshotsTest-1480305479 None] Acquiring lock "cinder-quobyte-34018968-8c90-4b3a-a4b6-903b433b786d" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:49:12 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d7c558cc-1189-4010-8bfe-695ecfab7299 tempest-GroupSnapshotsTest-1480305479 None] Lock "cinder-quobyte-34018968-8c90-4b3a-a4b6-903b433b786d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:49:12 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d7c558cc-1189-4010-8bfe-695ecfab7299 tempest-GroupSnapshotsTest-1480305479 None] Acquiring lock "cinder-quobyte-b2ff1ea2-7c53-4af8-8315-78c1d1bb15e4" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:49:12 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d7c558cc-1189-4010-8bfe-695ecfab7299 tempest-GroupSnapshotsTest-1480305479 None] Lock "cinder-quobyte-b2ff1ea2-7c53-4af8-8315-78c1d1bb15e4" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:49:12 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-d7c558cc-1189-4010-8bfe-695ecfab7299 tempest-GroupSnapshotsTest-1480305479 None] Deleting offline snapshot b2ff1ea2-7c53-4af8-8315-78c1d1bb15e4 of volume 34018968-8c90-4b3a-a4b6-903b433b786d {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 12:49:12 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-d7c558cc-1189-4010-8bfe-695ecfab7299 tempest-GroupSnapshotsTest-1480305479 None] snapshot_file for this snap is: volume-34018968-8c90-4b3a-a4b6-903b433b786d.b2ff1ea2-7c53-4af8-8315-78c1d1bb15e4 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 12:49:12 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[3948b60c-c41f-43f2-ad9f-27880ab05a1d]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:49:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d7c558cc-1189-4010-8bfe-695ecfab7299 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d.b2ff1ea2-7c53-4af8-8315-78c1d1bb15e4 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:13 devstack sudo[93500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d.b2ff1ea2-7c53-4af8-8315-78c1d1bb15e4 Aug 10 12:49:13 devstack sudo[93500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:13 devstack sudo[93500]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d7c558cc-1189-4010-8bfe-695ecfab7299 tempest-GroupSnapshotsTest-1480305479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d.b2ff1ea2-7c53-4af8-8315-78c1d1bb15e4" returned: 0 in 0.550s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:13 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-d7c558cc-1189-4010-8bfe-695ecfab7299 tempest-GroupSnapshotsTest-1480305479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34018968-8c90-4b3a-a4b6-903b433b786d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 12:49:13 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f81f3cb-fde5-4f37-bdb9-6b275ac15876]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:49:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d7c558cc-1189-4010-8bfe-695ecfab7299 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:13 devstack sudo[93509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d Aug 10 12:49:13 devstack sudo[93509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:14 devstack sudo[93509]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d7c558cc-1189-4010-8bfe-695ecfab7299 tempest-GroupSnapshotsTest-1480305479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d" returned: 0 in 0.698s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d7c558cc-1189-4010-8bfe-695ecfab7299 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d.b2ff1ea2-7c53-4af8-8315-78c1d1bb15e4 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:14 devstack sudo[93529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d.b2ff1ea2-7c53-4af8-8315-78c1d1bb15e4 Aug 10 12:49:14 devstack sudo[93529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:14 devstack sudo[93529]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d7c558cc-1189-4010-8bfe-695ecfab7299 tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d.b2ff1ea2-7c53-4af8-8315-78c1d1bb15e4" returned: 0 in 0.473s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d7c558cc-1189-4010-8bfe-695ecfab7299 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d.b2ff1ea2-7c53-4af8-8315-78c1d1bb15e4 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:14 devstack sudo[93545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d.b2ff1ea2-7c53-4af8-8315-78c1d1bb15e4 Aug 10 12:49:14 devstack sudo[93545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:14 devstack sudo[93545]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d7c558cc-1189-4010-8bfe-695ecfab7299 tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d.b2ff1ea2-7c53-4af8-8315-78c1d1bb15e4" returned: 0 in 0.317s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:14 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d7c558cc-1189-4010-8bfe-695ecfab7299 tempest-GroupSnapshotsTest-1480305479 None] Lock "cinder-quobyte-b2ff1ea2-7c53-4af8-8315-78c1d1bb15e4" released by "_delete_snapshot" :: held 2.168s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:49:14 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d7c558cc-1189-4010-8bfe-695ecfab7299 tempest-GroupSnapshotsTest-1480305479 None] Lock "cinder-quobyte-34018968-8c90-4b3a-a4b6-903b433b786d" released by "delete_snapshot" :: held 2.201s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:49:15 devstack cinder-volume[89096]: WARNING cinder.quota [None req-d7c558cc-1189-4010-8bfe-695ecfab7299 tempest-GroupSnapshotsTest-1480305479 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1902235260 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1902235260, it is now deprecated. Please use the default quota class for default quota. Aug 10 12:49:15 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-d7c558cc-1189-4010-8bfe-695ecfab7299 tempest-GroupSnapshotsTest-1480305479 None] Created reservations ['a92062b6-acad-4c86-a056-2079f5a0c4dd', '82c6d218-d37d-466d-8ffb-4545e9081301', 'e224c5d8-886d-4f49-8a53-1c320898015f', '38d6c9a4-a208-4d33-80e8-48f889c08547'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:49:15 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-d7c558cc-1189-4010-8bfe-695ecfab7299 tempest-GroupSnapshotsTest-1480305479 None] group_snapshot 6e605b68-9808-4719-93c2-70a5ad06ec7b: deleted successfully Aug 10 12:49:16 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-76296370-4c33-4b9d-a24d-53dfd95246d8 tempest-GroupSnapshotsTest-1480305479 None] Acquiring lock "cinder-quobyte-34018968-8c90-4b3a-a4b6-903b433b786d" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:49:16 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-76296370-4c33-4b9d-a24d-53dfd95246d8 tempest-GroupSnapshotsTest-1480305479 None] Lock "cinder-quobyte-34018968-8c90-4b3a-a4b6-903b433b786d" acquired by "delete_volume" :: waited 0.019s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:49:16 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[1317cb35-247c-4875-9588-91f70153ed63]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:49:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-76296370-4c33-4b9d-a24d-53dfd95246d8 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:16 devstack sudo[93552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d Aug 10 12:49:16 devstack sudo[93552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:16 devstack sudo[93552]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-76296370-4c33-4b9d-a24d-53dfd95246d8 tempest-GroupSnapshotsTest-1480305479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d" returned: 0 in 0.411s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-76296370-4c33-4b9d-a24d-53dfd95246d8 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:16 devstack sudo[93558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d Aug 10 12:49:16 devstack sudo[93558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:17 devstack sudo[93558]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-76296370-4c33-4b9d-a24d-53dfd95246d8 tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-34018968-8c90-4b3a-a4b6-903b433b786d" returned: 0 in 0.297s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:17 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-76296370-4c33-4b9d-a24d-53dfd95246d8 tempest-GroupSnapshotsTest-1480305479 None] Lock "cinder-quobyte-34018968-8c90-4b3a-a4b6-903b433b786d" released by "delete_volume" :: held 0.798s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:49:17 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-76296370-4c33-4b9d-a24d-53dfd95246d8 tempest-GroupSnapshotsTest-1480305479 None] Created reservations ['df4faaa1-5746-4112-ba77-256fbe0d76d5'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:49:17 devstack cinder-volume[89096]: WARNING cinder.db.api [None req-76296370-4c33-4b9d-a24d-53dfd95246d8 tempest-GroupSnapshotsTest-1480305479 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1902235260'] Aug 10 12:49:17 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-76296370-4c33-4b9d-a24d-53dfd95246d8 tempest-GroupSnapshotsTest-1480305479 None] Created reservations ['35992eed-a5f1-4219-928d-d82c2342a56b', '17b4e212-7da3-48cb-9fe8-90b57ebf51a4', '807d1344-51f4-4032-bd9c-afca8df67dc9', '03064028-a150-400f-ad6e-42fdaec98c4e'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:49:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-76296370-4c33-4b9d-a24d-53dfd95246d8 tempest-GroupSnapshotsTest-1480305479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:49:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-76296370-4c33-4b9d-a24d-53dfd95246d8 tempest-GroupSnapshotsTest-1480305479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:49:17 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-76296370-4c33-4b9d-a24d-53dfd95246d8 tempest-GroupSnapshotsTest-1480305479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:49:17 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-76296370-4c33-4b9d-a24d-53dfd95246d8 tempest-GroupSnapshotsTest-1480305479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:49:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-76296370-4c33-4b9d-a24d-53dfd95246d8 tempest-GroupSnapshotsTest-1480305479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:49:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-76296370-4c33-4b9d-a24d-53dfd95246d8 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:17 devstack sudo[93561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:49:17 devstack sudo[93561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:17 devstack sudo[93561]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-76296370-4c33-4b9d-a24d-53dfd95246d8 tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.347s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:17 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-76296370-4c33-4b9d-a24d-53dfd95246d8 tempest-GroupSnapshotsTest-1480305479 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:49:17 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-76296370-4c33-4b9d-a24d-53dfd95246d8 tempest-GroupSnapshotsTest-1480305479 None] Delete group completed successfully. Aug 10 12:49:17 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-25a7066f-93a0-48d2-90c2-bfa2e365ed00 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:49:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-25a7066f-93a0-48d2-90c2-bfa2e365ed00 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Flow 'volume_create_manager' (c500348f-05da-434f-b7f0-3c00029bc357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:49:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-25a7066f-93a0-48d2-90c2-bfa2e365ed00 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1615894b-49ad-49c4-9525-1673179af024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:49:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-25a7066f-93a0-48d2-90c2-bfa2e365ed00 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1615894b-49ad-49c4-9525-1673179af024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:49:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-557842215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cc1a07c-f7e0-4a61-b9ee-4dbdfc05644f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78227667eb514710b36d4839e6fa0158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:49:18Z,use_quota=True,user_id='0b3a95af996043b7a34a440b139690ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef985e67-663c-4c60-b67a-fcdf0c90c604),volume_type_id=ef985e67-663c-4c60-b67a-fcdf0c90c604)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:49:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-25a7066f-93a0-48d2-90c2-bfa2e365ed00 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5336bca0-8345-48fc-bb81-4e4f9b3e19c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:49:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-25a7066f-93a0-48d2-90c2-bfa2e365ed00 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5336bca0-8345-48fc-bb81-4e4f9b3e19c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:49:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-25a7066f-93a0-48d2-90c2-bfa2e365ed00 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1d28a25-76de-448d-a6ce-5c004e5456bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:49:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-25a7066f-93a0-48d2-90c2-bfa2e365ed00 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1d28a25-76de-448d-a6ce-5c004e5456bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cc1a07c-f7e0-4a61-b9ee-4dbdfc05644f', 'volume_name': 'volume-9cc1a07c-f7e0-4a61-b9ee-4dbdfc05644f', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:49:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-25a7066f-93a0-48d2-90c2-bfa2e365ed00 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36b864f7-3eb7-45f7-b889-291e930a2198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:49:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-25a7066f-93a0-48d2-90c2-bfa2e365ed00 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36b864f7-3eb7-45f7-b889-291e930a2198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:49:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-25a7066f-93a0-48d2-90c2-bfa2e365ed00 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25864cfc-d611-499e-b86d-36b7ab413cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:49:18 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-25a7066f-93a0-48d2-90c2-bfa2e365ed00 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Volume 9cc1a07c-f7e0-4a61-b9ee-4dbdfc05644f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cc1a07c-f7e0-4a61-b9ee-4dbdfc05644f', 'volume_size': 1} Aug 10 12:49:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-25a7066f-93a0-48d2-90c2-bfa2e365ed00 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:49:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-25a7066f-93a0-48d2-90c2-bfa2e365ed00 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:49:18 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-25a7066f-93a0-48d2-90c2-bfa2e365ed00 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:49:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-557842215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cc1a07c-f7e0-4a61-b9ee-4dbdfc05644f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78227667eb514710b36d4839e6fa0158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:49:18Z,use_quota=True,user_id='0b3a95af996043b7a34a440b139690ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef985e67-663c-4c60-b67a-fcdf0c90c604),volume_type_id=ef985e67-663c-4c60-b67a-fcdf0c90c604)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:49:18 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-25a7066f-93a0-48d2-90c2-bfa2e365ed00 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Creating volume 9cc1a07c-f7e0-4a61-b9ee-4dbdfc05644f {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:49:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-25a7066f-93a0-48d2-90c2-bfa2e365ed00 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:49:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-25a7066f-93a0-48d2-90c2-bfa2e365ed00 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:49:18 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-25a7066f-93a0-48d2-90c2-bfa2e365ed00 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:49:18 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-25a7066f-93a0-48d2-90c2-bfa2e365ed00 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:49:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-25a7066f-93a0-48d2-90c2-bfa2e365ed00 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:49:18 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-25a7066f-93a0-48d2-90c2-bfa2e365ed00 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:49:18 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-25a7066f-93a0-48d2-90c2-bfa2e365ed00 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:49:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-25a7066f-93a0-48d2-90c2-bfa2e365ed00 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9cc1a07c-f7e0-4a61-b9ee-4dbdfc05644f 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:18 devstack sudo[93566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9cc1a07c-f7e0-4a61-b9ee-4dbdfc05644f 1073741824 Aug 10 12:49:18 devstack sudo[93566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:18 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-7ca8c598-0d34-4e8b-b73c-c2def2acf631 tempest-GroupSnapshotsTest-1480305479 None] Group tempest-GroupSnapshotsTest-Group-1434487620: creating Aug 10 12:49:18 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-7ca8c598-0d34-4e8b-b73c-c2def2acf631 tempest-GroupSnapshotsTest-1480305479 None] Group tempest-GroupSnapshotsTest-Group-1434487620: created successfully Aug 10 12:49:18 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-7ca8c598-0d34-4e8b-b73c-c2def2acf631 tempest-GroupSnapshotsTest-1480305479 None] Create group completed successfully. Aug 10 12:49:18 devstack sudo[93566]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-25a7066f-93a0-48d2-90c2-bfa2e365ed00 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9cc1a07c-f7e0-4a61-b9ee-4dbdfc05644f 1073741824" returned: 0 in 0.465s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-25a7066f-93a0-48d2-90c2-bfa2e365ed00 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9cc1a07c-f7e0-4a61-b9ee-4dbdfc05644f {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:18 devstack sudo[93572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9cc1a07c-f7e0-4a61-b9ee-4dbdfc05644f Aug 10 12:49:18 devstack sudo[93572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:18 devstack sudo[93572]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-25a7066f-93a0-48d2-90c2-bfa2e365ed00 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9cc1a07c-f7e0-4a61-b9ee-4dbdfc05644f" returned: 0 in 0.256s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:18 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-25a7066f-93a0-48d2-90c2-bfa2e365ed00 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:49:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-25a7066f-93a0-48d2-90c2-bfa2e365ed00 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:49:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-25a7066f-93a0-48d2-90c2-bfa2e365ed00 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25864cfc-d611-499e-b86d-36b7ab413cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cc1a07c-f7e0-4a61-b9ee-4dbdfc05644f', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:49:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-25a7066f-93a0-48d2-90c2-bfa2e365ed00 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06d4ec81-e9ab-4bdb-8bc1-5139c7853bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:49:18 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-25a7066f-93a0-48d2-90c2-bfa2e365ed00 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Volume volume-9cc1a07c-f7e0-4a61-b9ee-4dbdfc05644f (9cc1a07c-f7e0-4a61-b9ee-4dbdfc05644f): created successfully Aug 10 12:49:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-25a7066f-93a0-48d2-90c2-bfa2e365ed00 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06d4ec81-e9ab-4bdb-8bc1-5139c7853bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:49:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-25a7066f-93a0-48d2-90c2-bfa2e365ed00 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Flow 'volume_create_manager' (c500348f-05da-434f-b7f0-3c00029bc357) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:49:18 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-25a7066f-93a0-48d2-90c2-bfa2e365ed00 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Created volume successfully. Aug 10 12:49:19 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-1491a4fb-8714-4a67-ab31-25bbbade484f tempest-GroupSnapshotsTest-1480305479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:49:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1491a4fb-8714-4a67-ab31-25bbbade484f tempest-GroupSnapshotsTest-1480305479 None] Flow 'volume_create_manager' (6762304e-e6fd-4fcd-983f-78a76ef0c217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:49:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1491a4fb-8714-4a67-ab31-25bbbade484f tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (032f145f-2d2c-4ffc-936d-3fba89d4e869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:49:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1491a4fb-8714-4a67-ab31-25bbbade484f tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (032f145f-2d2c-4ffc-936d-3fba89d4e869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1852355042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e010b0d8-3ff9-49b9-9196-8f56fe749128,host='devstack@QuobyteHD#QuobyteHD',id=5b5e7604-c494-40a8-973b-504eb2137930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8989f0078d4821bad814877f45db3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:49:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:49:20Z,use_quota=True,user_id='613ed7ca0d874ceb8c808624cfbb57b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7aa5c57e-0c3e-451c-a08b-c9d7df8ae9ed),volume_type_id=7aa5c57e-0c3e-451c-a08b-c9d7df8ae9ed)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:49:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1491a4fb-8714-4a67-ab31-25bbbade484f tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (957c3f7a-0430-4d74-ae43-6306ef7ca588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:49:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1491a4fb-8714-4a67-ab31-25bbbade484f tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (957c3f7a-0430-4d74-ae43-6306ef7ca588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:49:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1491a4fb-8714-4a67-ab31-25bbbade484f tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e774053b-406a-4598-82cb-774dacb5aae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:49:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1491a4fb-8714-4a67-ab31-25bbbade484f tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e774053b-406a-4598-82cb-774dacb5aae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b5e7604-c494-40a8-973b-504eb2137930', 'volume_name': 'volume-5b5e7604-c494-40a8-973b-504eb2137930', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:49:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1491a4fb-8714-4a67-ab31-25bbbade484f tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d12701a4-34fe-46db-a380-3789196c6765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:49:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1491a4fb-8714-4a67-ab31-25bbbade484f tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d12701a4-34fe-46db-a380-3789196c6765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:49:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1491a4fb-8714-4a67-ab31-25bbbade484f tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a92ed688-caad-4331-a223-07311181719c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:49:20 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-1491a4fb-8714-4a67-ab31-25bbbade484f tempest-GroupSnapshotsTest-1480305479 None] Volume 5b5e7604-c494-40a8-973b-504eb2137930: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b5e7604-c494-40a8-973b-504eb2137930', 'volume_size': 1} Aug 10 12:49:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1491a4fb-8714-4a67-ab31-25bbbade484f tempest-GroupSnapshotsTest-1480305479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:49:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1491a4fb-8714-4a67-ab31-25bbbade484f tempest-GroupSnapshotsTest-1480305479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:49:20 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1491a4fb-8714-4a67-ab31-25bbbade484f tempest-GroupSnapshotsTest-1480305479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e010b0d8-3ff9-49b9-9196-8f56fe749128,created_at=2026-08-10T10:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1852355042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e010b0d8-3ff9-49b9-9196-8f56fe749128,host='devstack@QuobyteHD#QuobyteHD',id=5b5e7604-c494-40a8-973b-504eb2137930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8989f0078d4821bad814877f45db3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:49:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:49:20Z,use_quota=True,user_id='613ed7ca0d874ceb8c808624cfbb57b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7aa5c57e-0c3e-451c-a08b-c9d7df8ae9ed),volume_type_id=7aa5c57e-0c3e-451c-a08b-c9d7df8ae9ed)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:49:20 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-1491a4fb-8714-4a67-ab31-25bbbade484f tempest-GroupSnapshotsTest-1480305479 None] Creating volume 5b5e7604-c494-40a8-973b-504eb2137930 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:49:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1491a4fb-8714-4a67-ab31-25bbbade484f tempest-GroupSnapshotsTest-1480305479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:49:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1491a4fb-8714-4a67-ab31-25bbbade484f tempest-GroupSnapshotsTest-1480305479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:49:20 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1491a4fb-8714-4a67-ab31-25bbbade484f tempest-GroupSnapshotsTest-1480305479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:49:20 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1491a4fb-8714-4a67-ab31-25bbbade484f tempest-GroupSnapshotsTest-1480305479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:49:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1491a4fb-8714-4a67-ab31-25bbbade484f tempest-GroupSnapshotsTest-1480305479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:49:20 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1491a4fb-8714-4a67-ab31-25bbbade484f tempest-GroupSnapshotsTest-1480305479 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:49:20 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-1491a4fb-8714-4a67-ab31-25bbbade484f tempest-GroupSnapshotsTest-1480305479 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:49:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1491a4fb-8714-4a67-ab31-25bbbade484f tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:20 devstack sudo[93609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930 1073741824 Aug 10 12:49:20 devstack sudo[93609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-87044206-73b6-45e8-8bab-03a7bca45530 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:49:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-87044206-73b6-45e8-8bab-03a7bca45530 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:49:20 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-87044206-73b6-45e8-8bab-03a7bca45530 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:49:20 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-87044206-73b6-45e8-8bab-03a7bca45530 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:49:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-87044206-73b6-45e8-8bab-03a7bca45530 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:49:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-87044206-73b6-45e8-8bab-03a7bca45530 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:20 devstack sudo[93618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:49:20 devstack sudo[93618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:20 devstack sudo[93609]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1491a4fb-8714-4a67-ab31-25bbbade484f tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930 1073741824" returned: 0 in 0.593s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1491a4fb-8714-4a67-ab31-25bbbade484f tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:20 devstack sudo[93620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930 Aug 10 12:49:20 devstack sudo[93620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:20 devstack sudo[93618]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-87044206-73b6-45e8-8bab-03a7bca45530 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.259s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:20 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-87044206-73b6-45e8-8bab-03a7bca45530 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:49:20 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-87044206-73b6-45e8-8bab-03a7bca45530 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Retype volume completed successfully. Aug 10 12:49:20 devstack sudo[93620]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1491a4fb-8714-4a67-ab31-25bbbade484f tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930" returned: 0 in 0.276s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:20 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1491a4fb-8714-4a67-ab31-25bbbade484f tempest-GroupSnapshotsTest-1480305479 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:49:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1491a4fb-8714-4a67-ab31-25bbbade484f tempest-GroupSnapshotsTest-1480305479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:49:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1491a4fb-8714-4a67-ab31-25bbbade484f tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a92ed688-caad-4331-a223-07311181719c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b5e7604-c494-40a8-973b-504eb2137930', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:49:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1491a4fb-8714-4a67-ab31-25bbbade484f tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0306be2-4a49-4239-9524-2b649c184510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:49:20 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-1491a4fb-8714-4a67-ab31-25bbbade484f tempest-GroupSnapshotsTest-1480305479 None] Volume volume-5b5e7604-c494-40a8-973b-504eb2137930 (5b5e7604-c494-40a8-973b-504eb2137930): created successfully Aug 10 12:49:21 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1491a4fb-8714-4a67-ab31-25bbbade484f tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0306be2-4a49-4239-9524-2b649c184510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:49:21 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1491a4fb-8714-4a67-ab31-25bbbade484f tempest-GroupSnapshotsTest-1480305479 None] Flow 'volume_create_manager' (6762304e-e6fd-4fcd-983f-78a76ef0c217) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:49:21 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-1491a4fb-8714-4a67-ab31-25bbbade484f tempest-GroupSnapshotsTest-1480305479 None] Created volume successfully. Aug 10 12:49:21 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e4764da-de3a-41cd-9c4c-2bae77c0b99f tempest-GroupSnapshotsTest-1480305479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:49:21 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7e4764da-de3a-41cd-9c4c-2bae77c0b99f tempest-GroupSnapshotsTest-1480305479 None] Flow 'volume_create_manager' (a60eea8b-0e18-45a3-a9be-909088612c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:49:21 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7e4764da-de3a-41cd-9c4c-2bae77c0b99f tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1d89ac4-2cd2-44e6-b21a-c9d27b46bd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:49:21 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7e4764da-de3a-41cd-9c4c-2bae77c0b99f tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1d89ac4-2cd2-44e6-b21a-c9d27b46bd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1787702875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e010b0d8-3ff9-49b9-9196-8f56fe749128,host='devstack@QuobyteHD#QuobyteHD',id=9723242f-fcdd-431b-9701-38e4c9efea4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8989f0078d4821bad814877f45db3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:49:22Z,use_quota=True,user_id='613ed7ca0d874ceb8c808624cfbb57b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7aa5c57e-0c3e-451c-a08b-c9d7df8ae9ed),volume_type_id=7aa5c57e-0c3e-451c-a08b-c9d7df8ae9ed)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:49:21 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7e4764da-de3a-41cd-9c4c-2bae77c0b99f tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c7fa90-1e3c-4f28-918a-c86c1a210955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:49:21 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7e4764da-de3a-41cd-9c4c-2bae77c0b99f tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c7fa90-1e3c-4f28-918a-c86c1a210955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:49:21 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7e4764da-de3a-41cd-9c4c-2bae77c0b99f tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (340a6ea1-2b02-4ab2-bca5-b2cb3fdbdf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:49:21 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7e4764da-de3a-41cd-9c4c-2bae77c0b99f tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (340a6ea1-2b02-4ab2-bca5-b2cb3fdbdf4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9723242f-fcdd-431b-9701-38e4c9efea4d', 'volume_name': 'volume-9723242f-fcdd-431b-9701-38e4c9efea4d', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:49:21 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7e4764da-de3a-41cd-9c4c-2bae77c0b99f tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c4e6d3d-6b1d-4bb3-add8-af7e0723cdc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:49:21 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7e4764da-de3a-41cd-9c4c-2bae77c0b99f tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c4e6d3d-6b1d-4bb3-add8-af7e0723cdc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:49:21 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7e4764da-de3a-41cd-9c4c-2bae77c0b99f tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f2f827c-b8ca-4e8d-8661-6fbd83cd8dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:49:21 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-7e4764da-de3a-41cd-9c4c-2bae77c0b99f tempest-GroupSnapshotsTest-1480305479 None] Volume 9723242f-fcdd-431b-9701-38e4c9efea4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9723242f-fcdd-431b-9701-38e4c9efea4d', 'volume_size': 1} Aug 10 12:49:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7e4764da-de3a-41cd-9c4c-2bae77c0b99f tempest-GroupSnapshotsTest-1480305479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:49:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7e4764da-de3a-41cd-9c4c-2bae77c0b99f tempest-GroupSnapshotsTest-1480305479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:49:21 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-7e4764da-de3a-41cd-9c4c-2bae77c0b99f tempest-GroupSnapshotsTest-1480305479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e010b0d8-3ff9-49b9-9196-8f56fe749128,created_at=2026-08-10T10:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1787702875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e010b0d8-3ff9-49b9-9196-8f56fe749128,host='devstack@QuobyteHD#QuobyteHD',id=9723242f-fcdd-431b-9701-38e4c9efea4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8989f0078d4821bad814877f45db3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:49:22Z,use_quota=True,user_id='613ed7ca0d874ceb8c808624cfbb57b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7aa5c57e-0c3e-451c-a08b-c9d7df8ae9ed),volume_type_id=7aa5c57e-0c3e-451c-a08b-c9d7df8ae9ed)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:49:21 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-7e4764da-de3a-41cd-9c4c-2bae77c0b99f tempest-GroupSnapshotsTest-1480305479 None] Creating volume 9723242f-fcdd-431b-9701-38e4c9efea4d {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:49:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7e4764da-de3a-41cd-9c4c-2bae77c0b99f tempest-GroupSnapshotsTest-1480305479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:49:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7e4764da-de3a-41cd-9c4c-2bae77c0b99f tempest-GroupSnapshotsTest-1480305479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:49:21 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-7e4764da-de3a-41cd-9c4c-2bae77c0b99f tempest-GroupSnapshotsTest-1480305479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:49:21 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-7e4764da-de3a-41cd-9c4c-2bae77c0b99f tempest-GroupSnapshotsTest-1480305479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:49:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7e4764da-de3a-41cd-9c4c-2bae77c0b99f tempest-GroupSnapshotsTest-1480305479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:49:21 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-7e4764da-de3a-41cd-9c4c-2bae77c0b99f tempest-GroupSnapshotsTest-1480305479 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:49:21 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-7e4764da-de3a-41cd-9c4c-2bae77c0b99f tempest-GroupSnapshotsTest-1480305479 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:49:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7e4764da-de3a-41cd-9c4c-2bae77c0b99f tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:21 devstack sudo[93625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d 1073741824 Aug 10 12:49:21 devstack sudo[93625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:21 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8c128286-c09c-481d-8dbe-a4e1d9501799 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Acquiring lock "cinder-9cc1a07c-f7e0-4a61-b9ee-4dbdfc05644f-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:49:21 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8c128286-c09c-481d-8dbe-a4e1d9501799 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Lock "cinder-9cc1a07c-f7e0-4a61-b9ee-4dbdfc05644f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:49:21 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8c128286-c09c-481d-8dbe-a4e1d9501799 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Acquiring lock "cinder-quobyte-9cc1a07c-f7e0-4a61-b9ee-4dbdfc05644f" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:49:22 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8c128286-c09c-481d-8dbe-a4e1d9501799 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Lock "cinder-quobyte-9cc1a07c-f7e0-4a61-b9ee-4dbdfc05644f" acquired by "delete_volume" :: waited 0.018s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:49:22 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[20077379-c463-45ce-bc7d-45f54fdf750c]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:49:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c128286-c09c-481d-8dbe-a4e1d9501799 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9cc1a07c-f7e0-4a61-b9ee-4dbdfc05644f {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:22 devstack sudo[93627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9cc1a07c-f7e0-4a61-b9ee-4dbdfc05644f Aug 10 12:49:22 devstack sudo[93627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:22 devstack sudo[93625]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7e4764da-de3a-41cd-9c4c-2bae77c0b99f tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d 1073741824" returned: 0 in 0.536s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7e4764da-de3a-41cd-9c4c-2bae77c0b99f tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:22 devstack sudo[93634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d Aug 10 12:49:22 devstack sudo[93634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:22 devstack sudo[93627]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c128286-c09c-481d-8dbe-a4e1d9501799 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9cc1a07c-f7e0-4a61-b9ee-4dbdfc05644f" returned: 0 in 0.419s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c128286-c09c-481d-8dbe-a4e1d9501799 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9cc1a07c-f7e0-4a61-b9ee-4dbdfc05644f {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:22 devstack sudo[93637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9cc1a07c-f7e0-4a61-b9ee-4dbdfc05644f Aug 10 12:49:22 devstack sudo[93637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:22 devstack sudo[93634]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7e4764da-de3a-41cd-9c4c-2bae77c0b99f tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d" returned: 0 in 0.282s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:22 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-7e4764da-de3a-41cd-9c4c-2bae77c0b99f tempest-GroupSnapshotsTest-1480305479 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:49:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7e4764da-de3a-41cd-9c4c-2bae77c0b99f tempest-GroupSnapshotsTest-1480305479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:49:22 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7e4764da-de3a-41cd-9c4c-2bae77c0b99f tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f2f827c-b8ca-4e8d-8661-6fbd83cd8dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9723242f-fcdd-431b-9701-38e4c9efea4d', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:49:22 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7e4764da-de3a-41cd-9c4c-2bae77c0b99f tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (229bbf1e-b86f-49ff-a7a9-a22b2e98f4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:49:22 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-7e4764da-de3a-41cd-9c4c-2bae77c0b99f tempest-GroupSnapshotsTest-1480305479 None] Volume volume-9723242f-fcdd-431b-9701-38e4c9efea4d (9723242f-fcdd-431b-9701-38e4c9efea4d): created successfully Aug 10 12:49:22 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7e4764da-de3a-41cd-9c4c-2bae77c0b99f tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (229bbf1e-b86f-49ff-a7a9-a22b2e98f4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:49:22 devstack sudo[93637]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:22 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7e4764da-de3a-41cd-9c4c-2bae77c0b99f tempest-GroupSnapshotsTest-1480305479 None] Flow 'volume_create_manager' (a60eea8b-0e18-45a3-a9be-909088612c84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:49:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c128286-c09c-481d-8dbe-a4e1d9501799 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9cc1a07c-f7e0-4a61-b9ee-4dbdfc05644f" returned: 0 in 0.261s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:22 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-7e4764da-de3a-41cd-9c4c-2bae77c0b99f tempest-GroupSnapshotsTest-1480305479 None] Created volume successfully. Aug 10 12:49:22 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8c128286-c09c-481d-8dbe-a4e1d9501799 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Lock "cinder-quobyte-9cc1a07c-f7e0-4a61-b9ee-4dbdfc05644f" released by "delete_volume" :: held 0.749s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:49:22 devstack cinder-volume[89096]: WARNING cinder.quota [None req-8c128286-c09c-481d-8dbe-a4e1d9501799 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 10 12:49:22 devstack cinder-volume[89096]: WARNING cinder.quota [None req-8c128286-c09c-481d-8dbe-a4e1d9501799 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 10 12:49:22 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-8c128286-c09c-481d-8dbe-a4e1d9501799 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Created reservations ['b6c57f97-b31d-49e4-9e67-812262ccd598', '06872d46-e300-46ff-b0ed-9db2efd2978f', 'c48a8d89-54c8-4b8c-a517-67b8eb1e2b87', '6ee3a52d-d367-4286-a3b4-20d3b6bda8de'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:49:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8c128286-c09c-481d-8dbe-a4e1d9501799 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:49:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8c128286-c09c-481d-8dbe-a4e1d9501799 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:49:22 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8c128286-c09c-481d-8dbe-a4e1d9501799 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:49:22 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8c128286-c09c-481d-8dbe-a4e1d9501799 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:49:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8c128286-c09c-481d-8dbe-a4e1d9501799 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:49:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c128286-c09c-481d-8dbe-a4e1d9501799 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:22 devstack sudo[93641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:49:22 devstack sudo[93641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:23 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-dfd86e28-602b-4e39-890e-675024d7fdc7 tempest-GroupSnapshotsTest-1480305479 None] Update group completed successfully. Aug 10 12:49:23 devstack sudo[93641]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c128286-c09c-481d-8dbe-a4e1d9501799 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.315s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:23 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-8c128286-c09c-481d-8dbe-a4e1d9501799 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:49:23 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-8c128286-c09c-481d-8dbe-a4e1d9501799 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Deleted volume successfully. Aug 10 12:49:23 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8c128286-c09c-481d-8dbe-a4e1d9501799 tempest-VolumeRetypeWithoutMigrationTest-864325312 None] Lock "cinder-9cc1a07c-f7e0-4a61-b9ee-4dbdfc05644f-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:49:24 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-18bd142f-9ea7-4189-8fc4-d9067d8244c1 tempest-GroupSnapshotsTest-1480305479 None] Update group completed successfully. Aug 10 12:49:25 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-7ff260d8-f16a-41b6-a28f-9e3d102e6bf3 tempest-GroupSnapshotsTest-1480305479 None] Update group completed successfully. Aug 10 12:49:26 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-5ed3eba0-52e5-4517-b088-366a2b268841 tempest-GroupSnapshotsTest-1480305479 None] Update group completed successfully. Aug 10 12:49:28 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-c603b715-0b36-4da9-89fd-6fe3e7f4ab93 tempest-GroupSnapshotsTest-1480305479 None] GroupSnapshot 7e219dc0-ca7f-427a-910d-e1d4d3ca4527: creating. Aug 10 12:49:28 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c603b715-0b36-4da9-89fd-6fe3e7f4ab93 tempest-GroupSnapshotsTest-1480305479 None] Group snapshot 7e219dc0-ca7f-427a-910d-e1d4d3ca4527: creating. {{(pid=89096) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 10 12:49:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c603b715-0b36-4da9-89fd-6fe3e7f4ab93 tempest-GroupSnapshotsTest-1480305479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:49:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c603b715-0b36-4da9-89fd-6fe3e7f4ab93 tempest-GroupSnapshotsTest-1480305479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:49:28 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-c603b715-0b36-4da9-89fd-6fe3e7f4ab93 tempest-GroupSnapshotsTest-1480305479 None] Creating offline snapshot 427fa88f-8e6c-49a7-a2d1-08b77674c0bf of volume 5b5e7604-c494-40a8-973b-504eb2137930 {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 12:49:28 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10d0fd8-5acf-4f95-8c61-cf638ed82865]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:49:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c603b715-0b36-4da9-89fd-6fe3e7f4ab93 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:28 devstack sudo[93645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930 Aug 10 12:49:28 devstack sudo[93645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:28 devstack sudo[93645]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c603b715-0b36-4da9-89fd-6fe3e7f4ab93 tempest-GroupSnapshotsTest-1480305479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930" returned: 0 in 0.415s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c603b715-0b36-4da9-89fd-6fe3e7f4ab93 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930.427fa88f-8e6c-49a7-a2d1-08b77674c0bf 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:28 devstack sudo[93650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930.427fa88f-8e6c-49a7-a2d1-08b77674c0bf 1G Aug 10 12:49:28 devstack sudo[93650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:29 devstack sudo[93650]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c603b715-0b36-4da9-89fd-6fe3e7f4ab93 tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930.427fa88f-8e6c-49a7-a2d1-08b77674c0bf 1G" returned: 0 in 0.542s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c603b715-0b36-4da9-89fd-6fe3e7f4ab93 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b5e7604-c494-40a8-973b-504eb2137930 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930.427fa88f-8e6c-49a7-a2d1-08b77674c0bf {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:29 devstack sudo[93656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b5e7604-c494-40a8-973b-504eb2137930 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930.427fa88f-8e6c-49a7-a2d1-08b77674c0bf Aug 10 12:49:29 devstack sudo[93656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:29 devstack sudo[93656]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c603b715-0b36-4da9-89fd-6fe3e7f4ab93 tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b5e7604-c494-40a8-973b-504eb2137930 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930.427fa88f-8e6c-49a7-a2d1-08b77674c0bf" returned: 0 in 0.352s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:29 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-c603b715-0b36-4da9-89fd-6fe3e7f4ab93 tempest-GroupSnapshotsTest-1480305479 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930.427fa88f-8e6c-49a7-a2d1-08b77674c0bf is being set with open permissions: ugo+rw: NotImplementedError Aug 10 12:49:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c603b715-0b36-4da9-89fd-6fe3e7f4ab93 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930.427fa88f-8e6c-49a7-a2d1-08b77674c0bf {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:29 devstack sudo[93661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930.427fa88f-8e6c-49a7-a2d1-08b77674c0bf Aug 10 12:49:29 devstack sudo[93661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:30 devstack sudo[93661]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c603b715-0b36-4da9-89fd-6fe3e7f4ab93 tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930.427fa88f-8e6c-49a7-a2d1-08b77674c0bf" returned: 0 in 0.293s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c603b715-0b36-4da9-89fd-6fe3e7f4ab93 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:30 devstack sudo[93664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930.info Aug 10 12:49:30 devstack sudo[93664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:30 devstack sudo[93664]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c603b715-0b36-4da9-89fd-6fe3e7f4ab93 tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930.info" returned: 0 in 0.353s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:30 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-c603b715-0b36-4da9-89fd-6fe3e7f4ab93 tempest-GroupSnapshotsTest-1480305479 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930.info is being set with open permissions: ugo+rw: NotImplementedError Aug 10 12:49:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c603b715-0b36-4da9-89fd-6fe3e7f4ab93 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:30 devstack sudo[93667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930.info Aug 10 12:49:30 devstack sudo[93667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:30 devstack sudo[93667]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c603b715-0b36-4da9-89fd-6fe3e7f4ab93 tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930.info" returned: 0 in 0.281s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c603b715-0b36-4da9-89fd-6fe3e7f4ab93 tempest-GroupSnapshotsTest-1480305479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.345s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:49:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c603b715-0b36-4da9-89fd-6fe3e7f4ab93 tempest-GroupSnapshotsTest-1480305479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:49:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c603b715-0b36-4da9-89fd-6fe3e7f4ab93 tempest-GroupSnapshotsTest-1480305479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:49:30 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-c603b715-0b36-4da9-89fd-6fe3e7f4ab93 tempest-GroupSnapshotsTest-1480305479 None] Creating offline snapshot ff3f31b7-2dd8-4f19-9eb3-8749c879b66c of volume 9723242f-fcdd-431b-9701-38e4c9efea4d {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 12:49:30 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[4602cc79-333b-434a-bcdc-cef888102c4b]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:49:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c603b715-0b36-4da9-89fd-6fe3e7f4ab93 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:31 devstack sudo[93671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d Aug 10 12:49:31 devstack sudo[93671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:31 devstack sudo[93671]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c603b715-0b36-4da9-89fd-6fe3e7f4ab93 tempest-GroupSnapshotsTest-1480305479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d" returned: 0 in 0.416s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c603b715-0b36-4da9-89fd-6fe3e7f4ab93 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d.ff3f31b7-2dd8-4f19-9eb3-8749c879b66c 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:31 devstack sudo[93676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d.ff3f31b7-2dd8-4f19-9eb3-8749c879b66c 1G Aug 10 12:49:31 devstack sudo[93676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:31 devstack sudo[93676]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c603b715-0b36-4da9-89fd-6fe3e7f4ab93 tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d.ff3f31b7-2dd8-4f19-9eb3-8749c879b66c 1G" returned: 0 in 0.510s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c603b715-0b36-4da9-89fd-6fe3e7f4ab93 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9723242f-fcdd-431b-9701-38e4c9efea4d -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d.ff3f31b7-2dd8-4f19-9eb3-8749c879b66c {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:31 devstack sudo[93683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9723242f-fcdd-431b-9701-38e4c9efea4d -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d.ff3f31b7-2dd8-4f19-9eb3-8749c879b66c Aug 10 12:49:31 devstack sudo[93683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:32 devstack sudo[93683]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c603b715-0b36-4da9-89fd-6fe3e7f4ab93 tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9723242f-fcdd-431b-9701-38e4c9efea4d -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d.ff3f31b7-2dd8-4f19-9eb3-8749c879b66c" returned: 0 in 0.349s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:32 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-c603b715-0b36-4da9-89fd-6fe3e7f4ab93 tempest-GroupSnapshotsTest-1480305479 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d.ff3f31b7-2dd8-4f19-9eb3-8749c879b66c is being set with open permissions: ugo+rw: NotImplementedError Aug 10 12:49:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c603b715-0b36-4da9-89fd-6fe3e7f4ab93 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d.ff3f31b7-2dd8-4f19-9eb3-8749c879b66c {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:32 devstack sudo[93689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d.ff3f31b7-2dd8-4f19-9eb3-8749c879b66c Aug 10 12:49:32 devstack sudo[93689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:32 devstack sudo[93689]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c603b715-0b36-4da9-89fd-6fe3e7f4ab93 tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d.ff3f31b7-2dd8-4f19-9eb3-8749c879b66c" returned: 0 in 0.280s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c603b715-0b36-4da9-89fd-6fe3e7f4ab93 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:32 devstack sudo[93693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d.info Aug 10 12:49:32 devstack sudo[93693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:32 devstack sudo[93693]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c603b715-0b36-4da9-89fd-6fe3e7f4ab93 tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d.info" returned: 0 in 0.328s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:32 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-c603b715-0b36-4da9-89fd-6fe3e7f4ab93 tempest-GroupSnapshotsTest-1480305479 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d.info is being set with open permissions: ugo+rw: NotImplementedError Aug 10 12:49:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c603b715-0b36-4da9-89fd-6fe3e7f4ab93 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:32 devstack sudo[93696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d.info Aug 10 12:49:32 devstack sudo[93696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:33 devstack sudo[93696]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c603b715-0b36-4da9-89fd-6fe3e7f4ab93 tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d.info" returned: 0 in 0.311s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c603b715-0b36-4da9-89fd-6fe3e7f4ab93 tempest-GroupSnapshotsTest-1480305479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.317s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:49:33 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-c603b715-0b36-4da9-89fd-6fe3e7f4ab93 tempest-GroupSnapshotsTest-1480305479 None] group_snapshot 7e219dc0-ca7f-427a-910d-e1d4d3ca4527: created successfully Aug 10 12:49:33 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] group_snapshot 7e219dc0-ca7f-427a-910d-e1d4d3ca4527: deleting Aug 10 12:49:34 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] group_snapshot 7e219dc0-ca7f-427a-910d-e1d4d3ca4527: deleting {{(pid=89096) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 10 12:49:34 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] Acquiring lock "cinder-quobyte-5b5e7604-c494-40a8-973b-504eb2137930" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:49:34 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] Lock "cinder-quobyte-5b5e7604-c494-40a8-973b-504eb2137930" acquired by "delete_snapshot" :: waited 0.027s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:49:34 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] Acquiring lock "cinder-quobyte-427fa88f-8e6c-49a7-a2d1-08b77674c0bf" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:49:34 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] Lock "cinder-quobyte-427fa88f-8e6c-49a7-a2d1-08b77674c0bf" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:49:34 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] Deleting offline snapshot 427fa88f-8e6c-49a7-a2d1-08b77674c0bf of volume 5b5e7604-c494-40a8-973b-504eb2137930 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 12:49:34 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] snapshot_file for this snap is: volume-5b5e7604-c494-40a8-973b-504eb2137930.427fa88f-8e6c-49a7-a2d1-08b77674c0bf {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 12:49:34 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaaa3e09-9698-49d5-b07d-f2e87843cdd6]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:49:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930.427fa88f-8e6c-49a7-a2d1-08b77674c0bf {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:34 devstack sudo[93699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930.427fa88f-8e6c-49a7-a2d1-08b77674c0bf Aug 10 12:49:34 devstack sudo[93699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:34 devstack sudo[93699]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930.427fa88f-8e6c-49a7-a2d1-08b77674c0bf" returned: 0 in 0.508s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:34 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b5e7604-c494-40a8-973b-504eb2137930(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 12:49:34 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad9b0d0-c428-4e59-9c28-641850859d3b]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:49:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:34 devstack sudo[93705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930 Aug 10 12:49:34 devstack sudo[93705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:35 devstack sudo[93705]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930" returned: 0 in 0.403s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930.427fa88f-8e6c-49a7-a2d1-08b77674c0bf {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:35 devstack sudo[93710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930.427fa88f-8e6c-49a7-a2d1-08b77674c0bf Aug 10 12:49:35 devstack sudo[93710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:35 devstack sudo[93710]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930.427fa88f-8e6c-49a7-a2d1-08b77674c0bf" returned: 0 in 0.385s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930.427fa88f-8e6c-49a7-a2d1-08b77674c0bf {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:35 devstack sudo[93716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930.427fa88f-8e6c-49a7-a2d1-08b77674c0bf Aug 10 12:49:35 devstack sudo[93716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:35 devstack sudo[93716]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930.427fa88f-8e6c-49a7-a2d1-08b77674c0bf" returned: 0 in 0.277s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:35 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] Lock "cinder-quobyte-427fa88f-8e6c-49a7-a2d1-08b77674c0bf" released by "_delete_snapshot" :: held 1.735s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:49:35 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] Lock "cinder-quobyte-5b5e7604-c494-40a8-973b-504eb2137930" released by "delete_snapshot" :: held 1.770s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:49:35 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] Acquiring lock "cinder-quobyte-9723242f-fcdd-431b-9701-38e4c9efea4d" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:49:35 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] Lock "cinder-quobyte-9723242f-fcdd-431b-9701-38e4c9efea4d" acquired by "delete_snapshot" :: waited 0.034s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:49:35 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] Acquiring lock "cinder-quobyte-ff3f31b7-2dd8-4f19-9eb3-8749c879b66c" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:49:35 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] Lock "cinder-quobyte-ff3f31b7-2dd8-4f19-9eb3-8749c879b66c" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:49:35 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] Deleting offline snapshot ff3f31b7-2dd8-4f19-9eb3-8749c879b66c of volume 9723242f-fcdd-431b-9701-38e4c9efea4d {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 12:49:35 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] snapshot_file for this snap is: volume-9723242f-fcdd-431b-9701-38e4c9efea4d.ff3f31b7-2dd8-4f19-9eb3-8749c879b66c {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 12:49:36 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5485c18-4951-4f41-b149-4141d5649a68]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:49:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d.ff3f31b7-2dd8-4f19-9eb3-8749c879b66c {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:36 devstack sudo[93719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d.ff3f31b7-2dd8-4f19-9eb3-8749c879b66c Aug 10 12:49:36 devstack sudo[93719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:36 devstack sudo[93719]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d.ff3f31b7-2dd8-4f19-9eb3-8749c879b66c" returned: 0 in 0.376s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:36 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9723242f-fcdd-431b-9701-38e4c9efea4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 12:49:36 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1be520-7379-48f4-916d-db9cd6829d22]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:49:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:36 devstack sudo[93724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d Aug 10 12:49:36 devstack sudo[93724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:36 devstack sudo[93724]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d" returned: 0 in 0.380s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d.ff3f31b7-2dd8-4f19-9eb3-8749c879b66c {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:36 devstack sudo[93730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d.ff3f31b7-2dd8-4f19-9eb3-8749c879b66c Aug 10 12:49:36 devstack sudo[93730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:37 devstack sudo[93730]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d.ff3f31b7-2dd8-4f19-9eb3-8749c879b66c" returned: 0 in 0.449s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d.ff3f31b7-2dd8-4f19-9eb3-8749c879b66c {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:37 devstack sudo[93736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d.ff3f31b7-2dd8-4f19-9eb3-8749c879b66c Aug 10 12:49:37 devstack sudo[93736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:37 devstack sudo[93736]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d.ff3f31b7-2dd8-4f19-9eb3-8749c879b66c" returned: 0 in 0.256s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:37 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] Lock "cinder-quobyte-ff3f31b7-2dd8-4f19-9eb3-8749c879b66c" released by "_delete_snapshot" :: held 1.594s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:49:37 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] Lock "cinder-quobyte-9723242f-fcdd-431b-9701-38e4c9efea4d" released by "delete_snapshot" :: held 1.633s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:49:37 devstack cinder-volume[89096]: WARNING cinder.quota [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-664179232 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-664179232, it is now deprecated. Please use the default quota class for default quota. Aug 10 12:49:37 devstack cinder-volume[89096]: WARNING cinder.quota [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-664179232 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-664179232, it is now deprecated. Please use the default quota class for default quota. Aug 10 12:49:37 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] Created reservations ['fdb932ca-97a2-4077-a440-be56756cec20', '75a911c1-1219-446a-8009-992668b25878', 'b105706f-e6ad-45eb-abb1-04219344e265', 'e7967519-eaaa-43ca-8257-2cf1e2c13115'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:49:37 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] Created reservations ['87740046-e17a-46b0-9fb5-eb99d4e65524', '52a627ef-d9c0-4f39-9f57-c02736232384', 'b97352d7-c2c1-4fb3-9fe1-0e92b4a4a7d2', 'fedd818d-a6d2-4b10-85f6-1f60b73fe055'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:49:37 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-ac9716d7-b982-45da-8cc2-0063c59b8ec7 tempest-GroupSnapshotsTest-1480305479 None] group_snapshot 7e219dc0-ca7f-427a-910d-e1d4d3ca4527: deleted successfully Aug 10 12:49:39 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2f51cbb4-5ae3-4a11-bb41-d0a2015533ce tempest-GroupSnapshotsTest-1480305479 None] Acquiring lock "cinder-quobyte-5b5e7604-c494-40a8-973b-504eb2137930" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:49:39 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2f51cbb4-5ae3-4a11-bb41-d0a2015533ce tempest-GroupSnapshotsTest-1480305479 None] Lock "cinder-quobyte-5b5e7604-c494-40a8-973b-504eb2137930" acquired by "delete_volume" :: waited 0.030s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:49:39 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b8efac-06a5-477b-9db3-89875b3c8ddc]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:49:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2f51cbb4-5ae3-4a11-bb41-d0a2015533ce tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:39 devstack sudo[93746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930 Aug 10 12:49:39 devstack sudo[93746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:39 devstack sudo[93746]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2f51cbb4-5ae3-4a11-bb41-d0a2015533ce tempest-GroupSnapshotsTest-1480305479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930" returned: 0 in 0.531s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2f51cbb4-5ae3-4a11-bb41-d0a2015533ce tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:39 devstack sudo[93752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930 Aug 10 12:49:39 devstack sudo[93752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:40 devstack sudo[93752]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2f51cbb4-5ae3-4a11-bb41-d0a2015533ce tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b5e7604-c494-40a8-973b-504eb2137930" returned: 0 in 0.302s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:40 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2f51cbb4-5ae3-4a11-bb41-d0a2015533ce tempest-GroupSnapshotsTest-1480305479 None] Lock "cinder-quobyte-5b5e7604-c494-40a8-973b-504eb2137930" released by "delete_volume" :: held 0.997s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:49:40 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2f51cbb4-5ae3-4a11-bb41-d0a2015533ce tempest-GroupSnapshotsTest-1480305479 None] Acquiring lock "cinder-quobyte-9723242f-fcdd-431b-9701-38e4c9efea4d" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:49:40 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2f51cbb4-5ae3-4a11-bb41-d0a2015533ce tempest-GroupSnapshotsTest-1480305479 None] Lock "cinder-quobyte-9723242f-fcdd-431b-9701-38e4c9efea4d" acquired by "delete_volume" :: waited 0.016s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:49:40 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f43032f-a44a-4a08-9ffc-6a71a001b5a1]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:49:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2f51cbb4-5ae3-4a11-bb41-d0a2015533ce tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:40 devstack sudo[93764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d Aug 10 12:49:40 devstack sudo[93764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:40 devstack sudo[93764]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2f51cbb4-5ae3-4a11-bb41-d0a2015533ce tempest-GroupSnapshotsTest-1480305479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d" returned: 0 in 0.569s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2f51cbb4-5ae3-4a11-bb41-d0a2015533ce tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:40 devstack sudo[93775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d Aug 10 12:49:40 devstack sudo[93775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:41 devstack sudo[93775]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2f51cbb4-5ae3-4a11-bb41-d0a2015533ce tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9723242f-fcdd-431b-9701-38e4c9efea4d" returned: 0 in 0.320s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:41 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2f51cbb4-5ae3-4a11-bb41-d0a2015533ce tempest-GroupSnapshotsTest-1480305479 None] Lock "cinder-quobyte-9723242f-fcdd-431b-9701-38e4c9efea4d" released by "delete_volume" :: held 0.989s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:49:41 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=110,cinder:INSERT=23,cinder:UPDATE=113,cinder:DELETE=4 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:49:41 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=125,cinder:INSERT=28,cinder:UPDATE=117,cinder:DELETE=3 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:49:41 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-2f51cbb4-5ae3-4a11-bb41-d0a2015533ce tempest-GroupSnapshotsTest-1480305479 None] Created reservations ['aa0cb94e-00cc-4435-b886-3948d21dfa5f'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:49:41 devstack cinder-volume[89096]: WARNING cinder.quota [None req-2f51cbb4-5ae3-4a11-bb41-d0a2015533ce tempest-GroupSnapshotsTest-1480305479 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-664179232 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-664179232, it is now deprecated. Please use the default quota class for default quota. Aug 10 12:49:41 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-2f51cbb4-5ae3-4a11-bb41-d0a2015533ce tempest-GroupSnapshotsTest-1480305479 None] Created reservations ['af577c3e-b656-4579-b061-833ce1fd05f6', 'd57b929b-7034-42d0-b479-1bb3c07acba6', '05bb1f1e-f85e-49ca-bf64-de49dba86949', 'd6d0d961-cf8d-451d-82b2-e62df23b2aa1'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:49:41 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-2f51cbb4-5ae3-4a11-bb41-d0a2015533ce tempest-GroupSnapshotsTest-1480305479 None] Created reservations ['fd079847-2703-47e8-9e83-1846ba6f53e7', 'c4c717db-ca83-4c7a-bc8c-4bf49849f6f5', 'eadaae93-7ce9-45ce-ba1e-60223abcff80', '90109ac8-b34d-491c-8537-5dd804d1c664'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:49:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2f51cbb4-5ae3-4a11-bb41-d0a2015533ce tempest-GroupSnapshotsTest-1480305479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:49:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2f51cbb4-5ae3-4a11-bb41-d0a2015533ce tempest-GroupSnapshotsTest-1480305479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:49:41 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-2f51cbb4-5ae3-4a11-bb41-d0a2015533ce tempest-GroupSnapshotsTest-1480305479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:49:41 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-2f51cbb4-5ae3-4a11-bb41-d0a2015533ce tempest-GroupSnapshotsTest-1480305479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:49:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2f51cbb4-5ae3-4a11-bb41-d0a2015533ce tempest-GroupSnapshotsTest-1480305479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:49:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2f51cbb4-5ae3-4a11-bb41-d0a2015533ce tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:41 devstack sudo[93778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:49:41 devstack sudo[93778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:41 devstack sudo[93778]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2f51cbb4-5ae3-4a11-bb41-d0a2015533ce tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.292s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:41 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-2f51cbb4-5ae3-4a11-bb41-d0a2015533ce tempest-GroupSnapshotsTest-1480305479 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:49:41 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-2f51cbb4-5ae3-4a11-bb41-d0a2015533ce tempest-GroupSnapshotsTest-1480305479 None] Delete group completed successfully. Aug 10 12:49:42 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-6888d8e4-604c-46fb-819a-b16ef266f00e tempest-GroupSnapshotsTest-1480305479 None] Group tempest-GroupSnapshotsTest-Group-1584986775: creating Aug 10 12:49:42 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-6888d8e4-604c-46fb-819a-b16ef266f00e tempest-GroupSnapshotsTest-1480305479 None] Group tempest-GroupSnapshotsTest-Group-1584986775: created successfully Aug 10 12:49:42 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-6888d8e4-604c-46fb-819a-b16ef266f00e tempest-GroupSnapshotsTest-1480305479 None] Create group completed successfully. Aug 10 12:49:44 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-c96816fb-3924-4f10-9219-12afbef5c073 tempest-GroupSnapshotsTest-1480305479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:49:44 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c96816fb-3924-4f10-9219-12afbef5c073 tempest-GroupSnapshotsTest-1480305479 None] Flow 'volume_create_manager' (fc814d52-030e-42cb-bb4b-4087f8957acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:49:44 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c96816fb-3924-4f10-9219-12afbef5c073 tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ae3863-78b3-4a76-b5a8-107d3c8ceeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:49:44 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c96816fb-3924-4f10-9219-12afbef5c073 tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ae3863-78b3-4a76-b5a8-107d3c8ceeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-611282218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=78caf819-4af9-4dbc-94f9-c50679ed79a4,host='devstack@QuobyteHD#QuobyteHD',id=67854507-d025-473e-90de-86255f958048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8989f0078d4821bad814877f45db3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:49:44Z,use_quota=True,user_id='613ed7ca0d874ceb8c808624cfbb57b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d71a605a-1f89-4192-9295-e44a105d8305),volume_type_id=d71a605a-1f89-4192-9295-e44a105d8305)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:49:44 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c96816fb-3924-4f10-9219-12afbef5c073 tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9d4c404-6a37-405a-ab10-e32f142dda8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:49:44 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c96816fb-3924-4f10-9219-12afbef5c073 tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9d4c404-6a37-405a-ab10-e32f142dda8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:49:44 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c96816fb-3924-4f10-9219-12afbef5c073 tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf62e94-2c85-40e7-aa87-7f22ca1838ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:49:44 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c96816fb-3924-4f10-9219-12afbef5c073 tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf62e94-2c85-40e7-aa87-7f22ca1838ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67854507-d025-473e-90de-86255f958048', 'volume_name': 'volume-67854507-d025-473e-90de-86255f958048', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:49:44 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c96816fb-3924-4f10-9219-12afbef5c073 tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d6d003-041c-425b-9495-fe50ee798b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:49:44 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c96816fb-3924-4f10-9219-12afbef5c073 tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d6d003-041c-425b-9495-fe50ee798b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:49:44 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c96816fb-3924-4f10-9219-12afbef5c073 tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c14c34a-e71d-434b-8953-92936d984cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:49:44 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-c96816fb-3924-4f10-9219-12afbef5c073 tempest-GroupSnapshotsTest-1480305479 None] Volume 67854507-d025-473e-90de-86255f958048: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67854507-d025-473e-90de-86255f958048', 'volume_size': 1} Aug 10 12:49:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c96816fb-3924-4f10-9219-12afbef5c073 tempest-GroupSnapshotsTest-1480305479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:49:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c96816fb-3924-4f10-9219-12afbef5c073 tempest-GroupSnapshotsTest-1480305479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:49:44 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c96816fb-3924-4f10-9219-12afbef5c073 tempest-GroupSnapshotsTest-1480305479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=78caf819-4af9-4dbc-94f9-c50679ed79a4,created_at=2026-08-10T10:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-611282218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=78caf819-4af9-4dbc-94f9-c50679ed79a4,host='devstack@QuobyteHD#QuobyteHD',id=67854507-d025-473e-90de-86255f958048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8989f0078d4821bad814877f45db3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:49:44Z,use_quota=True,user_id='613ed7ca0d874ceb8c808624cfbb57b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d71a605a-1f89-4192-9295-e44a105d8305),volume_type_id=d71a605a-1f89-4192-9295-e44a105d8305)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:49:44 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-c96816fb-3924-4f10-9219-12afbef5c073 tempest-GroupSnapshotsTest-1480305479 None] Creating volume 67854507-d025-473e-90de-86255f958048 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:49:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c96816fb-3924-4f10-9219-12afbef5c073 tempest-GroupSnapshotsTest-1480305479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:49:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c96816fb-3924-4f10-9219-12afbef5c073 tempest-GroupSnapshotsTest-1480305479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:49:44 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c96816fb-3924-4f10-9219-12afbef5c073 tempest-GroupSnapshotsTest-1480305479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:49:44 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c96816fb-3924-4f10-9219-12afbef5c073 tempest-GroupSnapshotsTest-1480305479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:49:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c96816fb-3924-4f10-9219-12afbef5c073 tempest-GroupSnapshotsTest-1480305479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:49:44 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c96816fb-3924-4f10-9219-12afbef5c073 tempest-GroupSnapshotsTest-1480305479 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:49:44 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-c96816fb-3924-4f10-9219-12afbef5c073 tempest-GroupSnapshotsTest-1480305479 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:49:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c96816fb-3924-4f10-9219-12afbef5c073 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:44 devstack sudo[93872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048 1073741824 Aug 10 12:49:44 devstack sudo[93872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:44 devstack sudo[93872]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c96816fb-3924-4f10-9219-12afbef5c073 tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048 1073741824" returned: 0 in 0.648s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c96816fb-3924-4f10-9219-12afbef5c073 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:44 devstack sudo[93878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048 Aug 10 12:49:44 devstack sudo[93878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:45 devstack sudo[93878]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c96816fb-3924-4f10-9219-12afbef5c073 tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048" returned: 0 in 0.344s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:45 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c96816fb-3924-4f10-9219-12afbef5c073 tempest-GroupSnapshotsTest-1480305479 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:49:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c96816fb-3924-4f10-9219-12afbef5c073 tempest-GroupSnapshotsTest-1480305479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:49:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c96816fb-3924-4f10-9219-12afbef5c073 tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c14c34a-e71d-434b-8953-92936d984cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67854507-d025-473e-90de-86255f958048', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:49:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c96816fb-3924-4f10-9219-12afbef5c073 tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec107d39-4434-4d5f-90a5-2bbc1502f602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:49:45 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-c96816fb-3924-4f10-9219-12afbef5c073 tempest-GroupSnapshotsTest-1480305479 None] Volume volume-67854507-d025-473e-90de-86255f958048 (67854507-d025-473e-90de-86255f958048): created successfully Aug 10 12:49:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c96816fb-3924-4f10-9219-12afbef5c073 tempest-GroupSnapshotsTest-1480305479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec107d39-4434-4d5f-90a5-2bbc1502f602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:49:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c96816fb-3924-4f10-9219-12afbef5c073 tempest-GroupSnapshotsTest-1480305479 None] Flow 'volume_create_manager' (fc814d52-030e-42cb-bb4b-4087f8957acf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:49:45 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-c96816fb-3924-4f10-9219-12afbef5c073 tempest-GroupSnapshotsTest-1480305479 None] Created volume successfully. Aug 10 12:49:46 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-8c8becd5-6b41-46a5-90c0-44b2ddaee018 tempest-GroupSnapshotsTest-1480305479 None] GroupSnapshot ac070ea6-9135-4600-b6e4-c72c28979795: creating. Aug 10 12:49:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8c8becd5-6b41-46a5-90c0-44b2ddaee018 tempest-GroupSnapshotsTest-1480305479 None] Group snapshot ac070ea6-9135-4600-b6e4-c72c28979795: creating. {{(pid=89096) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 10 12:49:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8c8becd5-6b41-46a5-90c0-44b2ddaee018 tempest-GroupSnapshotsTest-1480305479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:49:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8c8becd5-6b41-46a5-90c0-44b2ddaee018 tempest-GroupSnapshotsTest-1480305479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:49:47 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-8c8becd5-6b41-46a5-90c0-44b2ddaee018 tempest-GroupSnapshotsTest-1480305479 None] Creating offline snapshot 60330a4c-bfcc-437f-befc-37de1852eeb9 of volume 67854507-d025-473e-90de-86255f958048 {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 12:49:47 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3c539d-ee92-41ce-89f8-1a38e2d655ed]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:49:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c8becd5-6b41-46a5-90c0-44b2ddaee018 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:47 devstack sudo[93885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048 Aug 10 12:49:47 devstack sudo[93885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:47 devstack sudo[93885]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c8becd5-6b41-46a5-90c0-44b2ddaee018 tempest-GroupSnapshotsTest-1480305479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048" returned: 0 in 0.642s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c8becd5-6b41-46a5-90c0-44b2ddaee018 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048.60330a4c-bfcc-437f-befc-37de1852eeb9 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:47 devstack sudo[93891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048.60330a4c-bfcc-437f-befc-37de1852eeb9 1G Aug 10 12:49:47 devstack sudo[93891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:48 devstack sudo[93891]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c8becd5-6b41-46a5-90c0-44b2ddaee018 tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048.60330a4c-bfcc-437f-befc-37de1852eeb9 1G" returned: 0 in 0.608s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c8becd5-6b41-46a5-90c0-44b2ddaee018 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67854507-d025-473e-90de-86255f958048 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048.60330a4c-bfcc-437f-befc-37de1852eeb9 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:48 devstack sudo[93898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67854507-d025-473e-90de-86255f958048 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048.60330a4c-bfcc-437f-befc-37de1852eeb9 Aug 10 12:49:48 devstack sudo[93898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:48 devstack sudo[93898]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c8becd5-6b41-46a5-90c0-44b2ddaee018 tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67854507-d025-473e-90de-86255f958048 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048.60330a4c-bfcc-437f-befc-37de1852eeb9" returned: 0 in 0.365s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:48 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-8c8becd5-6b41-46a5-90c0-44b2ddaee018 tempest-GroupSnapshotsTest-1480305479 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048.60330a4c-bfcc-437f-befc-37de1852eeb9 is being set with open permissions: ugo+rw: NotImplementedError Aug 10 12:49:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c8becd5-6b41-46a5-90c0-44b2ddaee018 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048.60330a4c-bfcc-437f-befc-37de1852eeb9 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:48 devstack sudo[93905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048.60330a4c-bfcc-437f-befc-37de1852eeb9 Aug 10 12:49:48 devstack sudo[93905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:49 devstack sudo[93905]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c8becd5-6b41-46a5-90c0-44b2ddaee018 tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048.60330a4c-bfcc-437f-befc-37de1852eeb9" returned: 0 in 0.313s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c8becd5-6b41-46a5-90c0-44b2ddaee018 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:49 devstack sudo[93908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048.info Aug 10 12:49:49 devstack sudo[93908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:49 devstack sudo[93908]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c8becd5-6b41-46a5-90c0-44b2ddaee018 tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048.info" returned: 0 in 0.360s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:49 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-8c8becd5-6b41-46a5-90c0-44b2ddaee018 tempest-GroupSnapshotsTest-1480305479 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048.info is being set with open permissions: ugo+rw: NotImplementedError Aug 10 12:49:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c8becd5-6b41-46a5-90c0-44b2ddaee018 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:49 devstack sudo[93911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048.info Aug 10 12:49:49 devstack sudo[93911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:49 devstack sudo[93911]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c8becd5-6b41-46a5-90c0-44b2ddaee018 tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048.info" returned: 0 in 0.259s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8c8becd5-6b41-46a5-90c0-44b2ddaee018 tempest-GroupSnapshotsTest-1480305479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.720s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:49:49 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-8c8becd5-6b41-46a5-90c0-44b2ddaee018 tempest-GroupSnapshotsTest-1480305479 None] group_snapshot ac070ea6-9135-4600-b6e4-c72c28979795: created successfully Aug 10 12:49:50 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-2158b808-613e-4878-b758-ab1cca28b77d tempest-GroupSnapshotsTest-1480305479 None] group_snapshot ac070ea6-9135-4600-b6e4-c72c28979795: deleting Aug 10 12:49:50 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-2158b808-613e-4878-b758-ab1cca28b77d tempest-GroupSnapshotsTest-1480305479 None] group_snapshot ac070ea6-9135-4600-b6e4-c72c28979795: deleting {{(pid=89096) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 10 12:49:50 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2158b808-613e-4878-b758-ab1cca28b77d tempest-GroupSnapshotsTest-1480305479 None] Acquiring lock "cinder-quobyte-67854507-d025-473e-90de-86255f958048" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:49:50 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2158b808-613e-4878-b758-ab1cca28b77d tempest-GroupSnapshotsTest-1480305479 None] Lock "cinder-quobyte-67854507-d025-473e-90de-86255f958048" acquired by "delete_snapshot" :: waited 0.034s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:49:50 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2158b808-613e-4878-b758-ab1cca28b77d tempest-GroupSnapshotsTest-1480305479 None] Acquiring lock "cinder-quobyte-60330a4c-bfcc-437f-befc-37de1852eeb9" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:49:50 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2158b808-613e-4878-b758-ab1cca28b77d tempest-GroupSnapshotsTest-1480305479 None] Lock "cinder-quobyte-60330a4c-bfcc-437f-befc-37de1852eeb9" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:49:50 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-2158b808-613e-4878-b758-ab1cca28b77d tempest-GroupSnapshotsTest-1480305479 None] Deleting offline snapshot 60330a4c-bfcc-437f-befc-37de1852eeb9 of volume 67854507-d025-473e-90de-86255f958048 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 12:49:50 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-2158b808-613e-4878-b758-ab1cca28b77d tempest-GroupSnapshotsTest-1480305479 None] snapshot_file for this snap is: volume-67854507-d025-473e-90de-86255f958048.60330a4c-bfcc-437f-befc-37de1852eeb9 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 12:49:50 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bf08e3-ab1a-44f2-b215-a05815832ebe]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:49:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2158b808-613e-4878-b758-ab1cca28b77d tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048.60330a4c-bfcc-437f-befc-37de1852eeb9 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:50 devstack sudo[93914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048.60330a4c-bfcc-437f-befc-37de1852eeb9 Aug 10 12:49:50 devstack sudo[93914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:51 devstack sudo[93914]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2158b808-613e-4878-b758-ab1cca28b77d tempest-GroupSnapshotsTest-1480305479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048.60330a4c-bfcc-437f-befc-37de1852eeb9" returned: 0 in 0.441s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:51 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-2158b808-613e-4878-b758-ab1cca28b77d tempest-GroupSnapshotsTest-1480305479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67854507-d025-473e-90de-86255f958048(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 12:49:51 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3a06e4-a023-4fe7-bf53-aff92060e571]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:49:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2158b808-613e-4878-b758-ab1cca28b77d tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:51 devstack sudo[93919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048 Aug 10 12:49:51 devstack sudo[93919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:51 devstack sudo[93919]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2158b808-613e-4878-b758-ab1cca28b77d tempest-GroupSnapshotsTest-1480305479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048" returned: 0 in 0.369s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2158b808-613e-4878-b758-ab1cca28b77d tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048.60330a4c-bfcc-437f-befc-37de1852eeb9 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:51 devstack sudo[93925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048.60330a4c-bfcc-437f-befc-37de1852eeb9 Aug 10 12:49:51 devstack sudo[93925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:51 devstack sudo[93925]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2158b808-613e-4878-b758-ab1cca28b77d tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048.60330a4c-bfcc-437f-befc-37de1852eeb9" returned: 0 in 0.320s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2158b808-613e-4878-b758-ab1cca28b77d tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048.60330a4c-bfcc-437f-befc-37de1852eeb9 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:51 devstack sudo[93931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048.60330a4c-bfcc-437f-befc-37de1852eeb9 Aug 10 12:49:51 devstack sudo[93931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:52 devstack sudo[93931]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2158b808-613e-4878-b758-ab1cca28b77d tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048.60330a4c-bfcc-437f-befc-37de1852eeb9" returned: 0 in 0.267s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:52 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2158b808-613e-4878-b758-ab1cca28b77d tempest-GroupSnapshotsTest-1480305479 None] Lock "cinder-quobyte-60330a4c-bfcc-437f-befc-37de1852eeb9" released by "_delete_snapshot" :: held 1.581s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:49:52 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2158b808-613e-4878-b758-ab1cca28b77d tempest-GroupSnapshotsTest-1480305479 None] Lock "cinder-quobyte-67854507-d025-473e-90de-86255f958048" released by "delete_snapshot" :: held 1.617s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:49:52 devstack cinder-volume[89096]: WARNING cinder.quota [None req-2158b808-613e-4878-b758-ab1cca28b77d tempest-GroupSnapshotsTest-1480305479 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-95894470 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-95894470, it is now deprecated. Please use the default quota class for default quota. Aug 10 12:49:52 devstack cinder-volume[89096]: WARNING cinder.quota [None req-2158b808-613e-4878-b758-ab1cca28b77d tempest-GroupSnapshotsTest-1480305479 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-95894470 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-95894470, it is now deprecated. Please use the default quota class for default quota. Aug 10 12:49:52 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-2158b808-613e-4878-b758-ab1cca28b77d tempest-GroupSnapshotsTest-1480305479 None] Created reservations ['52f6bc1b-9068-4817-a67f-390c94bcf92a', '66b788b0-4109-4e64-97a3-a10319eb7267', '8d81710a-52c2-424c-a0e5-afd3766b4439', '30a48da4-4edc-4304-ad61-0cdc89a217f9'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:49:52 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-2158b808-613e-4878-b758-ab1cca28b77d tempest-GroupSnapshotsTest-1480305479 None] group_snapshot ac070ea6-9135-4600-b6e4-c72c28979795: deleted successfully Aug 10 12:49:53 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-be7e2311-2a2c-4b73-b0a5-0ebd76f48fe6 tempest-GroupSnapshotsTest-1480305479 None] Acquiring lock "cinder-quobyte-67854507-d025-473e-90de-86255f958048" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:49:53 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-be7e2311-2a2c-4b73-b0a5-0ebd76f48fe6 tempest-GroupSnapshotsTest-1480305479 None] Lock "cinder-quobyte-67854507-d025-473e-90de-86255f958048" acquired by "delete_volume" :: waited 0.031s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:49:53 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68babc3-d1c8-4797-bd8e-363d557da8e5]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:49:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-be7e2311-2a2c-4b73-b0a5-0ebd76f48fe6 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:53 devstack sudo[93934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048 Aug 10 12:49:53 devstack sudo[93934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:53 devstack sudo[93934]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-be7e2311-2a2c-4b73-b0a5-0ebd76f48fe6 tempest-GroupSnapshotsTest-1480305479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048" returned: 0 in 0.658s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-be7e2311-2a2c-4b73-b0a5-0ebd76f48fe6 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:53 devstack sudo[93939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048 Aug 10 12:49:53 devstack sudo[93939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:54 devstack sudo[93939]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-be7e2311-2a2c-4b73-b0a5-0ebd76f48fe6 tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-67854507-d025-473e-90de-86255f958048" returned: 0 in 0.302s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:54 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-be7e2311-2a2c-4b73-b0a5-0ebd76f48fe6 tempest-GroupSnapshotsTest-1480305479 None] Lock "cinder-quobyte-67854507-d025-473e-90de-86255f958048" released by "delete_volume" :: held 1.053s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:49:54 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-be7e2311-2a2c-4b73-b0a5-0ebd76f48fe6 tempest-GroupSnapshotsTest-1480305479 None] Created reservations ['4c5592ab-7cd8-4dfa-a350-17e2f66d0ce1'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:49:54 devstack cinder-volume[89096]: WARNING cinder.quota [None req-be7e2311-2a2c-4b73-b0a5-0ebd76f48fe6 tempest-GroupSnapshotsTest-1480305479 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-95894470 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-95894470, it is now deprecated. Please use the default quota class for default quota. Aug 10 12:49:54 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-be7e2311-2a2c-4b73-b0a5-0ebd76f48fe6 tempest-GroupSnapshotsTest-1480305479 None] Created reservations ['089d12b2-8ad8-4daf-8c46-9338dcba3be7', 'ceee9142-8610-4985-9ae7-60f98b652f9f', '4127405b-c52b-410d-bdcf-87a75de0f769', 'f17c1c89-1a62-451e-8f35-d8f826e381ac'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:49:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-be7e2311-2a2c-4b73-b0a5-0ebd76f48fe6 tempest-GroupSnapshotsTest-1480305479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:49:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-be7e2311-2a2c-4b73-b0a5-0ebd76f48fe6 tempest-GroupSnapshotsTest-1480305479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:49:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-be7e2311-2a2c-4b73-b0a5-0ebd76f48fe6 tempest-GroupSnapshotsTest-1480305479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:49:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-be7e2311-2a2c-4b73-b0a5-0ebd76f48fe6 tempest-GroupSnapshotsTest-1480305479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:49:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-be7e2311-2a2c-4b73-b0a5-0ebd76f48fe6 tempest-GroupSnapshotsTest-1480305479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:49:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-be7e2311-2a2c-4b73-b0a5-0ebd76f48fe6 tempest-GroupSnapshotsTest-1480305479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:49:54 devstack sudo[93942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:49:54 devstack sudo[93942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:49:54 devstack sudo[93942]: pam_unix(sudo:session): session closed for user root Aug 10 12:49:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-be7e2311-2a2c-4b73-b0a5-0ebd76f48fe6 tempest-GroupSnapshotsTest-1480305479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.284s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:49:54 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-be7e2311-2a2c-4b73-b0a5-0ebd76f48fe6 tempest-GroupSnapshotsTest-1480305479 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:49:54 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-be7e2311-2a2c-4b73-b0a5-0ebd76f48fe6 tempest-GroupSnapshotsTest-1480305479 None] Delete group completed successfully. Aug 10 12:50:01 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e175c7a-7d8e-4b13-857a-93f88c05fb48 tempest-SnapshotsActionsTest-452964465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:50:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0e175c7a-7d8e-4b13-857a-93f88c05fb48 tempest-SnapshotsActionsTest-452964465 None] Flow 'volume_create_manager' (63a1a8b4-710b-4daf-8150-460f8ec7a33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:50:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0e175c7a-7d8e-4b13-857a-93f88c05fb48 tempest-SnapshotsActionsTest-452964465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73950eb2-eadf-4f31-97b3-5ccc1b82c036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0e175c7a-7d8e-4b13-857a-93f88c05fb48 tempest-SnapshotsActionsTest-452964465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73950eb2-eadf-4f31-97b3-5ccc1b82c036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1536383539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47a545f2-fcfd-4d11-b960-6cf635b1520d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f2fd9ce90c44dd38014ddb42a5aca55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:50:01Z,use_quota=True,user_id='21618bec8d3342f6bd262275f00e2709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0e175c7a-7d8e-4b13-857a-93f88c05fb48 tempest-SnapshotsActionsTest-452964465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da93b028-6219-42c8-aa6c-856031dd0574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0e175c7a-7d8e-4b13-857a-93f88c05fb48 tempest-SnapshotsActionsTest-452964465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da93b028-6219-42c8-aa6c-856031dd0574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0e175c7a-7d8e-4b13-857a-93f88c05fb48 tempest-SnapshotsActionsTest-452964465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54d69a4e-7259-47c7-9b93-a1cf3657cf48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0e175c7a-7d8e-4b13-857a-93f88c05fb48 tempest-SnapshotsActionsTest-452964465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54d69a4e-7259-47c7-9b93-a1cf3657cf48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47a545f2-fcfd-4d11-b960-6cf635b1520d', 'volume_name': 'volume-47a545f2-fcfd-4d11-b960-6cf635b1520d', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0e175c7a-7d8e-4b13-857a-93f88c05fb48 tempest-SnapshotsActionsTest-452964465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ece6998-92df-4619-8f64-e1ed9e377eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0e175c7a-7d8e-4b13-857a-93f88c05fb48 tempest-SnapshotsActionsTest-452964465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ece6998-92df-4619-8f64-e1ed9e377eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0e175c7a-7d8e-4b13-857a-93f88c05fb48 tempest-SnapshotsActionsTest-452964465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4686599b-e5ba-4347-b59d-2cb730335e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:01 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-0e175c7a-7d8e-4b13-857a-93f88c05fb48 tempest-SnapshotsActionsTest-452964465 None] Volume 47a545f2-fcfd-4d11-b960-6cf635b1520d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47a545f2-fcfd-4d11-b960-6cf635b1520d', 'volume_size': 1} Aug 10 12:50:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0e175c7a-7d8e-4b13-857a-93f88c05fb48 tempest-SnapshotsActionsTest-452964465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:50:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0e175c7a-7d8e-4b13-857a-93f88c05fb48 tempest-SnapshotsActionsTest-452964465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:50:01 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0e175c7a-7d8e-4b13-857a-93f88c05fb48 tempest-SnapshotsActionsTest-452964465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1536383539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47a545f2-fcfd-4d11-b960-6cf635b1520d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f2fd9ce90c44dd38014ddb42a5aca55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:50:01Z,use_quota=True,user_id='21618bec8d3342f6bd262275f00e2709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:50:01 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-0e175c7a-7d8e-4b13-857a-93f88c05fb48 tempest-SnapshotsActionsTest-452964465 None] Creating volume 47a545f2-fcfd-4d11-b960-6cf635b1520d {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:50:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0e175c7a-7d8e-4b13-857a-93f88c05fb48 tempest-SnapshotsActionsTest-452964465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:50:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0e175c7a-7d8e-4b13-857a-93f88c05fb48 tempest-SnapshotsActionsTest-452964465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:50:01 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0e175c7a-7d8e-4b13-857a-93f88c05fb48 tempest-SnapshotsActionsTest-452964465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:50:01 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0e175c7a-7d8e-4b13-857a-93f88c05fb48 tempest-SnapshotsActionsTest-452964465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:50:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0e175c7a-7d8e-4b13-857a-93f88c05fb48 tempest-SnapshotsActionsTest-452964465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:50:01 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0e175c7a-7d8e-4b13-857a-93f88c05fb48 tempest-SnapshotsActionsTest-452964465 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:50:01 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-0e175c7a-7d8e-4b13-857a-93f88c05fb48 tempest-SnapshotsActionsTest-452964465 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:50:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0e175c7a-7d8e-4b13-857a-93f88c05fb48 tempest-SnapshotsActionsTest-452964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:01 devstack sudo[93963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d 1073741824 Aug 10 12:50:01 devstack sudo[93963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:01 devstack sudo[93963]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0e175c7a-7d8e-4b13-857a-93f88c05fb48 tempest-SnapshotsActionsTest-452964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d 1073741824" returned: 0 in 0.438s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0e175c7a-7d8e-4b13-857a-93f88c05fb48 tempest-SnapshotsActionsTest-452964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:01 devstack sudo[93972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d Aug 10 12:50:01 devstack sudo[93972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:02 devstack sudo[93972]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0e175c7a-7d8e-4b13-857a-93f88c05fb48 tempest-SnapshotsActionsTest-452964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d" returned: 0 in 0.271s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0e175c7a-7d8e-4b13-857a-93f88c05fb48 tempest-SnapshotsActionsTest-452964465 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:50:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0e175c7a-7d8e-4b13-857a-93f88c05fb48 tempest-SnapshotsActionsTest-452964465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:50:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0e175c7a-7d8e-4b13-857a-93f88c05fb48 tempest-SnapshotsActionsTest-452964465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4686599b-e5ba-4347-b59d-2cb730335e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47a545f2-fcfd-4d11-b960-6cf635b1520d', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0e175c7a-7d8e-4b13-857a-93f88c05fb48 tempest-SnapshotsActionsTest-452964465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e788f4-cc93-4b56-9dd5-0cd6e2e9d26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:02 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-0e175c7a-7d8e-4b13-857a-93f88c05fb48 tempest-SnapshotsActionsTest-452964465 None] Volume volume-47a545f2-fcfd-4d11-b960-6cf635b1520d (47a545f2-fcfd-4d11-b960-6cf635b1520d): created successfully Aug 10 12:50:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0e175c7a-7d8e-4b13-857a-93f88c05fb48 tempest-SnapshotsActionsTest-452964465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e788f4-cc93-4b56-9dd5-0cd6e2e9d26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0e175c7a-7d8e-4b13-857a-93f88c05fb48 tempest-SnapshotsActionsTest-452964465 None] Flow 'volume_create_manager' (63a1a8b4-710b-4daf-8150-460f8ec7a33f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:50:02 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-0e175c7a-7d8e-4b13-857a-93f88c05fb48 tempest-SnapshotsActionsTest-452964465 None] Created volume successfully. Aug 10 12:50:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c80b0ff3-717c-450f-96c0-be91fdffaa93 tempest-SnapshotsActionsTest-452964465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:50:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c80b0ff3-717c-450f-96c0-be91fdffaa93 tempest-SnapshotsActionsTest-452964465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:50:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-c80b0ff3-717c-450f-96c0-be91fdffaa93 tempest-SnapshotsActionsTest-452964465 None] Creating offline snapshot ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 of volume 47a545f2-fcfd-4d11-b960-6cf635b1520d {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 12:50:03 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a6a22a-45b3-4e92-8a46-0c578be0ed92]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:50:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c80b0ff3-717c-450f-96c0-be91fdffaa93 tempest-SnapshotsActionsTest-452964465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:03 devstack sudo[93980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d Aug 10 12:50:03 devstack sudo[93980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:03 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 12:50:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:50:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:50:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:50:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:50:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:50:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:03 devstack sudo[93989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:50:03 devstack sudo[93989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:04 devstack sudo[93989]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:04 devstack sudo[93980]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c80b0ff3-717c-450f-96c0-be91fdffaa93 tempest-SnapshotsActionsTest-452964465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d" returned: 0 in 0.642s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c80b0ff3-717c-450f-96c0-be91fdffaa93 tempest-SnapshotsActionsTest-452964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.495s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:04 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:50:04 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager._thread_info {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 12:50:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread count: 8 {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 12:50:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread info: [<_MainThread(MainThread, started 130607683133568)>, , , , , , , ] {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Aug 10 12:50:04 devstack sudo[94003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 1G Aug 10 12:50:04 devstack sudo[94003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:04 devstack sudo[94003]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c80b0ff3-717c-450f-96c0-be91fdffaa93 tempest-SnapshotsActionsTest-452964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 1G" returned: 0 in 0.545s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c80b0ff3-717c-450f-96c0-be91fdffaa93 tempest-SnapshotsActionsTest-452964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47a545f2-fcfd-4d11-b960-6cf635b1520d -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:04 devstack sudo[94009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47a545f2-fcfd-4d11-b960-6cf635b1520d -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 Aug 10 12:50:04 devstack sudo[94009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:05 devstack sudo[94009]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c80b0ff3-717c-450f-96c0-be91fdffaa93 tempest-SnapshotsActionsTest-452964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47a545f2-fcfd-4d11-b960-6cf635b1520d -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1" returned: 0 in 0.391s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:05 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-c80b0ff3-717c-450f-96c0-be91fdffaa93 tempest-SnapshotsActionsTest-452964465 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 is being set with open permissions: ugo+rw Aug 10 12:50:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c80b0ff3-717c-450f-96c0-be91fdffaa93 tempest-SnapshotsActionsTest-452964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:05 devstack sudo[94023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 Aug 10 12:50:05 devstack sudo[94023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:05 devstack sudo[94023]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c80b0ff3-717c-450f-96c0-be91fdffaa93 tempest-SnapshotsActionsTest-452964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1" returned: 0 in 0.338s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c80b0ff3-717c-450f-96c0-be91fdffaa93 tempest-SnapshotsActionsTest-452964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:05 devstack sudo[94034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.info Aug 10 12:50:05 devstack sudo[94034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:06 devstack sudo[94034]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c80b0ff3-717c-450f-96c0-be91fdffaa93 tempest-SnapshotsActionsTest-452964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.info" returned: 0 in 0.428s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:06 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-c80b0ff3-717c-450f-96c0-be91fdffaa93 tempest-SnapshotsActionsTest-452964465 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.info is being set with open permissions: ugo+rw Aug 10 12:50:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c80b0ff3-717c-450f-96c0-be91fdffaa93 tempest-SnapshotsActionsTest-452964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:06 devstack sudo[94043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.info Aug 10 12:50:06 devstack sudo[94043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:06 devstack sudo[94043]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c80b0ff3-717c-450f-96c0-be91fdffaa93 tempest-SnapshotsActionsTest-452964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.info" returned: 0 in 0.311s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c80b0ff3-717c-450f-96c0-be91fdffaa93 tempest-SnapshotsActionsTest-452964465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.812s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:50:06 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-c80b0ff3-717c-450f-96c0-be91fdffaa93 tempest-SnapshotsActionsTest-452964465 None] Create snapshot completed successfully Aug 10 12:50:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b35444b8-fe49-4ea2-896e-981c7b9021be tempest-SnapshotsActionsTest-452964465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:50:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b35444b8-fe49-4ea2-896e-981c7b9021be tempest-SnapshotsActionsTest-452964465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:50:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-b35444b8-fe49-4ea2-896e-981c7b9021be tempest-SnapshotsActionsTest-452964465 None] Creating offline snapshot a9591630-5be4-46b8-bac5-6a0f5f4f328e of volume 47a545f2-fcfd-4d11-b960-6cf635b1520d {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 12:50:08 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[6153d806-0548-408a-8e43-1a004d2242c7]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:50:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b35444b8-fe49-4ea2-896e-981c7b9021be tempest-SnapshotsActionsTest-452964465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:08 devstack sudo[94113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 Aug 10 12:50:08 devstack sudo[94113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:08 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-0db22779-e6e5-4262-80c6-0fd84f956ad5 tempest-AttachVolumeNegativeTest-1896074937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:50:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0db22779-e6e5-4262-80c6-0fd84f956ad5 tempest-AttachVolumeNegativeTest-1896074937 None] Flow 'volume_create_manager' (c7612c13-2dea-41e2-ab46-52dbccbd39c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:50:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0db22779-e6e5-4262-80c6-0fd84f956ad5 tempest-AttachVolumeNegativeTest-1896074937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda29d60-e977-48ec-a033-bff38d2a92f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0db22779-e6e5-4262-80c6-0fd84f956ad5 tempest-AttachVolumeNegativeTest-1896074937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda29d60-e977-48ec-a033-bff38d2a92f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2002171721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9e0b6f-45dd-4010-a166-945f272f8bc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5b7c20bff74031ba08276f3ede2b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:50:08Z,use_quota=True,user_id='d1f4d36b032f47449d58b9d791297bf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0db22779-e6e5-4262-80c6-0fd84f956ad5 tempest-AttachVolumeNegativeTest-1896074937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (253f70a3-4c7a-4684-9b88-5686e96f8ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0db22779-e6e5-4262-80c6-0fd84f956ad5 tempest-AttachVolumeNegativeTest-1896074937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (253f70a3-4c7a-4684-9b88-5686e96f8ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0db22779-e6e5-4262-80c6-0fd84f956ad5 tempest-AttachVolumeNegativeTest-1896074937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf75208-1353-4c5b-aa2d-63af80a5b9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0db22779-e6e5-4262-80c6-0fd84f956ad5 tempest-AttachVolumeNegativeTest-1896074937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf75208-1353-4c5b-aa2d-63af80a5b9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd9e0b6f-45dd-4010-a166-945f272f8bc6', 'volume_name': 'volume-cd9e0b6f-45dd-4010-a166-945f272f8bc6', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0db22779-e6e5-4262-80c6-0fd84f956ad5 tempest-AttachVolumeNegativeTest-1896074937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd3adad1-ff2e-4b4b-94c6-bc4cd29d9113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0db22779-e6e5-4262-80c6-0fd84f956ad5 tempest-AttachVolumeNegativeTest-1896074937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd3adad1-ff2e-4b4b-94c6-bc4cd29d9113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0db22779-e6e5-4262-80c6-0fd84f956ad5 tempest-AttachVolumeNegativeTest-1896074937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fea6c9d7-71de-47e8-9c3c-f226cc14d6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:08 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-0db22779-e6e5-4262-80c6-0fd84f956ad5 tempest-AttachVolumeNegativeTest-1896074937 None] Volume cd9e0b6f-45dd-4010-a166-945f272f8bc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd9e0b6f-45dd-4010-a166-945f272f8bc6', 'volume_size': 1} Aug 10 12:50:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0db22779-e6e5-4262-80c6-0fd84f956ad5 tempest-AttachVolumeNegativeTest-1896074937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:50:08 devstack sudo[94113]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b35444b8-fe49-4ea2-896e-981c7b9021be tempest-SnapshotsActionsTest-452964465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1" returned: 0 in 0.475s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-b35444b8-fe49-4ea2-896e-981c7b9021be tempest-SnapshotsActionsTest-452964465 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47a545f2-fcfd-4d11-b960-6cf635b1520d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 12:50:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b35444b8-fe49-4ea2-896e-981c7b9021be tempest-SnapshotsActionsTest-452964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.a9591630-5be4-46b8-bac5-6a0f5f4f328e 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:08 devstack sudo[94139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.a9591630-5be4-46b8-bac5-6a0f5f4f328e 1G Aug 10 12:50:08 devstack sudo[94139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:09 devstack sudo[94139]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b35444b8-fe49-4ea2-896e-981c7b9021be tempest-SnapshotsActionsTest-452964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.a9591630-5be4-46b8-bac5-6a0f5f4f328e 1G" returned: 0 in 0.443s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b35444b8-fe49-4ea2-896e-981c7b9021be tempest-SnapshotsActionsTest-452964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.a9591630-5be4-46b8-bac5-6a0f5f4f328e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:09 devstack sudo[94145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.a9591630-5be4-46b8-bac5-6a0f5f4f328e Aug 10 12:50:09 devstack sudo[94145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:09 devstack sudo[94145]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b35444b8-fe49-4ea2-896e-981c7b9021be tempest-SnapshotsActionsTest-452964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.a9591630-5be4-46b8-bac5-6a0f5f4f328e" returned: 0 in 0.304s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:09 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-b35444b8-fe49-4ea2-896e-981c7b9021be tempest-SnapshotsActionsTest-452964465 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.a9591630-5be4-46b8-bac5-6a0f5f4f328e is being set with open permissions: ugo+rw Aug 10 12:50:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b35444b8-fe49-4ea2-896e-981c7b9021be tempest-SnapshotsActionsTest-452964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.a9591630-5be4-46b8-bac5-6a0f5f4f328e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:09 devstack sudo[94151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.a9591630-5be4-46b8-bac5-6a0f5f4f328e Aug 10 12:50:09 devstack sudo[94151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:09 devstack sudo[94151]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b35444b8-fe49-4ea2-896e-981c7b9021be tempest-SnapshotsActionsTest-452964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.a9591630-5be4-46b8-bac5-6a0f5f4f328e" returned: 0 in 0.290s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b35444b8-fe49-4ea2-896e-981c7b9021be tempest-SnapshotsActionsTest-452964465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.695s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:50:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0db22779-e6e5-4262-80c6-0fd84f956ad5 tempest-AttachVolumeNegativeTest-1896074937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.124s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:50:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0db22779-e6e5-4262-80c6-0fd84f956ad5 tempest-AttachVolumeNegativeTest-1896074937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2002171721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9e0b6f-45dd-4010-a166-945f272f8bc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5b7c20bff74031ba08276f3ede2b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:50:08Z,use_quota=True,user_id='d1f4d36b032f47449d58b9d791297bf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:50:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-0db22779-e6e5-4262-80c6-0fd84f956ad5 tempest-AttachVolumeNegativeTest-1896074937 None] Creating volume cd9e0b6f-45dd-4010-a166-945f272f8bc6 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:50:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0db22779-e6e5-4262-80c6-0fd84f956ad5 tempest-AttachVolumeNegativeTest-1896074937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:50:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0db22779-e6e5-4262-80c6-0fd84f956ad5 tempest-AttachVolumeNegativeTest-1896074937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:50:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0db22779-e6e5-4262-80c6-0fd84f956ad5 tempest-AttachVolumeNegativeTest-1896074937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:50:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0db22779-e6e5-4262-80c6-0fd84f956ad5 tempest-AttachVolumeNegativeTest-1896074937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:50:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0db22779-e6e5-4262-80c6-0fd84f956ad5 tempest-AttachVolumeNegativeTest-1896074937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:50:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0db22779-e6e5-4262-80c6-0fd84f956ad5 tempest-AttachVolumeNegativeTest-1896074937 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:50:09 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-0db22779-e6e5-4262-80c6-0fd84f956ad5 tempest-AttachVolumeNegativeTest-1896074937 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:50:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0db22779-e6e5-4262-80c6-0fd84f956ad5 tempest-AttachVolumeNegativeTest-1896074937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cd9e0b6f-45dd-4010-a166-945f272f8bc6 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:09 devstack sudo[94156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cd9e0b6f-45dd-4010-a166-945f272f8bc6 1073741824 Aug 10 12:50:09 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-b35444b8-fe49-4ea2-896e-981c7b9021be tempest-SnapshotsActionsTest-452964465 None] Create snapshot completed successfully Aug 10 12:50:09 devstack sudo[94156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-97f95f20-dd83-442c-b504-4c366ae9795a tempest-SnapshotsActionsTest-1433625484 None] Acquiring lock "cinder-a9591630-5be4-46b8-bac5-6a0f5f4f328e-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:50:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-97f95f20-dd83-442c-b504-4c366ae9795a tempest-SnapshotsActionsTest-1433625484 None] Lock "cinder-a9591630-5be4-46b8-bac5-6a0f5f4f328e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:50:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-97f95f20-dd83-442c-b504-4c366ae9795a tempest-SnapshotsActionsTest-1433625484 None] Acquiring lock "cinder-quobyte-47a545f2-fcfd-4d11-b960-6cf635b1520d" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:50:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-97f95f20-dd83-442c-b504-4c366ae9795a tempest-SnapshotsActionsTest-1433625484 None] Lock "cinder-quobyte-47a545f2-fcfd-4d11-b960-6cf635b1520d" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:50:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-97f95f20-dd83-442c-b504-4c366ae9795a tempest-SnapshotsActionsTest-1433625484 None] Acquiring lock "cinder-quobyte-a9591630-5be4-46b8-bac5-6a0f5f4f328e" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:50:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-97f95f20-dd83-442c-b504-4c366ae9795a tempest-SnapshotsActionsTest-1433625484 None] Lock "cinder-quobyte-a9591630-5be4-46b8-bac5-6a0f5f4f328e" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:50:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-97f95f20-dd83-442c-b504-4c366ae9795a tempest-SnapshotsActionsTest-1433625484 None] Deleting offline snapshot a9591630-5be4-46b8-bac5-6a0f5f4f328e of volume 47a545f2-fcfd-4d11-b960-6cf635b1520d {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 12:50:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-97f95f20-dd83-442c-b504-4c366ae9795a tempest-SnapshotsActionsTest-1433625484 None] snapshot_file for this snap is: volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.a9591630-5be4-46b8-bac5-6a0f5f4f328e {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 12:50:10 devstack sudo[94156]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0db22779-e6e5-4262-80c6-0fd84f956ad5 tempest-AttachVolumeNegativeTest-1896074937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cd9e0b6f-45dd-4010-a166-945f272f8bc6 1073741824" returned: 0 in 0.639s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:10 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1288773-967f-4da6-8bce-4a0b278a3a36]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:50:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-97f95f20-dd83-442c-b504-4c366ae9795a tempest-SnapshotsActionsTest-1433625484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.a9591630-5be4-46b8-bac5-6a0f5f4f328e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0db22779-e6e5-4262-80c6-0fd84f956ad5 tempest-AttachVolumeNegativeTest-1896074937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cd9e0b6f-45dd-4010-a166-945f272f8bc6 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:10 devstack sudo[94164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cd9e0b6f-45dd-4010-a166-945f272f8bc6 Aug 10 12:50:10 devstack sudo[94164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:10 devstack sudo[94163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.a9591630-5be4-46b8-bac5-6a0f5f4f328e Aug 10 12:50:10 devstack sudo[94163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:10 devstack sudo[94164]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:10 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7179790-4505-4a53-9b11-fd21926f513c tempest-VolumesActionsTest-179111258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:50:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a7179790-4505-4a53-9b11-fd21926f513c tempest-VolumesActionsTest-179111258 None] Flow 'volume_create_manager' (d48b1d4c-2542-4444-8669-ae0ce64656e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:50:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a7179790-4505-4a53-9b11-fd21926f513c tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f66159-4547-4733-8d0a-49ead219af8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0db22779-e6e5-4262-80c6-0fd84f956ad5 tempest-AttachVolumeNegativeTest-1896074937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cd9e0b6f-45dd-4010-a166-945f272f8bc6" returned: 0 in 0.452s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0db22779-e6e5-4262-80c6-0fd84f956ad5 tempest-AttachVolumeNegativeTest-1896074937 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:50:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0db22779-e6e5-4262-80c6-0fd84f956ad5 tempest-AttachVolumeNegativeTest-1896074937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:50:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a7179790-4505-4a53-9b11-fd21926f513c tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f66159-4547-4733-8d0a-49ead219af8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-466649254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcddc254-5847-4e6d-a5ac-ea7eb42eb428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b1a88657d7242f980aa06a66796beb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:50:11Z,use_quota=True,user_id='68c2f8894a8840b18f9a6c2af19ebb79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a7179790-4505-4a53-9b11-fd21926f513c tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29297daf-edbf-4d5f-a201-bff0b57f77eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a7179790-4505-4a53-9b11-fd21926f513c tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29297daf-edbf-4d5f-a201-bff0b57f77eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a7179790-4505-4a53-9b11-fd21926f513c tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06d9cc5c-3929-4e15-8cdf-693e3f513fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:10 devstack sudo[94163]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a7179790-4505-4a53-9b11-fd21926f513c tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06d9cc5c-3929-4e15-8cdf-693e3f513fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcddc254-5847-4e6d-a5ac-ea7eb42eb428', 'volume_name': 'volume-fcddc254-5847-4e6d-a5ac-ea7eb42eb428', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a7179790-4505-4a53-9b11-fd21926f513c tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (552b9dc1-c841-4fa4-a7d5-f657a4a59303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a7179790-4505-4a53-9b11-fd21926f513c tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (552b9dc1-c841-4fa4-a7d5-f657a4a59303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a7179790-4505-4a53-9b11-fd21926f513c tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27521705-cb84-4410-a593-27fad6bf6524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:11 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-a7179790-4505-4a53-9b11-fd21926f513c tempest-VolumesActionsTest-179111258 None] Volume fcddc254-5847-4e6d-a5ac-ea7eb42eb428: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcddc254-5847-4e6d-a5ac-ea7eb42eb428', 'volume_size': 1} Aug 10 12:50:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a7179790-4505-4a53-9b11-fd21926f513c tempest-VolumesActionsTest-179111258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:50:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a7179790-4505-4a53-9b11-fd21926f513c tempest-VolumesActionsTest-179111258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:50:11 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a7179790-4505-4a53-9b11-fd21926f513c tempest-VolumesActionsTest-179111258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-466649254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcddc254-5847-4e6d-a5ac-ea7eb42eb428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b1a88657d7242f980aa06a66796beb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:50:11Z,use_quota=True,user_id='68c2f8894a8840b18f9a6c2af19ebb79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:50:11 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-a7179790-4505-4a53-9b11-fd21926f513c tempest-VolumesActionsTest-179111258 None] Creating volume fcddc254-5847-4e6d-a5ac-ea7eb42eb428 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:50:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a7179790-4505-4a53-9b11-fd21926f513c tempest-VolumesActionsTest-179111258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:50:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a7179790-4505-4a53-9b11-fd21926f513c tempest-VolumesActionsTest-179111258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:50:11 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a7179790-4505-4a53-9b11-fd21926f513c tempest-VolumesActionsTest-179111258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:50:11 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a7179790-4505-4a53-9b11-fd21926f513c tempest-VolumesActionsTest-179111258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:50:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a7179790-4505-4a53-9b11-fd21926f513c tempest-VolumesActionsTest-179111258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:50:11 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a7179790-4505-4a53-9b11-fd21926f513c tempest-VolumesActionsTest-179111258 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:50:11 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-a7179790-4505-4a53-9b11-fd21926f513c tempest-VolumesActionsTest-179111258 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:50:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a7179790-4505-4a53-9b11-fd21926f513c tempest-VolumesActionsTest-179111258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-fcddc254-5847-4e6d-a5ac-ea7eb42eb428 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0db22779-e6e5-4262-80c6-0fd84f956ad5 tempest-AttachVolumeNegativeTest-1896074937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fea6c9d7-71de-47e8-9c3c-f226cc14d6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd9e0b6f-45dd-4010-a166-945f272f8bc6', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0db22779-e6e5-4262-80c6-0fd84f956ad5 tempest-AttachVolumeNegativeTest-1896074937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0037019e-69b3-485d-b295-1798cee565fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:11 devstack sudo[94171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-fcddc254-5847-4e6d-a5ac-ea7eb42eb428 1073741824 Aug 10 12:50:11 devstack sudo[94171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-97f95f20-dd83-442c-b504-4c366ae9795a tempest-SnapshotsActionsTest-1433625484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.a9591630-5be4-46b8-bac5-6a0f5f4f328e" returned: 0 in 0.614s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:11 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-97f95f20-dd83-442c-b504-4c366ae9795a tempest-SnapshotsActionsTest-1433625484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47a545f2-fcfd-4d11-b960-6cf635b1520d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 12:50:11 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f235d1-9d82-4b64-96fb-3b6b2866c230]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:50:11 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-0db22779-e6e5-4262-80c6-0fd84f956ad5 tempest-AttachVolumeNegativeTest-1896074937 None] Volume volume-cd9e0b6f-45dd-4010-a166-945f272f8bc6 (cd9e0b6f-45dd-4010-a166-945f272f8bc6): created successfully Aug 10 12:50:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0db22779-e6e5-4262-80c6-0fd84f956ad5 tempest-AttachVolumeNegativeTest-1896074937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0037019e-69b3-485d-b295-1798cee565fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0db22779-e6e5-4262-80c6-0fd84f956ad5 tempest-AttachVolumeNegativeTest-1896074937 None] Flow 'volume_create_manager' (c7612c13-2dea-41e2-ab46-52dbccbd39c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:50:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-97f95f20-dd83-442c-b504-4c366ae9795a tempest-SnapshotsActionsTest-1433625484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:11 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-0db22779-e6e5-4262-80c6-0fd84f956ad5 tempest-AttachVolumeNegativeTest-1896074937 None] Created volume successfully. Aug 10 12:50:11 devstack sudo[94173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 Aug 10 12:50:11 devstack sudo[94173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:11 devstack sudo[94171]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a7179790-4505-4a53-9b11-fd21926f513c tempest-VolumesActionsTest-179111258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-fcddc254-5847-4e6d-a5ac-ea7eb42eb428 1073741824" returned: 0 in 0.536s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:11 devstack sudo[94173]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-97f95f20-dd83-442c-b504-4c366ae9795a tempest-SnapshotsActionsTest-1433625484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1" returned: 0 in 0.475s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:11 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-97f95f20-dd83-442c-b504-4c366ae9795a tempest-SnapshotsActionsTest-1433625484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47a545f2-fcfd-4d11-b960-6cf635b1520d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 12:50:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-97f95f20-dd83-442c-b504-4c366ae9795a tempest-SnapshotsActionsTest-1433625484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.a9591630-5be4-46b8-bac5-6a0f5f4f328e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:11 devstack sudo[94182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.a9591630-5be4-46b8-bac5-6a0f5f4f328e Aug 10 12:50:11 devstack sudo[94182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a7179790-4505-4a53-9b11-fd21926f513c tempest-VolumesActionsTest-179111258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-fcddc254-5847-4e6d-a5ac-ea7eb42eb428 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:11 devstack sudo[94184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-fcddc254-5847-4e6d-a5ac-ea7eb42eb428 Aug 10 12:50:11 devstack sudo[94184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:12 devstack sudo[94184]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a7179790-4505-4a53-9b11-fd21926f513c tempest-VolumesActionsTest-179111258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-fcddc254-5847-4e6d-a5ac-ea7eb42eb428" returned: 0 in 0.403s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:12 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a7179790-4505-4a53-9b11-fd21926f513c tempest-VolumesActionsTest-179111258 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:50:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a7179790-4505-4a53-9b11-fd21926f513c tempest-VolumesActionsTest-179111258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:50:12 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a7179790-4505-4a53-9b11-fd21926f513c tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27521705-cb84-4410-a593-27fad6bf6524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcddc254-5847-4e6d-a5ac-ea7eb42eb428', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:12 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a7179790-4505-4a53-9b11-fd21926f513c tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d58a9961-1880-4a56-aff9-910a9a0211e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:12 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-a7179790-4505-4a53-9b11-fd21926f513c tempest-VolumesActionsTest-179111258 None] Volume volume-fcddc254-5847-4e6d-a5ac-ea7eb42eb428 (fcddc254-5847-4e6d-a5ac-ea7eb42eb428): created successfully Aug 10 12:50:12 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a7179790-4505-4a53-9b11-fd21926f513c tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d58a9961-1880-4a56-aff9-910a9a0211e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:12 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a7179790-4505-4a53-9b11-fd21926f513c tempest-VolumesActionsTest-179111258 None] Flow 'volume_create_manager' (d48b1d4c-2542-4444-8669-ae0ce64656e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:50:12 devstack sudo[94182]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:12 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-a7179790-4505-4a53-9b11-fd21926f513c tempest-VolumesActionsTest-179111258 None] Created volume successfully. Aug 10 12:50:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-97f95f20-dd83-442c-b504-4c366ae9795a tempest-SnapshotsActionsTest-1433625484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.a9591630-5be4-46b8-bac5-6a0f5f4f328e" returned: 0 in 0.523s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-97f95f20-dd83-442c-b504-4c366ae9795a tempest-SnapshotsActionsTest-1433625484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.a9591630-5be4-46b8-bac5-6a0f5f4f328e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:12 devstack sudo[94196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.a9591630-5be4-46b8-bac5-6a0f5f4f328e Aug 10 12:50:12 devstack sudo[94196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:12 devstack sudo[94196]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-97f95f20-dd83-442c-b504-4c366ae9795a tempest-SnapshotsActionsTest-1433625484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.a9591630-5be4-46b8-bac5-6a0f5f4f328e" returned: 0 in 0.284s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:12 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-97f95f20-dd83-442c-b504-4c366ae9795a tempest-SnapshotsActionsTest-1433625484 None] Lock "cinder-quobyte-a9591630-5be4-46b8-bac5-6a0f5f4f328e" released by "_delete_snapshot" :: held 2.059s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:50:12 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-97f95f20-dd83-442c-b504-4c366ae9795a tempest-SnapshotsActionsTest-1433625484 None] Lock "cinder-quobyte-47a545f2-fcfd-4d11-b960-6cf635b1520d" released by "delete_snapshot" :: held 2.110s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:50:12 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-97f95f20-dd83-442c-b504-4c366ae9795a tempest-SnapshotsActionsTest-1433625484 None] Created reservations ['b0b93339-3496-4190-a9b0-acb1ece4d1c7', 'aca97afc-43c9-4ca7-8fae-39393d479f95', '0450c01c-946e-47fa-b67c-d735f636da05', '741165b5-1d77-488e-b1b5-5e5554760586'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:50:12 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-97f95f20-dd83-442c-b504-4c366ae9795a tempest-SnapshotsActionsTest-1433625484 None] Delete snapshot completed successfully. Aug 10 12:50:12 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-97f95f20-dd83-442c-b504-4c366ae9795a tempest-SnapshotsActionsTest-1433625484 None] Lock "cinder-a9591630-5be4-46b8-bac5-6a0f5f4f328e-delete_snapshot" released by "delete_snapshot" :: held 2.285s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:50:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-1d76421f-dcfc-46e9-9e23-251a8b1c8f13 req-37be2e5e-8a73-4e15-be9c-8fad2736f726 tempest-AttachVolumeNegativeTest-1896074937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:50:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-1d76421f-dcfc-46e9-9e23-251a8b1c8f13 req-37be2e5e-8a73-4e15-be9c-8fad2736f726 tempest-AttachVolumeNegativeTest-1896074937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:50:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-1d76421f-dcfc-46e9-9e23-251a8b1c8f13 req-37be2e5e-8a73-4e15-be9c-8fad2736f726 tempest-AttachVolumeNegativeTest-1896074937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:50:12 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-1d76421f-dcfc-46e9-9e23-251a8b1c8f13 req-37be2e5e-8a73-4e15-be9c-8fad2736f726 tempest-AttachVolumeNegativeTest-1896074937 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d', 'name': 'volume-cd9e0b6f-45dd-4010-a166-945f272f8bc6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '98c77a28-d10d-42e8-83cb-cf9a7e218850', 'enforce_multipath': True} {{(pid=89096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Aug 10 12:50:13 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-351b97ad-2778-48c4-a682-217c9954ee46 tempest-VolumesActionsTest-179111258 None] Acquiring lock "cinder-fcddc254-5847-4e6d-a5ac-ea7eb42eb428" by "attach_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:50:13 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-351b97ad-2778-48c4-a682-217c9954ee46 tempest-VolumesActionsTest-179111258 None] Lock "cinder-fcddc254-5847-4e6d-a5ac-ea7eb42eb428" acquired by "attach_volume" :: waited 0.034s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:50:13 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-1d76421f-dcfc-46e9-9e23-251a8b1c8f13 req-37be2e5e-8a73-4e15-be9c-8fad2736f726 tempest-AttachVolumeNegativeTest-1896074937 None] attachment_update completed successfully. Aug 10 12:50:13 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-351b97ad-2778-48c4-a682-217c9954ee46 tempest-VolumesActionsTest-179111258 None] Attaching volume fcddc254-5847-4e6d-a5ac-ea7eb42eb428 to instance f07b186a-55dd-40b4-9e7e-1a7b22c9dca3 at mountpoint /dev/vdb on host None. Aug 10 12:50:13 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-351b97ad-2778-48c4-a682-217c9954ee46 tempest-VolumesActionsTest-179111258 None] Attach volume completed successfully. Aug 10 12:50:13 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-351b97ad-2778-48c4-a682-217c9954ee46 tempest-VolumesActionsTest-179111258 None] Lock "cinder-fcddc254-5847-4e6d-a5ac-ea7eb42eb428" released by "attach_volume" :: held 0.131s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:50:13 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-0e1cb93b-22ee-4d28-8ba0-6842d8243065 tempest-VolumesActionsTest-378999174 None] Terminate volume connection completed successfully. Aug 10 12:50:13 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0e1cb93b-22ee-4d28-8ba0-6842d8243065 tempest-VolumesActionsTest-378999174 None] Acquiring lock "cinder-fcddc254-5847-4e6d-a5ac-ea7eb42eb428-detach_volume" by "detach_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:50:13 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0e1cb93b-22ee-4d28-8ba0-6842d8243065 tempest-VolumesActionsTest-378999174 None] Lock "cinder-fcddc254-5847-4e6d-a5ac-ea7eb42eb428-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:50:13 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-0e1cb93b-22ee-4d28-8ba0-6842d8243065 tempest-VolumesActionsTest-378999174 None] Detaching volume fcddc254-5847-4e6d-a5ac-ea7eb42eb428 from instance f07b186a-55dd-40b4-9e7e-1a7b22c9dca3. Aug 10 12:50:13 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-0e1cb93b-22ee-4d28-8ba0-6842d8243065 tempest-VolumesActionsTest-378999174 None] Detach volume completed successfully. Aug 10 12:50:13 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0e1cb93b-22ee-4d28-8ba0-6842d8243065 tempest-VolumesActionsTest-378999174 None] Lock "cinder-fcddc254-5847-4e6d-a5ac-ea7eb42eb428-detach_volume" released by "detach_volume" :: held 0.098s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:50:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6d065cfa-1225-440c-a8f8-cdae14c77144 tempest-SnapshotsActionsTest-452964465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:50:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6d065cfa-1225-440c-a8f8-cdae14c77144 tempest-SnapshotsActionsTest-452964465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:50:13 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-6d065cfa-1225-440c-a8f8-cdae14c77144 tempest-SnapshotsActionsTest-452964465 None] Creating offline snapshot f4e39542-b266-4b45-8194-f5b150037b03 of volume 47a545f2-fcfd-4d11-b960-6cf635b1520d {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 12:50:14 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e7065a-a0bc-4704-9bad-e2449487ebd0]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:50:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6d065cfa-1225-440c-a8f8-cdae14c77144 tempest-SnapshotsActionsTest-452964465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:14 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-6cf039e3-fb39-45e1-8ac9-e7760d302dc1 tempest-VolumesActionsTest-179111258 None] Acquiring lock "cinder-fcddc254-5847-4e6d-a5ac-ea7eb42eb428-detach_volume" by "detach_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:50:14 devstack sudo[94593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 Aug 10 12:50:14 devstack sudo[94593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:14 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-6cf039e3-fb39-45e1-8ac9-e7760d302dc1 tempest-VolumesActionsTest-179111258 None] Lock "cinder-fcddc254-5847-4e6d-a5ac-ea7eb42eb428-detach_volume" acquired by "detach_volume" :: waited 0.049s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:50:14 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-6cf039e3-fb39-45e1-8ac9-e7760d302dc1 tempest-VolumesActionsTest-179111258 None] Volume detach called, but volume not attached. Aug 10 12:50:14 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-6cf039e3-fb39-45e1-8ac9-e7760d302dc1 tempest-VolumesActionsTest-179111258 None] Lock "cinder-fcddc254-5847-4e6d-a5ac-ea7eb42eb428-detach_volume" released by "detach_volume" :: held 0.035s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:50:14 devstack sudo[94593]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6d065cfa-1225-440c-a8f8-cdae14c77144 tempest-SnapshotsActionsTest-452964465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1" returned: 0 in 0.443s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:14 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-6d065cfa-1225-440c-a8f8-cdae14c77144 tempest-SnapshotsActionsTest-452964465 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47a545f2-fcfd-4d11-b960-6cf635b1520d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 12:50:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6d065cfa-1225-440c-a8f8-cdae14c77144 tempest-SnapshotsActionsTest-452964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.f4e39542-b266-4b45-8194-f5b150037b03 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:14 devstack sudo[94599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.f4e39542-b266-4b45-8194-f5b150037b03 1G Aug 10 12:50:14 devstack sudo[94599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:14 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2d3dc920-b027-4226-a5c3-acfc7b7d5dfe tempest-VolumesActionsTest-179111258 None] Acquiring lock "cinder-fcddc254-5847-4e6d-a5ac-ea7eb42eb428-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:50:14 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2d3dc920-b027-4226-a5c3-acfc7b7d5dfe tempest-VolumesActionsTest-179111258 None] Lock "cinder-fcddc254-5847-4e6d-a5ac-ea7eb42eb428-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:50:14 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2d3dc920-b027-4226-a5c3-acfc7b7d5dfe tempest-VolumesActionsTest-179111258 None] Acquiring lock "cinder-quobyte-fcddc254-5847-4e6d-a5ac-ea7eb42eb428" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:50:14 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2d3dc920-b027-4226-a5c3-acfc7b7d5dfe tempest-VolumesActionsTest-179111258 None] Lock "cinder-quobyte-fcddc254-5847-4e6d-a5ac-ea7eb42eb428" acquired by "delete_volume" :: waited 0.028s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:50:14 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9ea168-26b1-4a0f-b533-c6226ea024ea]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:50:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2d3dc920-b027-4226-a5c3-acfc7b7d5dfe tempest-VolumesActionsTest-179111258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-fcddc254-5847-4e6d-a5ac-ea7eb42eb428 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:14 devstack sudo[94601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-fcddc254-5847-4e6d-a5ac-ea7eb42eb428 Aug 10 12:50:14 devstack sudo[94601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:15 devstack sudo[94599]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6d065cfa-1225-440c-a8f8-cdae14c77144 tempest-SnapshotsActionsTest-452964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.f4e39542-b266-4b45-8194-f5b150037b03 1G" returned: 0 in 0.505s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6d065cfa-1225-440c-a8f8-cdae14c77144 tempest-SnapshotsActionsTest-452964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.f4e39542-b266-4b45-8194-f5b150037b03 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:15 devstack sudo[94609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.f4e39542-b266-4b45-8194-f5b150037b03 Aug 10 12:50:15 devstack sudo[94609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:15 devstack sudo[94601]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2d3dc920-b027-4226-a5c3-acfc7b7d5dfe tempest-VolumesActionsTest-179111258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-fcddc254-5847-4e6d-a5ac-ea7eb42eb428" returned: 0 in 0.419s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2d3dc920-b027-4226-a5c3-acfc7b7d5dfe tempest-VolumesActionsTest-179111258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-fcddc254-5847-4e6d-a5ac-ea7eb42eb428 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:15 devstack sudo[94612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-fcddc254-5847-4e6d-a5ac-ea7eb42eb428 Aug 10 12:50:15 devstack sudo[94612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:15 devstack sudo[94612]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2d3dc920-b027-4226-a5c3-acfc7b7d5dfe tempest-VolumesActionsTest-179111258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-fcddc254-5847-4e6d-a5ac-ea7eb42eb428" returned: 0 in 0.314s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:15 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2d3dc920-b027-4226-a5c3-acfc7b7d5dfe tempest-VolumesActionsTest-179111258 None] Lock "cinder-quobyte-fcddc254-5847-4e6d-a5ac-ea7eb42eb428" released by "delete_volume" :: held 0.794s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:50:15 devstack sudo[94609]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6d065cfa-1225-440c-a8f8-cdae14c77144 tempest-SnapshotsActionsTest-452964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.f4e39542-b266-4b45-8194-f5b150037b03" returned: 0 in 0.484s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:15 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-6d065cfa-1225-440c-a8f8-cdae14c77144 tempest-SnapshotsActionsTest-452964465 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.f4e39542-b266-4b45-8194-f5b150037b03 is being set with open permissions: ugo+rw Aug 10 12:50:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6d065cfa-1225-440c-a8f8-cdae14c77144 tempest-SnapshotsActionsTest-452964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.f4e39542-b266-4b45-8194-f5b150037b03 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:15 devstack sudo[94618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.f4e39542-b266-4b45-8194-f5b150037b03 Aug 10 12:50:15 devstack sudo[94618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:15 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-2d3dc920-b027-4226-a5c3-acfc7b7d5dfe tempest-VolumesActionsTest-179111258 None] Created reservations ['c8b12a19-b492-4889-b238-bc06f8dfdc56', 'a5c2a4c0-5275-4b6e-876d-86742ac8c7b4', '6d1f68b8-5de5-422d-90ab-bfc627fea772', '7a84ff24-d80f-439d-9989-f22895677a25'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:50:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2d3dc920-b027-4226-a5c3-acfc7b7d5dfe tempest-VolumesActionsTest-179111258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:50:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2d3dc920-b027-4226-a5c3-acfc7b7d5dfe tempest-VolumesActionsTest-179111258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:50:15 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-2d3dc920-b027-4226-a5c3-acfc7b7d5dfe tempest-VolumesActionsTest-179111258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:50:15 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-2d3dc920-b027-4226-a5c3-acfc7b7d5dfe tempest-VolumesActionsTest-179111258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:50:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2d3dc920-b027-4226-a5c3-acfc7b7d5dfe tempest-VolumesActionsTest-179111258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:50:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2d3dc920-b027-4226-a5c3-acfc7b7d5dfe tempest-VolumesActionsTest-179111258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:15 devstack sudo[94620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:50:15 devstack sudo[94620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:16 devstack sudo[94618]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6d065cfa-1225-440c-a8f8-cdae14c77144 tempest-SnapshotsActionsTest-452964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.f4e39542-b266-4b45-8194-f5b150037b03" returned: 0 in 0.539s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6d065cfa-1225-440c-a8f8-cdae14c77144 tempest-SnapshotsActionsTest-452964465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.158s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:50:16 devstack sudo[94620]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2d3dc920-b027-4226-a5c3-acfc7b7d5dfe tempest-VolumesActionsTest-179111258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.477s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:16 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-2d3dc920-b027-4226-a5c3-acfc7b7d5dfe tempest-VolumesActionsTest-179111258 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:50:16 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-2d3dc920-b027-4226-a5c3-acfc7b7d5dfe tempest-VolumesActionsTest-179111258 None] Deleted volume successfully. Aug 10 12:50:16 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-6d065cfa-1225-440c-a8f8-cdae14c77144 tempest-SnapshotsActionsTest-452964465 None] Create snapshot completed successfully Aug 10 12:50:16 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2d3dc920-b027-4226-a5c3-acfc7b7d5dfe tempest-VolumesActionsTest-179111258 None] Lock "cinder-fcddc254-5847-4e6d-a5ac-ea7eb42eb428-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:50:17 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4182e6a0-ad22-415c-8975-550dd77bbdc4 tempest-SnapshotsActionsTest-1433625484 None] Acquiring lock "cinder-f4e39542-b266-4b45-8194-f5b150037b03-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:50:17 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4182e6a0-ad22-415c-8975-550dd77bbdc4 tempest-SnapshotsActionsTest-1433625484 None] Lock "cinder-f4e39542-b266-4b45-8194-f5b150037b03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:50:17 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4182e6a0-ad22-415c-8975-550dd77bbdc4 tempest-SnapshotsActionsTest-1433625484 None] Acquiring lock "cinder-quobyte-47a545f2-fcfd-4d11-b960-6cf635b1520d" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:50:17 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4182e6a0-ad22-415c-8975-550dd77bbdc4 tempest-SnapshotsActionsTest-1433625484 None] Lock "cinder-quobyte-47a545f2-fcfd-4d11-b960-6cf635b1520d" acquired by "delete_snapshot" :: waited 0.030s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:50:17 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4182e6a0-ad22-415c-8975-550dd77bbdc4 tempest-SnapshotsActionsTest-1433625484 None] Acquiring lock "cinder-quobyte-f4e39542-b266-4b45-8194-f5b150037b03" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:50:17 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4182e6a0-ad22-415c-8975-550dd77bbdc4 tempest-SnapshotsActionsTest-1433625484 None] Lock "cinder-quobyte-f4e39542-b266-4b45-8194-f5b150037b03" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:50:17 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-4182e6a0-ad22-415c-8975-550dd77bbdc4 tempest-SnapshotsActionsTest-1433625484 None] Deleting offline snapshot f4e39542-b266-4b45-8194-f5b150037b03 of volume 47a545f2-fcfd-4d11-b960-6cf635b1520d {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 12:50:17 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-4182e6a0-ad22-415c-8975-550dd77bbdc4 tempest-SnapshotsActionsTest-1433625484 None] snapshot_file for this snap is: volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.f4e39542-b266-4b45-8194-f5b150037b03 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 12:50:17 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[00eabb4a-41b3-4eb5-a8e3-f93b587bc03b]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:50:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4182e6a0-ad22-415c-8975-550dd77bbdc4 tempest-SnapshotsActionsTest-1433625484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.f4e39542-b266-4b45-8194-f5b150037b03 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:17 devstack sudo[94653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.f4e39542-b266-4b45-8194-f5b150037b03 Aug 10 12:50:17 devstack sudo[94653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:17 devstack sudo[94653]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4182e6a0-ad22-415c-8975-550dd77bbdc4 tempest-SnapshotsActionsTest-1433625484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.f4e39542-b266-4b45-8194-f5b150037b03" returned: 0 in 0.419s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:17 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-4182e6a0-ad22-415c-8975-550dd77bbdc4 tempest-SnapshotsActionsTest-1433625484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47a545f2-fcfd-4d11-b960-6cf635b1520d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 12:50:17 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e379d7-adb7-40bb-9cf7-440121e2dda7]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:50:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4182e6a0-ad22-415c-8975-550dd77bbdc4 tempest-SnapshotsActionsTest-1433625484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:18 devstack sudo[94659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 Aug 10 12:50:18 devstack sudo[94659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:18 devstack sudo[94659]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4182e6a0-ad22-415c-8975-550dd77bbdc4 tempest-SnapshotsActionsTest-1433625484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1" returned: 0 in 0.372s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:18 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-4182e6a0-ad22-415c-8975-550dd77bbdc4 tempest-SnapshotsActionsTest-1433625484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47a545f2-fcfd-4d11-b960-6cf635b1520d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 12:50:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4182e6a0-ad22-415c-8975-550dd77bbdc4 tempest-SnapshotsActionsTest-1433625484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.f4e39542-b266-4b45-8194-f5b150037b03 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:18 devstack sudo[94664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.f4e39542-b266-4b45-8194-f5b150037b03 Aug 10 12:50:18 devstack sudo[94664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:18 devstack sudo[94664]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4182e6a0-ad22-415c-8975-550dd77bbdc4 tempest-SnapshotsActionsTest-1433625484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.f4e39542-b266-4b45-8194-f5b150037b03" returned: 0 in 0.438s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4182e6a0-ad22-415c-8975-550dd77bbdc4 tempest-SnapshotsActionsTest-1433625484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.f4e39542-b266-4b45-8194-f5b150037b03 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:18 devstack sudo[94670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.f4e39542-b266-4b45-8194-f5b150037b03 Aug 10 12:50:18 devstack sudo[94670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:19 devstack sudo[94670]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4182e6a0-ad22-415c-8975-550dd77bbdc4 tempest-SnapshotsActionsTest-1433625484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.f4e39542-b266-4b45-8194-f5b150037b03" returned: 0 in 0.310s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:19 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4182e6a0-ad22-415c-8975-550dd77bbdc4 tempest-SnapshotsActionsTest-1433625484 None] Lock "cinder-quobyte-f4e39542-b266-4b45-8194-f5b150037b03" released by "_delete_snapshot" :: held 1.702s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:50:19 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4182e6a0-ad22-415c-8975-550dd77bbdc4 tempest-SnapshotsActionsTest-1433625484 None] Lock "cinder-quobyte-47a545f2-fcfd-4d11-b960-6cf635b1520d" released by "delete_snapshot" :: held 1.736s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:50:19 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c10983b-ee3f-411e-84dd-44cbb30c00e0 tempest-VolumesActionsTest-179111258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:50:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9c10983b-ee3f-411e-84dd-44cbb30c00e0 tempest-VolumesActionsTest-179111258 None] Flow 'volume_create_manager' (41534dc6-1bfd-4e63-92be-7fbb0fe44b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:50:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9c10983b-ee3f-411e-84dd-44cbb30c00e0 tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4e00f43-83bd-4866-a8bf-949b48342c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:19 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-4182e6a0-ad22-415c-8975-550dd77bbdc4 tempest-SnapshotsActionsTest-1433625484 None] Created reservations ['1bd4a155-cf95-41b4-8749-3ca887c5b68c', '0d6c3d18-08b4-43bc-8197-89fe4b8b47e2', 'bd376a29-1fdf-454e-980c-a75a6b8eeee7', '5f8fd806-d186-42d7-af6f-f228d9c4fb6b'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:50:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9c10983b-ee3f-411e-84dd-44cbb30c00e0 tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4e00f43-83bd-4866-a8bf-949b48342c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-534129618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b960c6b1-f4aa-4cd3-92bf-e3be556e9179,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b1a88657d7242f980aa06a66796beb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:50:19Z,use_quota=True,user_id='68c2f8894a8840b18f9a6c2af19ebb79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9c10983b-ee3f-411e-84dd-44cbb30c00e0 tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9843d94-f4f9-4b85-8179-5812bd016ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9c10983b-ee3f-411e-84dd-44cbb30c00e0 tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9843d94-f4f9-4b85-8179-5812bd016ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9c10983b-ee3f-411e-84dd-44cbb30c00e0 tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a8e8a53-a35e-4cbc-a8bc-edb43dd834be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9c10983b-ee3f-411e-84dd-44cbb30c00e0 tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a8e8a53-a35e-4cbc-a8bc-edb43dd834be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b960c6b1-f4aa-4cd3-92bf-e3be556e9179', 'volume_name': 'volume-b960c6b1-f4aa-4cd3-92bf-e3be556e9179', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9c10983b-ee3f-411e-84dd-44cbb30c00e0 tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b241fb8c-925b-4ea7-b54e-bc3d0197b41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9c10983b-ee3f-411e-84dd-44cbb30c00e0 tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b241fb8c-925b-4ea7-b54e-bc3d0197b41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9c10983b-ee3f-411e-84dd-44cbb30c00e0 tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9a294d6-4023-43f8-8da7-d4aaa4ea20b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:19 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-9c10983b-ee3f-411e-84dd-44cbb30c00e0 tempest-VolumesActionsTest-179111258 None] Volume b960c6b1-f4aa-4cd3-92bf-e3be556e9179: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b960c6b1-f4aa-4cd3-92bf-e3be556e9179', 'volume_size': 1} Aug 10 12:50:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9c10983b-ee3f-411e-84dd-44cbb30c00e0 tempest-VolumesActionsTest-179111258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:50:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9c10983b-ee3f-411e-84dd-44cbb30c00e0 tempest-VolumesActionsTest-179111258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:50:19 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9c10983b-ee3f-411e-84dd-44cbb30c00e0 tempest-VolumesActionsTest-179111258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-534129618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b960c6b1-f4aa-4cd3-92bf-e3be556e9179,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b1a88657d7242f980aa06a66796beb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:50:19Z,use_quota=True,user_id='68c2f8894a8840b18f9a6c2af19ebb79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:50:19 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-9c10983b-ee3f-411e-84dd-44cbb30c00e0 tempest-VolumesActionsTest-179111258 None] Creating volume b960c6b1-f4aa-4cd3-92bf-e3be556e9179 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:50:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9c10983b-ee3f-411e-84dd-44cbb30c00e0 tempest-VolumesActionsTest-179111258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:50:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9c10983b-ee3f-411e-84dd-44cbb30c00e0 tempest-VolumesActionsTest-179111258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:50:19 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9c10983b-ee3f-411e-84dd-44cbb30c00e0 tempest-VolumesActionsTest-179111258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:50:19 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9c10983b-ee3f-411e-84dd-44cbb30c00e0 tempest-VolumesActionsTest-179111258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:50:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9c10983b-ee3f-411e-84dd-44cbb30c00e0 tempest-VolumesActionsTest-179111258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:50:19 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9c10983b-ee3f-411e-84dd-44cbb30c00e0 tempest-VolumesActionsTest-179111258 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:50:19 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-9c10983b-ee3f-411e-84dd-44cbb30c00e0 tempest-VolumesActionsTest-179111258 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:50:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9c10983b-ee3f-411e-84dd-44cbb30c00e0 tempest-VolumesActionsTest-179111258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b960c6b1-f4aa-4cd3-92bf-e3be556e9179 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:19 devstack sudo[94677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b960c6b1-f4aa-4cd3-92bf-e3be556e9179 1073741824 Aug 10 12:50:19 devstack sudo[94677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:19 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-4182e6a0-ad22-415c-8975-550dd77bbdc4 tempest-SnapshotsActionsTest-1433625484 None] Delete snapshot completed successfully. Aug 10 12:50:19 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4182e6a0-ad22-415c-8975-550dd77bbdc4 tempest-SnapshotsActionsTest-1433625484 None] Lock "cinder-f4e39542-b266-4b45-8194-f5b150037b03-delete_snapshot" released by "delete_snapshot" :: held 2.040s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:50:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8dd13d67-855f-46a6-91ca-ee7a2c674a26 tempest-SnapshotsActionsTest-452964465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:50:19 devstack sudo[94677]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9c10983b-ee3f-411e-84dd-44cbb30c00e0 tempest-VolumesActionsTest-179111258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b960c6b1-f4aa-4cd3-92bf-e3be556e9179 1073741824" returned: 0 in 0.541s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9c10983b-ee3f-411e-84dd-44cbb30c00e0 tempest-VolumesActionsTest-179111258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b960c6b1-f4aa-4cd3-92bf-e3be556e9179 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:19 devstack sudo[94684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b960c6b1-f4aa-4cd3-92bf-e3be556e9179 Aug 10 12:50:19 devstack sudo[94684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:20 devstack sudo[94684]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9c10983b-ee3f-411e-84dd-44cbb30c00e0 tempest-VolumesActionsTest-179111258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b960c6b1-f4aa-4cd3-92bf-e3be556e9179" returned: 0 in 0.256s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:20 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9c10983b-ee3f-411e-84dd-44cbb30c00e0 tempest-VolumesActionsTest-179111258 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:50:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9c10983b-ee3f-411e-84dd-44cbb30c00e0 tempest-VolumesActionsTest-179111258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:50:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8dd13d67-855f-46a6-91ca-ee7a2c674a26 tempest-SnapshotsActionsTest-452964465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.328s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:50:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9c10983b-ee3f-411e-84dd-44cbb30c00e0 tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9a294d6-4023-43f8-8da7-d4aaa4ea20b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b960c6b1-f4aa-4cd3-92bf-e3be556e9179', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9c10983b-ee3f-411e-84dd-44cbb30c00e0 tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e9d1d4c-0000-4157-bb9d-e687c1577d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:20 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-8dd13d67-855f-46a6-91ca-ee7a2c674a26 tempest-SnapshotsActionsTest-452964465 None] Creating offline snapshot 5a6fbc2a-0c5b-4444-8280-592134edb3a3 of volume 47a545f2-fcfd-4d11-b960-6cf635b1520d {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 12:50:20 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-9c10983b-ee3f-411e-84dd-44cbb30c00e0 tempest-VolumesActionsTest-179111258 None] Volume volume-b960c6b1-f4aa-4cd3-92bf-e3be556e9179 (b960c6b1-f4aa-4cd3-92bf-e3be556e9179): created successfully Aug 10 12:50:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9c10983b-ee3f-411e-84dd-44cbb30c00e0 tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e9d1d4c-0000-4157-bb9d-e687c1577d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9c10983b-ee3f-411e-84dd-44cbb30c00e0 tempest-VolumesActionsTest-179111258 None] Flow 'volume_create_manager' (41534dc6-1bfd-4e63-92be-7fbb0fe44b0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:50:20 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b767e65-6e18-4032-af17-84a69ddf93d6]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:50:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8dd13d67-855f-46a6-91ca-ee7a2c674a26 tempest-SnapshotsActionsTest-452964465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:20 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-9c10983b-ee3f-411e-84dd-44cbb30c00e0 tempest-VolumesActionsTest-179111258 None] Created volume successfully. Aug 10 12:50:20 devstack sudo[94688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 Aug 10 12:50:20 devstack sudo[94688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:20 devstack sudo[94688]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8dd13d67-855f-46a6-91ca-ee7a2c674a26 tempest-SnapshotsActionsTest-452964465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1" returned: 0 in 0.562s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:20 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-8dd13d67-855f-46a6-91ca-ee7a2c674a26 tempest-SnapshotsActionsTest-452964465 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47a545f2-fcfd-4d11-b960-6cf635b1520d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 12:50:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8dd13d67-855f-46a6-91ca-ee7a2c674a26 tempest-SnapshotsActionsTest-452964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a6fbc2a-0c5b-4444-8280-592134edb3a3 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:20 devstack sudo[94730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a6fbc2a-0c5b-4444-8280-592134edb3a3 1G Aug 10 12:50:20 devstack sudo[94730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:21 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0227a215-fe24-4692-aa9a-3dbc6a2907a5 tempest-VolumesActionsTest-378999174 None] Acquiring lock "cinder-b960c6b1-f4aa-4cd3-92bf-e3be556e9179-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:50:21 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0227a215-fe24-4692-aa9a-3dbc6a2907a5 tempest-VolumesActionsTest-378999174 None] Lock "cinder-b960c6b1-f4aa-4cd3-92bf-e3be556e9179-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:50:21 devstack sudo[94730]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8dd13d67-855f-46a6-91ca-ee7a2c674a26 tempest-SnapshotsActionsTest-452964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a6fbc2a-0c5b-4444-8280-592134edb3a3 1G" returned: 0 in 0.744s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8dd13d67-855f-46a6-91ca-ee7a2c674a26 tempest-SnapshotsActionsTest-452964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a6fbc2a-0c5b-4444-8280-592134edb3a3 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:21 devstack sudo[94753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a6fbc2a-0c5b-4444-8280-592134edb3a3 Aug 10 12:50:21 devstack sudo[94753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:21 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0227a215-fe24-4692-aa9a-3dbc6a2907a5 tempest-VolumesActionsTest-378999174 None] Acquiring lock "cinder-quobyte-b960c6b1-f4aa-4cd3-92bf-e3be556e9179" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:50:21 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0227a215-fe24-4692-aa9a-3dbc6a2907a5 tempest-VolumesActionsTest-378999174 None] Lock "cinder-quobyte-b960c6b1-f4aa-4cd3-92bf-e3be556e9179" acquired by "delete_volume" :: waited 0.015s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:50:21 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47d4989-abf5-4218-8388-f9ed62a0ef82]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:50:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0227a215-fe24-4692-aa9a-3dbc6a2907a5 tempest-VolumesActionsTest-378999174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b960c6b1-f4aa-4cd3-92bf-e3be556e9179 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:21 devstack sudo[94755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b960c6b1-f4aa-4cd3-92bf-e3be556e9179 Aug 10 12:50:21 devstack sudo[94755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:21 devstack sudo[94753]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8dd13d67-855f-46a6-91ca-ee7a2c674a26 tempest-SnapshotsActionsTest-452964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a6fbc2a-0c5b-4444-8280-592134edb3a3" returned: 0 in 0.351s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:21 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-8dd13d67-855f-46a6-91ca-ee7a2c674a26 tempest-SnapshotsActionsTest-452964465 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a6fbc2a-0c5b-4444-8280-592134edb3a3 is being set with open permissions: ugo+rw Aug 10 12:50:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8dd13d67-855f-46a6-91ca-ee7a2c674a26 tempest-SnapshotsActionsTest-452964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a6fbc2a-0c5b-4444-8280-592134edb3a3 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:21 devstack sudo[94760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a6fbc2a-0c5b-4444-8280-592134edb3a3 Aug 10 12:50:21 devstack sudo[94760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:22 devstack sudo[94755]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0227a215-fe24-4692-aa9a-3dbc6a2907a5 tempest-VolumesActionsTest-378999174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b960c6b1-f4aa-4cd3-92bf-e3be556e9179" returned: 0 in 0.394s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0227a215-fe24-4692-aa9a-3dbc6a2907a5 tempest-VolumesActionsTest-378999174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b960c6b1-f4aa-4cd3-92bf-e3be556e9179 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:22 devstack sudo[94765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b960c6b1-f4aa-4cd3-92bf-e3be556e9179 Aug 10 12:50:22 devstack sudo[94765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:22 devstack sudo[94760]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8dd13d67-855f-46a6-91ca-ee7a2c674a26 tempest-SnapshotsActionsTest-452964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a6fbc2a-0c5b-4444-8280-592134edb3a3" returned: 0 in 0.272s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8dd13d67-855f-46a6-91ca-ee7a2c674a26 tempest-SnapshotsActionsTest-452964465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.083s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:50:22 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-8dd13d67-855f-46a6-91ca-ee7a2c674a26 tempest-SnapshotsActionsTest-452964465 None] Create snapshot completed successfully Aug 10 12:50:22 devstack sudo[94765]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0227a215-fe24-4692-aa9a-3dbc6a2907a5 tempest-VolumesActionsTest-378999174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b960c6b1-f4aa-4cd3-92bf-e3be556e9179" returned: 0 in 0.259s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:22 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0227a215-fe24-4692-aa9a-3dbc6a2907a5 tempest-VolumesActionsTest-378999174 None] Lock "cinder-quobyte-b960c6b1-f4aa-4cd3-92bf-e3be556e9179" released by "delete_volume" :: held 0.704s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:50:22 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-0227a215-fe24-4692-aa9a-3dbc6a2907a5 tempest-VolumesActionsTest-378999174 None] Created reservations ['eda076a5-0e70-48df-92cb-26f3625dc28c', '5e779a7e-afe7-44c2-8375-906747b18a0e', '7298d351-7c1b-4217-b5ae-1ebbfb8f199a', '52716909-8624-4052-a36a-c0c9bf966cb5'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:50:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0227a215-fe24-4692-aa9a-3dbc6a2907a5 tempest-VolumesActionsTest-378999174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:50:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0227a215-fe24-4692-aa9a-3dbc6a2907a5 tempest-VolumesActionsTest-378999174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:50:22 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0227a215-fe24-4692-aa9a-3dbc6a2907a5 tempest-VolumesActionsTest-378999174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:50:22 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0227a215-fe24-4692-aa9a-3dbc6a2907a5 tempest-VolumesActionsTest-378999174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:50:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0227a215-fe24-4692-aa9a-3dbc6a2907a5 tempest-VolumesActionsTest-378999174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:50:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0227a215-fe24-4692-aa9a-3dbc6a2907a5 tempest-VolumesActionsTest-378999174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:22 devstack sudo[94769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:50:22 devstack sudo[94769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:22 devstack sudo[94769]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0227a215-fe24-4692-aa9a-3dbc6a2907a5 tempest-VolumesActionsTest-378999174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.285s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:22 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-0227a215-fe24-4692-aa9a-3dbc6a2907a5 tempest-VolumesActionsTest-378999174 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:50:22 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-0227a215-fe24-4692-aa9a-3dbc6a2907a5 tempest-VolumesActionsTest-378999174 None] Deleted volume successfully. Aug 10 12:50:22 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0227a215-fe24-4692-aa9a-3dbc6a2907a5 tempest-VolumesActionsTest-378999174 None] Lock "cinder-b960c6b1-f4aa-4cd3-92bf-e3be556e9179-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:50:23 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a4bcd513-9f6c-47d4-bc0b-de291f52e922 tempest-SnapshotsActionsTest-1433625484 None] Acquiring lock "cinder-5a6fbc2a-0c5b-4444-8280-592134edb3a3-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:50:23 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a4bcd513-9f6c-47d4-bc0b-de291f52e922 tempest-SnapshotsActionsTest-1433625484 None] Lock "cinder-5a6fbc2a-0c5b-4444-8280-592134edb3a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:50:23 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a4bcd513-9f6c-47d4-bc0b-de291f52e922 tempest-SnapshotsActionsTest-1433625484 None] Acquiring lock "cinder-quobyte-47a545f2-fcfd-4d11-b960-6cf635b1520d" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:50:23 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a4bcd513-9f6c-47d4-bc0b-de291f52e922 tempest-SnapshotsActionsTest-1433625484 None] Lock "cinder-quobyte-47a545f2-fcfd-4d11-b960-6cf635b1520d" acquired by "delete_snapshot" :: waited 0.034s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:50:23 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a4bcd513-9f6c-47d4-bc0b-de291f52e922 tempest-SnapshotsActionsTest-1433625484 None] Acquiring lock "cinder-quobyte-5a6fbc2a-0c5b-4444-8280-592134edb3a3" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:50:23 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a4bcd513-9f6c-47d4-bc0b-de291f52e922 tempest-SnapshotsActionsTest-1433625484 None] Lock "cinder-quobyte-5a6fbc2a-0c5b-4444-8280-592134edb3a3" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:50:23 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-a4bcd513-9f6c-47d4-bc0b-de291f52e922 tempest-SnapshotsActionsTest-1433625484 None] Deleting offline snapshot 5a6fbc2a-0c5b-4444-8280-592134edb3a3 of volume 47a545f2-fcfd-4d11-b960-6cf635b1520d {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 12:50:23 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-a4bcd513-9f6c-47d4-bc0b-de291f52e922 tempest-SnapshotsActionsTest-1433625484 None] snapshot_file for this snap is: volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a6fbc2a-0c5b-4444-8280-592134edb3a3 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 12:50:23 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9459b3-ac19-41c5-a541-7a4c5a853914]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:50:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a4bcd513-9f6c-47d4-bc0b-de291f52e922 tempest-SnapshotsActionsTest-1433625484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a6fbc2a-0c5b-4444-8280-592134edb3a3 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:23 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-5240c836-a338-4ef8-874b-cc9b9c05c606 tempest-VolumesActionsTest-179111258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:50:23 devstack sudo[94778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a6fbc2a-0c5b-4444-8280-592134edb3a3 Aug 10 12:50:23 devstack sudo[94778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:23 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5240c836-a338-4ef8-874b-cc9b9c05c606 tempest-VolumesActionsTest-179111258 None] Flow 'volume_create_manager' (5b52b406-70dc-48f7-bb32-042e98f6bdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:50:23 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5240c836-a338-4ef8-874b-cc9b9c05c606 tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (721bddbb-69bf-47e5-8799-c186028d1cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:23 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5240c836-a338-4ef8-874b-cc9b9c05c606 tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (721bddbb-69bf-47e5-8799-c186028d1cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:50:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-111014392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12417d57-406a-4455-8d78-0d8bbb34d83a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b1a88657d7242f980aa06a66796beb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:50:23Z,use_quota=True,user_id='68c2f8894a8840b18f9a6c2af19ebb79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:23 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5240c836-a338-4ef8-874b-cc9b9c05c606 tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28bacefd-9393-4561-8ad7-3cbb450aed0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:23 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5240c836-a338-4ef8-874b-cc9b9c05c606 tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28bacefd-9393-4561-8ad7-3cbb450aed0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:23 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5240c836-a338-4ef8-874b-cc9b9c05c606 tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (280fb542-27e7-4015-865e-01fead56f369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:23 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5240c836-a338-4ef8-874b-cc9b9c05c606 tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (280fb542-27e7-4015-865e-01fead56f369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12417d57-406a-4455-8d78-0d8bbb34d83a', 'volume_name': 'volume-12417d57-406a-4455-8d78-0d8bbb34d83a', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:23 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5240c836-a338-4ef8-874b-cc9b9c05c606 tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa24c8e5-44da-45a2-b60d-30cb78ee995c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:23 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5240c836-a338-4ef8-874b-cc9b9c05c606 tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa24c8e5-44da-45a2-b60d-30cb78ee995c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:23 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5240c836-a338-4ef8-874b-cc9b9c05c606 tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b530926a-e9c3-4eee-965b-4412ec70fd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:23 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-5240c836-a338-4ef8-874b-cc9b9c05c606 tempest-VolumesActionsTest-179111258 None] Volume 12417d57-406a-4455-8d78-0d8bbb34d83a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12417d57-406a-4455-8d78-0d8bbb34d83a', 'volume_size': 1} Aug 10 12:50:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5240c836-a338-4ef8-874b-cc9b9c05c606 tempest-VolumesActionsTest-179111258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:50:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5240c836-a338-4ef8-874b-cc9b9c05c606 tempest-VolumesActionsTest-179111258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:50:23 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-5240c836-a338-4ef8-874b-cc9b9c05c606 tempest-VolumesActionsTest-179111258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:50:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-111014392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12417d57-406a-4455-8d78-0d8bbb34d83a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b1a88657d7242f980aa06a66796beb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:50:23Z,use_quota=True,user_id='68c2f8894a8840b18f9a6c2af19ebb79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:50:23 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-5240c836-a338-4ef8-874b-cc9b9c05c606 tempest-VolumesActionsTest-179111258 None] Creating volume 12417d57-406a-4455-8d78-0d8bbb34d83a {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:50:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5240c836-a338-4ef8-874b-cc9b9c05c606 tempest-VolumesActionsTest-179111258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:50:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5240c836-a338-4ef8-874b-cc9b9c05c606 tempest-VolumesActionsTest-179111258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:50:23 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-5240c836-a338-4ef8-874b-cc9b9c05c606 tempest-VolumesActionsTest-179111258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:50:23 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-5240c836-a338-4ef8-874b-cc9b9c05c606 tempest-VolumesActionsTest-179111258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:50:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5240c836-a338-4ef8-874b-cc9b9c05c606 tempest-VolumesActionsTest-179111258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:50:23 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-5240c836-a338-4ef8-874b-cc9b9c05c606 tempest-VolumesActionsTest-179111258 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:50:23 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-5240c836-a338-4ef8-874b-cc9b9c05c606 tempest-VolumesActionsTest-179111258 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:50:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5240c836-a338-4ef8-874b-cc9b9c05c606 tempest-VolumesActionsTest-179111258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-12417d57-406a-4455-8d78-0d8bbb34d83a 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:23 devstack sudo[94799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-12417d57-406a-4455-8d78-0d8bbb34d83a 1073741824 Aug 10 12:50:23 devstack sudo[94799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:23 devstack sudo[94778]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a4bcd513-9f6c-47d4-bc0b-de291f52e922 tempest-SnapshotsActionsTest-1433625484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a6fbc2a-0c5b-4444-8280-592134edb3a3" returned: 0 in 0.651s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:23 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-a4bcd513-9f6c-47d4-bc0b-de291f52e922 tempest-SnapshotsActionsTest-1433625484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47a545f2-fcfd-4d11-b960-6cf635b1520d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 12:50:24 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8682486-8be1-4235-8796-28566429a791]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:50:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a4bcd513-9f6c-47d4-bc0b-de291f52e922 tempest-SnapshotsActionsTest-1433625484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:24 devstack sudo[94813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 Aug 10 12:50:24 devstack sudo[94813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:24 devstack sudo[94799]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5240c836-a338-4ef8-874b-cc9b9c05c606 tempest-VolumesActionsTest-179111258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-12417d57-406a-4455-8d78-0d8bbb34d83a 1073741824" returned: 0 in 0.656s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5240c836-a338-4ef8-874b-cc9b9c05c606 tempest-VolumesActionsTest-179111258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-12417d57-406a-4455-8d78-0d8bbb34d83a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:24 devstack sudo[94824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-12417d57-406a-4455-8d78-0d8bbb34d83a Aug 10 12:50:24 devstack sudo[94824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:24 devstack sudo[94813]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a4bcd513-9f6c-47d4-bc0b-de291f52e922 tempest-SnapshotsActionsTest-1433625484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1" returned: 0 in 0.521s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:24 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-a4bcd513-9f6c-47d4-bc0b-de291f52e922 tempest-SnapshotsActionsTest-1433625484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47a545f2-fcfd-4d11-b960-6cf635b1520d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 12:50:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a4bcd513-9f6c-47d4-bc0b-de291f52e922 tempest-SnapshotsActionsTest-1433625484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a6fbc2a-0c5b-4444-8280-592134edb3a3 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:24 devstack sudo[94835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a6fbc2a-0c5b-4444-8280-592134edb3a3 Aug 10 12:50:24 devstack sudo[94835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:24 devstack sudo[94824]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5240c836-a338-4ef8-874b-cc9b9c05c606 tempest-VolumesActionsTest-179111258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-12417d57-406a-4455-8d78-0d8bbb34d83a" returned: 0 in 0.287s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:24 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-5240c836-a338-4ef8-874b-cc9b9c05c606 tempest-VolumesActionsTest-179111258 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:50:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5240c836-a338-4ef8-874b-cc9b9c05c606 tempest-VolumesActionsTest-179111258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:50:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5240c836-a338-4ef8-874b-cc9b9c05c606 tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b530926a-e9c3-4eee-965b-4412ec70fd7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12417d57-406a-4455-8d78-0d8bbb34d83a', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5240c836-a338-4ef8-874b-cc9b9c05c606 tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f07bb8b-28b4-42b9-b8cb-383f15e580e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:24 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-5240c836-a338-4ef8-874b-cc9b9c05c606 tempest-VolumesActionsTest-179111258 None] Volume volume-12417d57-406a-4455-8d78-0d8bbb34d83a (12417d57-406a-4455-8d78-0d8bbb34d83a): created successfully Aug 10 12:50:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5240c836-a338-4ef8-874b-cc9b9c05c606 tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f07bb8b-28b4-42b9-b8cb-383f15e580e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5240c836-a338-4ef8-874b-cc9b9c05c606 tempest-VolumesActionsTest-179111258 None] Flow 'volume_create_manager' (5b52b406-70dc-48f7-bb32-042e98f6bdfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:50:24 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-5240c836-a338-4ef8-874b-cc9b9c05c606 tempest-VolumesActionsTest-179111258 None] Created volume successfully. Aug 10 12:50:24 devstack sudo[94835]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a4bcd513-9f6c-47d4-bc0b-de291f52e922 tempest-SnapshotsActionsTest-1433625484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a6fbc2a-0c5b-4444-8280-592134edb3a3" returned: 0 in 0.410s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a4bcd513-9f6c-47d4-bc0b-de291f52e922 tempest-SnapshotsActionsTest-1433625484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a6fbc2a-0c5b-4444-8280-592134edb3a3 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:24 devstack sudo[94855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a6fbc2a-0c5b-4444-8280-592134edb3a3 Aug 10 12:50:24 devstack sudo[94855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:25 devstack sudo[94855]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a4bcd513-9f6c-47d4-bc0b-de291f52e922 tempest-SnapshotsActionsTest-1433625484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a6fbc2a-0c5b-4444-8280-592134edb3a3" returned: 0 in 0.259s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a4bcd513-9f6c-47d4-bc0b-de291f52e922 tempest-SnapshotsActionsTest-1433625484 None] Lock "cinder-quobyte-5a6fbc2a-0c5b-4444-8280-592134edb3a3" released by "_delete_snapshot" :: held 2.013s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:50:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a4bcd513-9f6c-47d4-bc0b-de291f52e922 tempest-SnapshotsActionsTest-1433625484 None] Lock "cinder-quobyte-47a545f2-fcfd-4d11-b960-6cf635b1520d" released by "delete_snapshot" :: held 2.055s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:50:25 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-a4bcd513-9f6c-47d4-bc0b-de291f52e922 tempest-SnapshotsActionsTest-1433625484 None] Created reservations ['83d35f1c-62de-4136-960a-6f22666f65a2', '6b3792fd-4750-47fe-bfb8-f4030fe1e992', '544b4bcb-4ab3-42d9-ba97-3131f077f097', '1358fbae-2479-43ca-906d-7a16576e4eb6'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:50:25 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-a4bcd513-9f6c-47d4-bc0b-de291f52e922 tempest-SnapshotsActionsTest-1433625484 None] Delete snapshot completed successfully. Aug 10 12:50:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a4bcd513-9f6c-47d4-bc0b-de291f52e922 tempest-SnapshotsActionsTest-1433625484 None] Lock "cinder-5a6fbc2a-0c5b-4444-8280-592134edb3a3-delete_snapshot" released by "delete_snapshot" :: held 2.273s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:50:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7df0b567-a044-4a2e-80b1-fcfa62c92fd9 tempest-VolumesActionsTest-378999174 None] Acquiring lock "cinder-12417d57-406a-4455-8d78-0d8bbb34d83a-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:50:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7df0b567-a044-4a2e-80b1-fcfa62c92fd9 tempest-VolumesActionsTest-378999174 None] Lock "cinder-12417d57-406a-4455-8d78-0d8bbb34d83a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:50:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7df0b567-a044-4a2e-80b1-fcfa62c92fd9 tempest-VolumesActionsTest-378999174 None] Acquiring lock "cinder-quobyte-12417d57-406a-4455-8d78-0d8bbb34d83a" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:50:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7df0b567-a044-4a2e-80b1-fcfa62c92fd9 tempest-VolumesActionsTest-378999174 None] Lock "cinder-quobyte-12417d57-406a-4455-8d78-0d8bbb34d83a" acquired by "delete_volume" :: waited 0.027s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:50:25 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[45046d70-c573-48c6-b1d8-afc891d0028e]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:50:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7df0b567-a044-4a2e-80b1-fcfa62c92fd9 tempest-VolumesActionsTest-378999174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-12417d57-406a-4455-8d78-0d8bbb34d83a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:25 devstack sudo[94860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-12417d57-406a-4455-8d78-0d8bbb34d83a Aug 10 12:50:25 devstack sudo[94860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:26 devstack sudo[94860]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7df0b567-a044-4a2e-80b1-fcfa62c92fd9 tempest-VolumesActionsTest-378999174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-12417d57-406a-4455-8d78-0d8bbb34d83a" returned: 0 in 0.459s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7df0b567-a044-4a2e-80b1-fcfa62c92fd9 tempest-VolumesActionsTest-378999174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-12417d57-406a-4455-8d78-0d8bbb34d83a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:26 devstack sudo[94866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-12417d57-406a-4455-8d78-0d8bbb34d83a Aug 10 12:50:26 devstack sudo[94866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:26 devstack sudo[94866]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7df0b567-a044-4a2e-80b1-fcfa62c92fd9 tempest-VolumesActionsTest-378999174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-12417d57-406a-4455-8d78-0d8bbb34d83a" returned: 0 in 0.284s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:26 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7df0b567-a044-4a2e-80b1-fcfa62c92fd9 tempest-VolumesActionsTest-378999174 None] Lock "cinder-quobyte-12417d57-406a-4455-8d78-0d8bbb34d83a" released by "delete_volume" :: held 0.809s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:50:26 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-7df0b567-a044-4a2e-80b1-fcfa62c92fd9 tempest-VolumesActionsTest-378999174 None] Created reservations ['b81adfbd-f08c-4f62-a463-6c7750db8ddb', 'dbfe54f5-6154-42f4-a94c-3ebdb78b194f', '72c491b6-c395-43b3-8a12-bded16e56ab0', 'fce9eaa0-71a2-4612-b2f5-8bb845ccc88d'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:50:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7df0b567-a044-4a2e-80b1-fcfa62c92fd9 tempest-VolumesActionsTest-378999174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:50:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7df0b567-a044-4a2e-80b1-fcfa62c92fd9 tempest-VolumesActionsTest-378999174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:50:26 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-7df0b567-a044-4a2e-80b1-fcfa62c92fd9 tempest-VolumesActionsTest-378999174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:50:26 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-7df0b567-a044-4a2e-80b1-fcfa62c92fd9 tempest-VolumesActionsTest-378999174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:50:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7df0b567-a044-4a2e-80b1-fcfa62c92fd9 tempest-VolumesActionsTest-378999174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:50:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7df0b567-a044-4a2e-80b1-fcfa62c92fd9 tempest-VolumesActionsTest-378999174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:26 devstack sudo[94869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:50:26 devstack sudo[94869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-273be8a5-32f3-455a-968b-479e2c1ac7d7 tempest-SnapshotsActionsTest-452964465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:50:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-273be8a5-32f3-455a-968b-479e2c1ac7d7 tempest-SnapshotsActionsTest-452964465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:50:26 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-273be8a5-32f3-455a-968b-479e2c1ac7d7 tempest-SnapshotsActionsTest-452964465 None] Creating offline snapshot 5a45ad78-02c5-477b-bac0-e55ccbb610d9 of volume 47a545f2-fcfd-4d11-b960-6cf635b1520d {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 12:50:27 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da5c6ef-a59f-4eb8-8edf-a86aa08c9250]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:50:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-273be8a5-32f3-455a-968b-479e2c1ac7d7 tempest-SnapshotsActionsTest-452964465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:27 devstack sudo[94869]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7df0b567-a044-4a2e-80b1-fcfa62c92fd9 tempest-VolumesActionsTest-378999174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.452s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:27 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-7df0b567-a044-4a2e-80b1-fcfa62c92fd9 tempest-VolumesActionsTest-378999174 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:50:27 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-7df0b567-a044-4a2e-80b1-fcfa62c92fd9 tempest-VolumesActionsTest-378999174 None] Deleted volume successfully. Aug 10 12:50:27 devstack sudo[94872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 Aug 10 12:50:27 devstack sudo[94872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:27 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7df0b567-a044-4a2e-80b1-fcfa62c92fd9 tempest-VolumesActionsTest-378999174 None] Lock "cinder-12417d57-406a-4455-8d78-0d8bbb34d83a-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:50:27 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-81600a3a-4ab7-4029-8f13-96c970221e8d tempest-VolumesActionsTest-179111258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:50:27 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81600a3a-4ab7-4029-8f13-96c970221e8d tempest-VolumesActionsTest-179111258 None] Flow 'volume_create_manager' (a748c460-3050-4283-9afb-ae040fca09b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:50:27 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81600a3a-4ab7-4029-8f13-96c970221e8d tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1638cfb-7073-41e3-9e4d-9d50cb21b11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:27 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81600a3a-4ab7-4029-8f13-96c970221e8d tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1638cfb-7073-41e3-9e4d-9d50cb21b11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-22275904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae7b7c4b-2ee9-4655-8b25-32b39c71c55d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b1a88657d7242f980aa06a66796beb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:50:27Z,use_quota=True,user_id='68c2f8894a8840b18f9a6c2af19ebb79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:27 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81600a3a-4ab7-4029-8f13-96c970221e8d tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cf22182-5609-40f3-af71-dbba9d24cfcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:27 devstack sudo[94872]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:27 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81600a3a-4ab7-4029-8f13-96c970221e8d tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cf22182-5609-40f3-af71-dbba9d24cfcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:27 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81600a3a-4ab7-4029-8f13-96c970221e8d tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16790ae5-b7f9-42e6-b0ab-8cd8f2c4bfca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:27 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81600a3a-4ab7-4029-8f13-96c970221e8d tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16790ae5-b7f9-42e6-b0ab-8cd8f2c4bfca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae7b7c4b-2ee9-4655-8b25-32b39c71c55d', 'volume_name': 'volume-ae7b7c4b-2ee9-4655-8b25-32b39c71c55d', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:27 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81600a3a-4ab7-4029-8f13-96c970221e8d tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24825aaa-fa24-4076-b647-6e12a0f32486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:27 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81600a3a-4ab7-4029-8f13-96c970221e8d tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24825aaa-fa24-4076-b647-6e12a0f32486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:27 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81600a3a-4ab7-4029-8f13-96c970221e8d tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e99ab14-6dae-4984-8689-96986aaf3e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:27 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-81600a3a-4ab7-4029-8f13-96c970221e8d tempest-VolumesActionsTest-179111258 None] Volume ae7b7c4b-2ee9-4655-8b25-32b39c71c55d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae7b7c4b-2ee9-4655-8b25-32b39c71c55d', 'volume_size': 1} Aug 10 12:50:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-81600a3a-4ab7-4029-8f13-96c970221e8d tempest-VolumesActionsTest-179111258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:50:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-273be8a5-32f3-455a-968b-479e2c1ac7d7 tempest-SnapshotsActionsTest-452964465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1" returned: 0 in 0.623s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:27 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-273be8a5-32f3-455a-968b-479e2c1ac7d7 tempest-SnapshotsActionsTest-452964465 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47a545f2-fcfd-4d11-b960-6cf635b1520d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 12:50:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-273be8a5-32f3-455a-968b-479e2c1ac7d7 tempest-SnapshotsActionsTest-452964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a45ad78-02c5-477b-bac0-e55ccbb610d9 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:27 devstack sudo[94877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a45ad78-02c5-477b-bac0-e55ccbb610d9 1G Aug 10 12:50:27 devstack sudo[94877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:28 devstack sudo[94877]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-273be8a5-32f3-455a-968b-479e2c1ac7d7 tempest-SnapshotsActionsTest-452964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a45ad78-02c5-477b-bac0-e55ccbb610d9 1G" returned: 0 in 0.533s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-273be8a5-32f3-455a-968b-479e2c1ac7d7 tempest-SnapshotsActionsTest-452964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a45ad78-02c5-477b-bac0-e55ccbb610d9 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:28 devstack sudo[94885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a45ad78-02c5-477b-bac0-e55ccbb610d9 Aug 10 12:50:28 devstack sudo[94885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:28 devstack sudo[94885]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-273be8a5-32f3-455a-968b-479e2c1ac7d7 tempest-SnapshotsActionsTest-452964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a45ad78-02c5-477b-bac0-e55ccbb610d9" returned: 0 in 0.389s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:28 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-273be8a5-32f3-455a-968b-479e2c1ac7d7 tempest-SnapshotsActionsTest-452964465 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a45ad78-02c5-477b-bac0-e55ccbb610d9 is being set with open permissions: ugo+rw Aug 10 12:50:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-273be8a5-32f3-455a-968b-479e2c1ac7d7 tempest-SnapshotsActionsTest-452964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a45ad78-02c5-477b-bac0-e55ccbb610d9 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:28 devstack sudo[94892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a45ad78-02c5-477b-bac0-e55ccbb610d9 Aug 10 12:50:28 devstack sudo[94892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:28 devstack sudo[94892]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-273be8a5-32f3-455a-968b-479e2c1ac7d7 tempest-SnapshotsActionsTest-452964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a45ad78-02c5-477b-bac0-e55ccbb610d9" returned: 0 in 0.253s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-273be8a5-32f3-455a-968b-479e2c1ac7d7 tempest-SnapshotsActionsTest-452964465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.974s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:50:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-81600a3a-4ab7-4029-8f13-96c970221e8d tempest-VolumesActionsTest-179111258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.222s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:50:28 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-81600a3a-4ab7-4029-8f13-96c970221e8d tempest-VolumesActionsTest-179111258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-22275904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae7b7c4b-2ee9-4655-8b25-32b39c71c55d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b1a88657d7242f980aa06a66796beb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:50:27Z,use_quota=True,user_id='68c2f8894a8840b18f9a6c2af19ebb79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:50:28 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-81600a3a-4ab7-4029-8f13-96c970221e8d tempest-VolumesActionsTest-179111258 None] Creating volume ae7b7c4b-2ee9-4655-8b25-32b39c71c55d {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:50:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-81600a3a-4ab7-4029-8f13-96c970221e8d tempest-VolumesActionsTest-179111258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:50:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-81600a3a-4ab7-4029-8f13-96c970221e8d tempest-VolumesActionsTest-179111258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:50:28 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-81600a3a-4ab7-4029-8f13-96c970221e8d tempest-VolumesActionsTest-179111258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:50:28 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-81600a3a-4ab7-4029-8f13-96c970221e8d tempest-VolumesActionsTest-179111258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:50:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-81600a3a-4ab7-4029-8f13-96c970221e8d tempest-VolumesActionsTest-179111258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:50:28 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-81600a3a-4ab7-4029-8f13-96c970221e8d tempest-VolumesActionsTest-179111258 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:50:28 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-81600a3a-4ab7-4029-8f13-96c970221e8d tempest-VolumesActionsTest-179111258 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:50:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-81600a3a-4ab7-4029-8f13-96c970221e8d tempest-VolumesActionsTest-179111258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ae7b7c4b-2ee9-4655-8b25-32b39c71c55d 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:28 devstack sudo[94895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ae7b7c4b-2ee9-4655-8b25-32b39c71c55d 1073741824 Aug 10 12:50:28 devstack sudo[94895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:28 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-273be8a5-32f3-455a-968b-479e2c1ac7d7 tempest-SnapshotsActionsTest-452964465 None] Create snapshot completed successfully Aug 10 12:50:29 devstack sudo[94895]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-81600a3a-4ab7-4029-8f13-96c970221e8d tempest-VolumesActionsTest-179111258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ae7b7c4b-2ee9-4655-8b25-32b39c71c55d 1073741824" returned: 0 in 0.444s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-81600a3a-4ab7-4029-8f13-96c970221e8d tempest-VolumesActionsTest-179111258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ae7b7c4b-2ee9-4655-8b25-32b39c71c55d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:29 devstack sudo[94901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ae7b7c4b-2ee9-4655-8b25-32b39c71c55d Aug 10 12:50:29 devstack sudo[94901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:29 devstack sudo[94901]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-81600a3a-4ab7-4029-8f13-96c970221e8d tempest-VolumesActionsTest-179111258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ae7b7c4b-2ee9-4655-8b25-32b39c71c55d" returned: 0 in 0.248s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:29 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-81600a3a-4ab7-4029-8f13-96c970221e8d tempest-VolumesActionsTest-179111258 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:50:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-81600a3a-4ab7-4029-8f13-96c970221e8d tempest-VolumesActionsTest-179111258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:50:29 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81600a3a-4ab7-4029-8f13-96c970221e8d tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e99ab14-6dae-4984-8689-96986aaf3e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae7b7c4b-2ee9-4655-8b25-32b39c71c55d', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:29 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81600a3a-4ab7-4029-8f13-96c970221e8d tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe772aae-4e27-4a9d-aef3-336fdd952e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:29 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-81600a3a-4ab7-4029-8f13-96c970221e8d tempest-VolumesActionsTest-179111258 None] Volume volume-ae7b7c4b-2ee9-4655-8b25-32b39c71c55d (ae7b7c4b-2ee9-4655-8b25-32b39c71c55d): created successfully Aug 10 12:50:29 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81600a3a-4ab7-4029-8f13-96c970221e8d tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe772aae-4e27-4a9d-aef3-336fdd952e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:29 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81600a3a-4ab7-4029-8f13-96c970221e8d tempest-VolumesActionsTest-179111258 None] Flow 'volume_create_manager' (a748c460-3050-4283-9afb-ae040fca09b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:50:29 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-81600a3a-4ab7-4029-8f13-96c970221e8d tempest-VolumesActionsTest-179111258 None] Created volume successfully. Aug 10 12:50:30 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-1d47f89e-400d-4733-b291-89c9d10fc01b tempest-SnapshotsActionsTest-1433625484 None] Acquiring lock "cinder-5a45ad78-02c5-477b-bac0-e55ccbb610d9-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:50:30 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-1d47f89e-400d-4733-b291-89c9d10fc01b tempest-SnapshotsActionsTest-1433625484 None] Lock "cinder-5a45ad78-02c5-477b-bac0-e55ccbb610d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:50:30 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-1d47f89e-400d-4733-b291-89c9d10fc01b tempest-SnapshotsActionsTest-1433625484 None] Acquiring lock "cinder-quobyte-47a545f2-fcfd-4d11-b960-6cf635b1520d" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:50:30 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-1d47f89e-400d-4733-b291-89c9d10fc01b tempest-SnapshotsActionsTest-1433625484 None] Lock "cinder-quobyte-47a545f2-fcfd-4d11-b960-6cf635b1520d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:50:30 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-1d47f89e-400d-4733-b291-89c9d10fc01b tempest-SnapshotsActionsTest-1433625484 None] Acquiring lock "cinder-quobyte-5a45ad78-02c5-477b-bac0-e55ccbb610d9" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:50:30 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-1d47f89e-400d-4733-b291-89c9d10fc01b tempest-SnapshotsActionsTest-1433625484 None] Lock "cinder-quobyte-5a45ad78-02c5-477b-bac0-e55ccbb610d9" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:50:30 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-1d47f89e-400d-4733-b291-89c9d10fc01b tempest-SnapshotsActionsTest-1433625484 None] Deleting offline snapshot 5a45ad78-02c5-477b-bac0-e55ccbb610d9 of volume 47a545f2-fcfd-4d11-b960-6cf635b1520d {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 12:50:30 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-1d47f89e-400d-4733-b291-89c9d10fc01b tempest-SnapshotsActionsTest-1433625484 None] snapshot_file for this snap is: volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a45ad78-02c5-477b-bac0-e55ccbb610d9 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 12:50:30 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[048f0bc9-e40d-493a-8385-a97b91826755]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:50:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1d47f89e-400d-4733-b291-89c9d10fc01b tempest-SnapshotsActionsTest-1433625484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a45ad78-02c5-477b-bac0-e55ccbb610d9 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:30 devstack sudo[94904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a45ad78-02c5-477b-bac0-e55ccbb610d9 Aug 10 12:50:30 devstack sudo[94904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:30 devstack sudo[94904]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1d47f89e-400d-4733-b291-89c9d10fc01b tempest-SnapshotsActionsTest-1433625484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a45ad78-02c5-477b-bac0-e55ccbb610d9" returned: 0 in 0.366s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:30 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-1d47f89e-400d-4733-b291-89c9d10fc01b tempest-SnapshotsActionsTest-1433625484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47a545f2-fcfd-4d11-b960-6cf635b1520d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 12:50:30 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1ab001-93bc-41ea-8f37-b11fd3f4454c]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:50:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1d47f89e-400d-4733-b291-89c9d10fc01b tempest-SnapshotsActionsTest-1433625484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:30 devstack sudo[94909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 Aug 10 12:50:30 devstack sudo[94909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:30 devstack sudo[94909]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1d47f89e-400d-4733-b291-89c9d10fc01b tempest-SnapshotsActionsTest-1433625484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1" returned: 0 in 0.378s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:30 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-1d47f89e-400d-4733-b291-89c9d10fc01b tempest-SnapshotsActionsTest-1433625484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47a545f2-fcfd-4d11-b960-6cf635b1520d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 12:50:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1d47f89e-400d-4733-b291-89c9d10fc01b tempest-SnapshotsActionsTest-1433625484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a45ad78-02c5-477b-bac0-e55ccbb610d9 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:31 devstack sudo[94915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a45ad78-02c5-477b-bac0-e55ccbb610d9 Aug 10 12:50:31 devstack sudo[94915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:31 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-bd283572-2952-4002-966b-91007335b25b tempest-VolumesActionsTest-378999174 None] Acquiring lock "cinder-ae7b7c4b-2ee9-4655-8b25-32b39c71c55d-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:50:31 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-bd283572-2952-4002-966b-91007335b25b tempest-VolumesActionsTest-378999174 None] Lock "cinder-ae7b7c4b-2ee9-4655-8b25-32b39c71c55d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:50:31 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-bd283572-2952-4002-966b-91007335b25b tempest-VolumesActionsTest-378999174 None] Acquiring lock "cinder-quobyte-ae7b7c4b-2ee9-4655-8b25-32b39c71c55d" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:50:31 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-bd283572-2952-4002-966b-91007335b25b tempest-VolumesActionsTest-378999174 None] Lock "cinder-quobyte-ae7b7c4b-2ee9-4655-8b25-32b39c71c55d" acquired by "delete_volume" :: waited 0.029s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:50:31 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[5978d4f6-7804-4b08-9318-0003677f9eb1]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:50:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-bd283572-2952-4002-966b-91007335b25b tempest-VolumesActionsTest-378999174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ae7b7c4b-2ee9-4655-8b25-32b39c71c55d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:31 devstack sudo[94917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ae7b7c4b-2ee9-4655-8b25-32b39c71c55d Aug 10 12:50:31 devstack sudo[94917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:31 devstack sudo[94915]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1d47f89e-400d-4733-b291-89c9d10fc01b tempest-SnapshotsActionsTest-1433625484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a45ad78-02c5-477b-bac0-e55ccbb610d9" returned: 0 in 0.477s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1d47f89e-400d-4733-b291-89c9d10fc01b tempest-SnapshotsActionsTest-1433625484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a45ad78-02c5-477b-bac0-e55ccbb610d9 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:31 devstack sudo[94922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a45ad78-02c5-477b-bac0-e55ccbb610d9 Aug 10 12:50:31 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:31 devstack sudo[94917]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-bd283572-2952-4002-966b-91007335b25b tempest-VolumesActionsTest-378999174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ae7b7c4b-2ee9-4655-8b25-32b39c71c55d" returned: 0 in 0.392s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-bd283572-2952-4002-966b-91007335b25b tempest-VolumesActionsTest-378999174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ae7b7c4b-2ee9-4655-8b25-32b39c71c55d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:31 devstack sudo[94927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ae7b7c4b-2ee9-4655-8b25-32b39c71c55d Aug 10 12:50:31 devstack sudo[94927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:31 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1d47f89e-400d-4733-b291-89c9d10fc01b tempest-SnapshotsActionsTest-1433625484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.5a45ad78-02c5-477b-bac0-e55ccbb610d9" returned: 0 in 0.281s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:31 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-1d47f89e-400d-4733-b291-89c9d10fc01b tempest-SnapshotsActionsTest-1433625484 None] Lock "cinder-quobyte-5a45ad78-02c5-477b-bac0-e55ccbb610d9" released by "_delete_snapshot" :: held 1.615s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:50:31 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-1d47f89e-400d-4733-b291-89c9d10fc01b tempest-SnapshotsActionsTest-1433625484 None] Lock "cinder-quobyte-47a545f2-fcfd-4d11-b960-6cf635b1520d" released by "delete_snapshot" :: held 1.644s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:50:31 devstack sudo[94927]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-bd283572-2952-4002-966b-91007335b25b tempest-VolumesActionsTest-378999174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ae7b7c4b-2ee9-4655-8b25-32b39c71c55d" returned: 0 in 0.260s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:31 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-1d47f89e-400d-4733-b291-89c9d10fc01b tempest-SnapshotsActionsTest-1433625484 None] Created reservations ['4e11c1b6-c3eb-4826-9771-ba29e000c669', 'cea0359c-e624-44c9-9278-b523ccdc30c9', '97908d48-4c9d-4ed3-a604-f58daa0fc867', 'c73362f1-b3b6-4612-8d43-4a6a20ba2c6d'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:50:31 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-bd283572-2952-4002-966b-91007335b25b tempest-VolumesActionsTest-378999174 None] Lock "cinder-quobyte-ae7b7c4b-2ee9-4655-8b25-32b39c71c55d" released by "delete_volume" :: held 0.712s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:50:31 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-1d47f89e-400d-4733-b291-89c9d10fc01b tempest-SnapshotsActionsTest-1433625484 None] Delete snapshot completed successfully. Aug 10 12:50:31 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-1d47f89e-400d-4733-b291-89c9d10fc01b tempest-SnapshotsActionsTest-1433625484 None] Lock "cinder-5a45ad78-02c5-477b-bac0-e55ccbb610d9-delete_snapshot" released by "delete_snapshot" :: held 1.827s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:50:31 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-bd283572-2952-4002-966b-91007335b25b tempest-VolumesActionsTest-378999174 None] Created reservations ['e2fabd7f-ca4a-4c4a-a26e-fa904e36d285', 'db4bfcc3-eff5-497b-92d0-0693f8fc99e7', '5bc314bb-bbe2-4a7f-87d4-c46c4ff533b9', '25f95243-8a0c-4412-ade9-0a43930828c7'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:50:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-bd283572-2952-4002-966b-91007335b25b tempest-VolumesActionsTest-378999174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:50:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-bd283572-2952-4002-966b-91007335b25b tempest-VolumesActionsTest-378999174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:50:32 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-bd283572-2952-4002-966b-91007335b25b tempest-VolumesActionsTest-378999174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:50:32 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-bd283572-2952-4002-966b-91007335b25b tempest-VolumesActionsTest-378999174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:50:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-bd283572-2952-4002-966b-91007335b25b tempest-VolumesActionsTest-378999174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:50:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-bd283572-2952-4002-966b-91007335b25b tempest-VolumesActionsTest-378999174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:32 devstack sudo[94931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:50:32 devstack sudo[94931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:32 devstack sudo[94931]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-bd283572-2952-4002-966b-91007335b25b tempest-VolumesActionsTest-378999174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.309s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:32 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-bd283572-2952-4002-966b-91007335b25b tempest-VolumesActionsTest-378999174 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:50:32 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-bd283572-2952-4002-966b-91007335b25b tempest-VolumesActionsTest-378999174 None] Deleted volume successfully. Aug 10 12:50:32 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-bd283572-2952-4002-966b-91007335b25b tempest-VolumesActionsTest-378999174 None] Lock "cinder-ae7b7c4b-2ee9-4655-8b25-32b39c71c55d-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:50:32 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b6b5fbfc-4a1b-403c-9444-7f5f5b403ad5 tempest-SnapshotsActionsTest-452964465 None] Acquiring lock "cinder-ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:50:32 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b6b5fbfc-4a1b-403c-9444-7f5f5b403ad5 tempest-SnapshotsActionsTest-452964465 None] Lock "cinder-ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:50:32 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b6b5fbfc-4a1b-403c-9444-7f5f5b403ad5 tempest-SnapshotsActionsTest-452964465 None] Acquiring lock "cinder-quobyte-47a545f2-fcfd-4d11-b960-6cf635b1520d" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:50:32 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-73790456-6d4b-4284-ad82-0d2081e86cdd tempest-VolumesActionsTest-179111258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:50:32 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-73790456-6d4b-4284-ad82-0d2081e86cdd tempest-VolumesActionsTest-179111258 None] Flow 'volume_create_manager' (58e4da06-9543-4b22-afb6-17de3b4d3a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:50:32 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-73790456-6d4b-4284-ad82-0d2081e86cdd tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33d95dec-7953-4545-8814-5c452092979c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:32 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b6b5fbfc-4a1b-403c-9444-7f5f5b403ad5 tempest-SnapshotsActionsTest-452964465 None] Lock "cinder-quobyte-47a545f2-fcfd-4d11-b960-6cf635b1520d" acquired by "delete_snapshot" :: waited 0.049s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:50:32 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b6b5fbfc-4a1b-403c-9444-7f5f5b403ad5 tempest-SnapshotsActionsTest-452964465 None] Acquiring lock "cinder-quobyte-ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:50:32 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-73790456-6d4b-4284-ad82-0d2081e86cdd tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33d95dec-7953-4545-8814-5c452092979c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-75441435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eba1731b-5bc3-4dec-86e1-7a0f97d7e606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b1a88657d7242f980aa06a66796beb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:50:33Z,use_quota=True,user_id='68c2f8894a8840b18f9a6c2af19ebb79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:32 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-73790456-6d4b-4284-ad82-0d2081e86cdd tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c48db4-4055-4c5e-8faf-8053276ef081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:32 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-73790456-6d4b-4284-ad82-0d2081e86cdd tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c48db4-4055-4c5e-8faf-8053276ef081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:32 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-73790456-6d4b-4284-ad82-0d2081e86cdd tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1a169c-8878-4e95-aeee-4da6a2b55e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:32 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-73790456-6d4b-4284-ad82-0d2081e86cdd tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1a169c-8878-4e95-aeee-4da6a2b55e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eba1731b-5bc3-4dec-86e1-7a0f97d7e606', 'volume_name': 'volume-eba1731b-5bc3-4dec-86e1-7a0f97d7e606', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:32 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-73790456-6d4b-4284-ad82-0d2081e86cdd tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f052ad3-3d6d-428c-b746-0d8eee5fb1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:32 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-73790456-6d4b-4284-ad82-0d2081e86cdd tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f052ad3-3d6d-428c-b746-0d8eee5fb1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:32 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-73790456-6d4b-4284-ad82-0d2081e86cdd tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d169c4e9-b8e4-4f38-a8b3-e3973529f3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:32 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-73790456-6d4b-4284-ad82-0d2081e86cdd tempest-VolumesActionsTest-179111258 None] Volume eba1731b-5bc3-4dec-86e1-7a0f97d7e606: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eba1731b-5bc3-4dec-86e1-7a0f97d7e606', 'volume_size': 1} Aug 10 12:50:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-73790456-6d4b-4284-ad82-0d2081e86cdd tempest-VolumesActionsTest-179111258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:50:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-73790456-6d4b-4284-ad82-0d2081e86cdd tempest-VolumesActionsTest-179111258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:50:32 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-73790456-6d4b-4284-ad82-0d2081e86cdd tempest-VolumesActionsTest-179111258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-75441435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eba1731b-5bc3-4dec-86e1-7a0f97d7e606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b1a88657d7242f980aa06a66796beb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:50:33Z,use_quota=True,user_id='68c2f8894a8840b18f9a6c2af19ebb79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:50:32 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-73790456-6d4b-4284-ad82-0d2081e86cdd tempest-VolumesActionsTest-179111258 None] Creating volume eba1731b-5bc3-4dec-86e1-7a0f97d7e606 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:50:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-73790456-6d4b-4284-ad82-0d2081e86cdd tempest-VolumesActionsTest-179111258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:50:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-73790456-6d4b-4284-ad82-0d2081e86cdd tempest-VolumesActionsTest-179111258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:50:32 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-73790456-6d4b-4284-ad82-0d2081e86cdd tempest-VolumesActionsTest-179111258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:50:32 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-73790456-6d4b-4284-ad82-0d2081e86cdd tempest-VolumesActionsTest-179111258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:50:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-73790456-6d4b-4284-ad82-0d2081e86cdd tempest-VolumesActionsTest-179111258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:50:32 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-73790456-6d4b-4284-ad82-0d2081e86cdd tempest-VolumesActionsTest-179111258 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:50:32 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-73790456-6d4b-4284-ad82-0d2081e86cdd tempest-VolumesActionsTest-179111258 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:50:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-73790456-6d4b-4284-ad82-0d2081e86cdd tempest-VolumesActionsTest-179111258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-eba1731b-5bc3-4dec-86e1-7a0f97d7e606 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:32 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b6b5fbfc-4a1b-403c-9444-7f5f5b403ad5 tempest-SnapshotsActionsTest-452964465 None] Lock "cinder-quobyte-ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1" acquired by "_delete_snapshot" :: waited 0.073s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:50:32 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-b6b5fbfc-4a1b-403c-9444-7f5f5b403ad5 tempest-SnapshotsActionsTest-452964465 None] Deleting offline snapshot ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 of volume 47a545f2-fcfd-4d11-b960-6cf635b1520d {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 12:50:32 devstack sudo[94934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-eba1731b-5bc3-4dec-86e1-7a0f97d7e606 1073741824 Aug 10 12:50:32 devstack sudo[94934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:33 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-b6b5fbfc-4a1b-403c-9444-7f5f5b403ad5 tempest-SnapshotsActionsTest-452964465 None] snapshot_file for this snap is: volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 12:50:33 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[271df43f-1c14-4321-911e-1c2a832f1686]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:50:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b6b5fbfc-4a1b-403c-9444-7f5f5b403ad5 tempest-SnapshotsActionsTest-452964465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:33 devstack sudo[94936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 Aug 10 12:50:33 devstack sudo[94936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:33 devstack sudo[94934]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-73790456-6d4b-4284-ad82-0d2081e86cdd tempest-VolumesActionsTest-179111258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-eba1731b-5bc3-4dec-86e1-7a0f97d7e606 1073741824" returned: 0 in 0.456s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:33 devstack sudo[94936]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b6b5fbfc-4a1b-403c-9444-7f5f5b403ad5 tempest-SnapshotsActionsTest-452964465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1" returned: 0 in 0.424s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:33 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-b6b5fbfc-4a1b-403c-9444-7f5f5b403ad5 tempest-SnapshotsActionsTest-452964465 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47a545f2-fcfd-4d11-b960-6cf635b1520d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 12:50:33 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c350e8-8a6b-4c6e-9ff0-ea3980d29b39]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:50:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b6b5fbfc-4a1b-403c-9444-7f5f5b403ad5 tempest-SnapshotsActionsTest-452964465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-73790456-6d4b-4284-ad82-0d2081e86cdd tempest-VolumesActionsTest-179111258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-eba1731b-5bc3-4dec-86e1-7a0f97d7e606 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:33 devstack sudo[94970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-eba1731b-5bc3-4dec-86e1-7a0f97d7e606 Aug 10 12:50:33 devstack sudo[94970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:33 devstack sudo[94969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d Aug 10 12:50:33 devstack sudo[94969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:33 devstack sudo[94970]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-73790456-6d4b-4284-ad82-0d2081e86cdd tempest-VolumesActionsTest-179111258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-eba1731b-5bc3-4dec-86e1-7a0f97d7e606" returned: 0 in 0.301s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:33 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-73790456-6d4b-4284-ad82-0d2081e86cdd tempest-VolumesActionsTest-179111258 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:50:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-73790456-6d4b-4284-ad82-0d2081e86cdd tempest-VolumesActionsTest-179111258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:50:33 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-73790456-6d4b-4284-ad82-0d2081e86cdd tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d169c4e9-b8e4-4f38-a8b3-e3973529f3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eba1731b-5bc3-4dec-86e1-7a0f97d7e606', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:33 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-73790456-6d4b-4284-ad82-0d2081e86cdd tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a785a18e-be74-448f-86ce-b91601f31c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:33 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-73790456-6d4b-4284-ad82-0d2081e86cdd tempest-VolumesActionsTest-179111258 None] Volume volume-eba1731b-5bc3-4dec-86e1-7a0f97d7e606 (eba1731b-5bc3-4dec-86e1-7a0f97d7e606): created successfully Aug 10 12:50:33 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-73790456-6d4b-4284-ad82-0d2081e86cdd tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a785a18e-be74-448f-86ce-b91601f31c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:33 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-73790456-6d4b-4284-ad82-0d2081e86cdd tempest-VolumesActionsTest-179111258 None] Flow 'volume_create_manager' (58e4da06-9543-4b22-afb6-17de3b4d3a88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:50:33 devstack sudo[94969]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:33 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-73790456-6d4b-4284-ad82-0d2081e86cdd tempest-VolumesActionsTest-179111258 None] Created volume successfully. Aug 10 12:50:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b6b5fbfc-4a1b-403c-9444-7f5f5b403ad5 tempest-SnapshotsActionsTest-452964465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d" returned: 0 in 0.399s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b6b5fbfc-4a1b-403c-9444-7f5f5b403ad5 tempest-SnapshotsActionsTest-452964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:33 devstack sudo[94977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 Aug 10 12:50:33 devstack sudo[94977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:34 devstack sudo[94977]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b6b5fbfc-4a1b-403c-9444-7f5f5b403ad5 tempest-SnapshotsActionsTest-452964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1" returned: 0 in 0.347s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b6b5fbfc-4a1b-403c-9444-7f5f5b403ad5 tempest-SnapshotsActionsTest-452964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:34 devstack sudo[94983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1 Aug 10 12:50:34 devstack sudo[94983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:34 devstack sudo[94983]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b6b5fbfc-4a1b-403c-9444-7f5f5b403ad5 tempest-SnapshotsActionsTest-452964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d.ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1" returned: 0 in 0.267s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:34 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b6b5fbfc-4a1b-403c-9444-7f5f5b403ad5 tempest-SnapshotsActionsTest-452964465 None] Lock "cinder-quobyte-ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1" released by "_delete_snapshot" :: held 1.557s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:50:34 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b6b5fbfc-4a1b-403c-9444-7f5f5b403ad5 tempest-SnapshotsActionsTest-452964465 None] Lock "cinder-quobyte-47a545f2-fcfd-4d11-b960-6cf635b1520d" released by "delete_snapshot" :: held 1.641s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:50:34 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-b6b5fbfc-4a1b-403c-9444-7f5f5b403ad5 tempest-SnapshotsActionsTest-452964465 None] Created reservations ['5203c0a2-2112-4c02-84da-aab30b17b59b', '7688a699-800f-402a-be44-632ad8822ec0', '561c9340-a0ce-499e-ab96-e6c4a8df8d03', '5ae48109-fda3-4c0d-81cf-0fa296b16f5f'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:50:34 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-b6b5fbfc-4a1b-403c-9444-7f5f5b403ad5 tempest-SnapshotsActionsTest-452964465 None] Delete snapshot completed successfully. Aug 10 12:50:34 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b6b5fbfc-4a1b-403c-9444-7f5f5b403ad5 tempest-SnapshotsActionsTest-452964465 None] Lock "cinder-ce0ce8d6-0b5c-435c-8767-d0ed167ce5f1-delete_snapshot" released by "delete_snapshot" :: held 1.818s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:50:35 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f5e6a13b-1f47-4b51-91fb-58c9c76d120f tempest-VolumesActionsTest-378999174 None] Acquiring lock "cinder-eba1731b-5bc3-4dec-86e1-7a0f97d7e606-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:50:35 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f5e6a13b-1f47-4b51-91fb-58c9c76d120f tempest-VolumesActionsTest-378999174 None] Lock "cinder-eba1731b-5bc3-4dec-86e1-7a0f97d7e606-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:50:35 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c731a280-21a7-468e-b2f0-1faed5c56da2 tempest-SnapshotsActionsTest-452964465 None] Acquiring lock "cinder-47a545f2-fcfd-4d11-b960-6cf635b1520d-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:50:35 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c731a280-21a7-468e-b2f0-1faed5c56da2 tempest-SnapshotsActionsTest-452964465 None] Lock "cinder-47a545f2-fcfd-4d11-b960-6cf635b1520d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:50:35 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f5e6a13b-1f47-4b51-91fb-58c9c76d120f tempest-VolumesActionsTest-378999174 None] Acquiring lock "cinder-quobyte-eba1731b-5bc3-4dec-86e1-7a0f97d7e606" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:50:35 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f5e6a13b-1f47-4b51-91fb-58c9c76d120f tempest-VolumesActionsTest-378999174 None] Lock "cinder-quobyte-eba1731b-5bc3-4dec-86e1-7a0f97d7e606" acquired by "delete_volume" :: waited 0.039s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:50:35 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c731a280-21a7-468e-b2f0-1faed5c56da2 tempest-SnapshotsActionsTest-452964465 None] Acquiring lock "cinder-quobyte-47a545f2-fcfd-4d11-b960-6cf635b1520d" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:50:35 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c731a280-21a7-468e-b2f0-1faed5c56da2 tempest-SnapshotsActionsTest-452964465 None] Lock "cinder-quobyte-47a545f2-fcfd-4d11-b960-6cf635b1520d" acquired by "delete_volume" :: waited 0.017s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:50:35 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[22783e34-f3ae-4e41-b83c-c23987cf62ac]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:50:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f5e6a13b-1f47-4b51-91fb-58c9c76d120f tempest-VolumesActionsTest-378999174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-eba1731b-5bc3-4dec-86e1-7a0f97d7e606 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:35 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55cc0e6-c93b-4511-8b30-a1b82bf9f524]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:50:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c731a280-21a7-468e-b2f0-1faed5c56da2 tempest-SnapshotsActionsTest-452964465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:35 devstack sudo[94986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-eba1731b-5bc3-4dec-86e1-7a0f97d7e606 Aug 10 12:50:35 devstack sudo[94986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:35 devstack sudo[94987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d Aug 10 12:50:35 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:35 devstack sudo[94986]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f5e6a13b-1f47-4b51-91fb-58c9c76d120f tempest-VolumesActionsTest-378999174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-eba1731b-5bc3-4dec-86e1-7a0f97d7e606" returned: 0 in 0.374s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f5e6a13b-1f47-4b51-91fb-58c9c76d120f tempest-VolumesActionsTest-378999174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-eba1731b-5bc3-4dec-86e1-7a0f97d7e606 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:35 devstack sudo[94996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-eba1731b-5bc3-4dec-86e1-7a0f97d7e606 Aug 10 12:50:35 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:35 devstack sudo[94996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c731a280-21a7-468e-b2f0-1faed5c56da2 tempest-SnapshotsActionsTest-452964465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d" returned: 0 in 0.396s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c731a280-21a7-468e-b2f0-1faed5c56da2 tempest-SnapshotsActionsTest-452964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:35 devstack sudo[94998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d Aug 10 12:50:35 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:35 devstack sudo[94996]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f5e6a13b-1f47-4b51-91fb-58c9c76d120f tempest-VolumesActionsTest-378999174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-eba1731b-5bc3-4dec-86e1-7a0f97d7e606" returned: 0 in 0.261s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:35 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f5e6a13b-1f47-4b51-91fb-58c9c76d120f tempest-VolumesActionsTest-378999174 None] Lock "cinder-quobyte-eba1731b-5bc3-4dec-86e1-7a0f97d7e606" released by "delete_volume" :: held 0.709s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:50:35 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c731a280-21a7-468e-b2f0-1faed5c56da2 tempest-SnapshotsActionsTest-452964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-47a545f2-fcfd-4d11-b960-6cf635b1520d" returned: 0 in 0.278s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:35 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c731a280-21a7-468e-b2f0-1faed5c56da2 tempest-SnapshotsActionsTest-452964465 None] Lock "cinder-quobyte-47a545f2-fcfd-4d11-b960-6cf635b1520d" released by "delete_volume" :: held 0.746s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:50:35 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-f5e6a13b-1f47-4b51-91fb-58c9c76d120f tempest-VolumesActionsTest-378999174 None] Created reservations ['366c4b7d-27b0-4001-9cdc-c4fe9da305ed', 'fdf0f096-e9e9-46b7-a61c-ca0ecde247ac', '2704103c-a555-4051-807c-140d7e3bc4a6', '6f5e8ae1-e6c8-4f96-a5bc-ceba05f034e5'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:50:36 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-c731a280-21a7-468e-b2f0-1faed5c56da2 tempest-SnapshotsActionsTest-452964465 None] Created reservations ['0ab1f73e-080d-48f9-b235-7bd4fc34b929', 'eddbd775-a871-4ceb-840d-d90d7cf06e31', 'eae4190f-0bcf-40d0-946b-755145781e0a', '71e07348-a1ad-4b5f-8c63-45a1122365b9'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:50:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f5e6a13b-1f47-4b51-91fb-58c9c76d120f tempest-VolumesActionsTest-378999174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:50:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f5e6a13b-1f47-4b51-91fb-58c9c76d120f tempest-VolumesActionsTest-378999174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:50:36 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f5e6a13b-1f47-4b51-91fb-58c9c76d120f tempest-VolumesActionsTest-378999174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:50:36 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f5e6a13b-1f47-4b51-91fb-58c9c76d120f tempest-VolumesActionsTest-378999174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:50:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f5e6a13b-1f47-4b51-91fb-58c9c76d120f tempest-VolumesActionsTest-378999174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:50:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f5e6a13b-1f47-4b51-91fb-58c9c76d120f tempest-VolumesActionsTest-378999174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:36 devstack sudo[95002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:50:36 devstack sudo[95002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c731a280-21a7-468e-b2f0-1faed5c56da2 tempest-SnapshotsActionsTest-452964465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:50:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c731a280-21a7-468e-b2f0-1faed5c56da2 tempest-SnapshotsActionsTest-452964465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:50:36 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c731a280-21a7-468e-b2f0-1faed5c56da2 tempest-SnapshotsActionsTest-452964465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:50:36 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c731a280-21a7-468e-b2f0-1faed5c56da2 tempest-SnapshotsActionsTest-452964465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:50:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c731a280-21a7-468e-b2f0-1faed5c56da2 tempest-SnapshotsActionsTest-452964465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:50:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c731a280-21a7-468e-b2f0-1faed5c56da2 tempest-SnapshotsActionsTest-452964465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:36 devstack sudo[95004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:50:36 devstack sudo[95004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:36 devstack sudo[95002]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f5e6a13b-1f47-4b51-91fb-58c9c76d120f tempest-VolumesActionsTest-378999174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.337s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:36 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-f5e6a13b-1f47-4b51-91fb-58c9c76d120f tempest-VolumesActionsTest-378999174 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:50:36 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-f5e6a13b-1f47-4b51-91fb-58c9c76d120f tempest-VolumesActionsTest-378999174 None] Deleted volume successfully. Aug 10 12:50:36 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f5e6a13b-1f47-4b51-91fb-58c9c76d120f tempest-VolumesActionsTest-378999174 None] Lock "cinder-eba1731b-5bc3-4dec-86e1-7a0f97d7e606-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:50:36 devstack sudo[95004]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c731a280-21a7-468e-b2f0-1faed5c56da2 tempest-SnapshotsActionsTest-452964465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.368s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:36 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-c731a280-21a7-468e-b2f0-1faed5c56da2 tempest-SnapshotsActionsTest-452964465 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:50:36 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-c731a280-21a7-468e-b2f0-1faed5c56da2 tempest-SnapshotsActionsTest-452964465 None] Deleted volume successfully. Aug 10 12:50:36 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c731a280-21a7-468e-b2f0-1faed5c56da2 tempest-SnapshotsActionsTest-452964465 None] Lock "cinder-47a545f2-fcfd-4d11-b960-6cf635b1520d-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:50:37 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac8c9264-2bd2-488f-a7ef-25f2b1429050 tempest-VolumesActionsTest-179111258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:50:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ac8c9264-2bd2-488f-a7ef-25f2b1429050 tempest-VolumesActionsTest-179111258 None] Flow 'volume_create_manager' (14952fee-176c-4b35-9cb8-4551e3ff7682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:50:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ac8c9264-2bd2-488f-a7ef-25f2b1429050 tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (093aa2c2-9694-4fdc-9dfa-03d9b04cc023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ac8c9264-2bd2-488f-a7ef-25f2b1429050 tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (093aa2c2-9694-4fdc-9dfa-03d9b04cc023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1748568119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73271897-7057-4474-8945-e7be39ad4c8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b1a88657d7242f980aa06a66796beb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:50:37Z,use_quota=True,user_id='68c2f8894a8840b18f9a6c2af19ebb79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ac8c9264-2bd2-488f-a7ef-25f2b1429050 tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22755f5e-8771-4cd9-b573-c4eb9865a6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ac8c9264-2bd2-488f-a7ef-25f2b1429050 tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22755f5e-8771-4cd9-b573-c4eb9865a6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ac8c9264-2bd2-488f-a7ef-25f2b1429050 tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bde37810-eb14-4565-8540-079bf99ff0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ac8c9264-2bd2-488f-a7ef-25f2b1429050 tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bde37810-eb14-4565-8540-079bf99ff0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73271897-7057-4474-8945-e7be39ad4c8f', 'volume_name': 'volume-73271897-7057-4474-8945-e7be39ad4c8f', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ac8c9264-2bd2-488f-a7ef-25f2b1429050 tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1dde84d-3bad-47ce-81f4-1e64bc304667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ac8c9264-2bd2-488f-a7ef-25f2b1429050 tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1dde84d-3bad-47ce-81f4-1e64bc304667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ac8c9264-2bd2-488f-a7ef-25f2b1429050 tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6445bc04-a886-4be0-832e-bee2e10980d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:37 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-ac8c9264-2bd2-488f-a7ef-25f2b1429050 tempest-VolumesActionsTest-179111258 None] Volume 73271897-7057-4474-8945-e7be39ad4c8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73271897-7057-4474-8945-e7be39ad4c8f', 'volume_size': 1} Aug 10 12:50:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ac8c9264-2bd2-488f-a7ef-25f2b1429050 tempest-VolumesActionsTest-179111258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:50:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ac8c9264-2bd2-488f-a7ef-25f2b1429050 tempest-VolumesActionsTest-179111258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:50:37 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ac8c9264-2bd2-488f-a7ef-25f2b1429050 tempest-VolumesActionsTest-179111258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1748568119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73271897-7057-4474-8945-e7be39ad4c8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b1a88657d7242f980aa06a66796beb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:50:37Z,use_quota=True,user_id='68c2f8894a8840b18f9a6c2af19ebb79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:50:37 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-ac8c9264-2bd2-488f-a7ef-25f2b1429050 tempest-VolumesActionsTest-179111258 None] Creating volume 73271897-7057-4474-8945-e7be39ad4c8f {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:50:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ac8c9264-2bd2-488f-a7ef-25f2b1429050 tempest-VolumesActionsTest-179111258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:50:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ac8c9264-2bd2-488f-a7ef-25f2b1429050 tempest-VolumesActionsTest-179111258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:50:37 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ac8c9264-2bd2-488f-a7ef-25f2b1429050 tempest-VolumesActionsTest-179111258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:50:37 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ac8c9264-2bd2-488f-a7ef-25f2b1429050 tempest-VolumesActionsTest-179111258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:50:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ac8c9264-2bd2-488f-a7ef-25f2b1429050 tempest-VolumesActionsTest-179111258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:50:37 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ac8c9264-2bd2-488f-a7ef-25f2b1429050 tempest-VolumesActionsTest-179111258 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:50:37 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-ac8c9264-2bd2-488f-a7ef-25f2b1429050 tempest-VolumesActionsTest-179111258 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:50:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ac8c9264-2bd2-488f-a7ef-25f2b1429050 tempest-VolumesActionsTest-179111258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-73271897-7057-4474-8945-e7be39ad4c8f 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:37 devstack sudo[95008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-73271897-7057-4474-8945-e7be39ad4c8f 1073741824 Aug 10 12:50:37 devstack sudo[95008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:37 devstack sudo[95008]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ac8c9264-2bd2-488f-a7ef-25f2b1429050 tempest-VolumesActionsTest-179111258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-73271897-7057-4474-8945-e7be39ad4c8f 1073741824" returned: 0 in 0.507s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ac8c9264-2bd2-488f-a7ef-25f2b1429050 tempest-VolumesActionsTest-179111258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-73271897-7057-4474-8945-e7be39ad4c8f {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:37 devstack sudo[95013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-73271897-7057-4474-8945-e7be39ad4c8f Aug 10 12:50:37 devstack sudo[95013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:37 devstack sudo[95013]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ac8c9264-2bd2-488f-a7ef-25f2b1429050 tempest-VolumesActionsTest-179111258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-73271897-7057-4474-8945-e7be39ad4c8f" returned: 0 in 0.316s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:37 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ac8c9264-2bd2-488f-a7ef-25f2b1429050 tempest-VolumesActionsTest-179111258 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:50:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ac8c9264-2bd2-488f-a7ef-25f2b1429050 tempest-VolumesActionsTest-179111258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:50:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ac8c9264-2bd2-488f-a7ef-25f2b1429050 tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6445bc04-a886-4be0-832e-bee2e10980d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73271897-7057-4474-8945-e7be39ad4c8f', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ac8c9264-2bd2-488f-a7ef-25f2b1429050 tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8dd9f94-7f5d-4034-a81d-56bef4185d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:38 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-ac8c9264-2bd2-488f-a7ef-25f2b1429050 tempest-VolumesActionsTest-179111258 None] Volume volume-73271897-7057-4474-8945-e7be39ad4c8f (73271897-7057-4474-8945-e7be39ad4c8f): created successfully Aug 10 12:50:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ac8c9264-2bd2-488f-a7ef-25f2b1429050 tempest-VolumesActionsTest-179111258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8dd9f94-7f5d-4034-a81d-56bef4185d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ac8c9264-2bd2-488f-a7ef-25f2b1429050 tempest-VolumesActionsTest-179111258 None] Flow 'volume_create_manager' (14952fee-176c-4b35-9cb8-4551e3ff7682) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:50:38 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-ac8c9264-2bd2-488f-a7ef-25f2b1429050 tempest-VolumesActionsTest-179111258 None] Created volume successfully. Aug 10 12:50:39 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a1f441b2-a3fe-4f83-8a9d-f0131a29bb47 tempest-VolumesActionsTest-179111258 None] Acquiring lock "cinder-73271897-7057-4474-8945-e7be39ad4c8f-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:50:39 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a1f441b2-a3fe-4f83-8a9d-f0131a29bb47 tempest-VolumesActionsTest-179111258 None] Lock "cinder-73271897-7057-4474-8945-e7be39ad4c8f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:50:39 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a1f441b2-a3fe-4f83-8a9d-f0131a29bb47 tempest-VolumesActionsTest-179111258 None] Acquiring lock "cinder-quobyte-73271897-7057-4474-8945-e7be39ad4c8f" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:50:39 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a1f441b2-a3fe-4f83-8a9d-f0131a29bb47 tempest-VolumesActionsTest-179111258 None] Lock "cinder-quobyte-73271897-7057-4474-8945-e7be39ad4c8f" acquired by "delete_volume" :: waited 0.019s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:50:39 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f8157d-c5fd-49da-a2ad-a97bdbef325d]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:50:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a1f441b2-a3fe-4f83-8a9d-f0131a29bb47 tempest-VolumesActionsTest-179111258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-73271897-7057-4474-8945-e7be39ad4c8f {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:39 devstack sudo[95033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-73271897-7057-4474-8945-e7be39ad4c8f Aug 10 12:50:39 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:40 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a1f441b2-a3fe-4f83-8a9d-f0131a29bb47 tempest-VolumesActionsTest-179111258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-73271897-7057-4474-8945-e7be39ad4c8f" returned: 0 in 0.366s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a1f441b2-a3fe-4f83-8a9d-f0131a29bb47 tempest-VolumesActionsTest-179111258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-73271897-7057-4474-8945-e7be39ad4c8f {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:40 devstack sudo[95038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-73271897-7057-4474-8945-e7be39ad4c8f Aug 10 12:50:40 devstack sudo[95038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:40 devstack sudo[95038]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a1f441b2-a3fe-4f83-8a9d-f0131a29bb47 tempest-VolumesActionsTest-179111258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-73271897-7057-4474-8945-e7be39ad4c8f" returned: 0 in 0.257s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:40 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a1f441b2-a3fe-4f83-8a9d-f0131a29bb47 tempest-VolumesActionsTest-179111258 None] Lock "cinder-quobyte-73271897-7057-4474-8945-e7be39ad4c8f" released by "delete_volume" :: held 0.667s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:50:40 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-a1f441b2-a3fe-4f83-8a9d-f0131a29bb47 tempest-VolumesActionsTest-179111258 None] Created reservations ['1c65c800-9c7c-4c35-9309-3d47c26ed0fd', '9dec8f83-d6e7-4e1d-8201-e8053669dc38', 'ac61dad1-5862-4c82-8172-a52d29a58c3c', '04e13f02-9150-4d9c-bbb7-ea4e2cbeda61'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:50:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a1f441b2-a3fe-4f83-8a9d-f0131a29bb47 tempest-VolumesActionsTest-179111258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:50:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a1f441b2-a3fe-4f83-8a9d-f0131a29bb47 tempest-VolumesActionsTest-179111258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:50:40 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a1f441b2-a3fe-4f83-8a9d-f0131a29bb47 tempest-VolumesActionsTest-179111258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:50:40 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a1f441b2-a3fe-4f83-8a9d-f0131a29bb47 tempest-VolumesActionsTest-179111258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:50:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a1f441b2-a3fe-4f83-8a9d-f0131a29bb47 tempest-VolumesActionsTest-179111258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:50:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a1f441b2-a3fe-4f83-8a9d-f0131a29bb47 tempest-VolumesActionsTest-179111258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:40 devstack sudo[95041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:50:40 devstack sudo[95041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:40 devstack sudo[95041]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a1f441b2-a3fe-4f83-8a9d-f0131a29bb47 tempest-VolumesActionsTest-179111258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.257s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:40 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-a1f441b2-a3fe-4f83-8a9d-f0131a29bb47 tempest-VolumesActionsTest-179111258 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:50:40 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-a1f441b2-a3fe-4f83-8a9d-f0131a29bb47 tempest-VolumesActionsTest-179111258 None] Deleted volume successfully. Aug 10 12:50:40 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a1f441b2-a3fe-4f83-8a9d-f0131a29bb47 tempest-VolumesActionsTest-179111258 None] Lock "cinder-73271897-7057-4474-8945-e7be39ad4c8f-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:50:50 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=141,cinder:UPDATE=141,cinder:INSERT=39,cinder:DELETE=12 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:50:50 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:INSERT=40,cinder:SELECT=135,cinder:UPDATE=177,cinder:DELETE=9 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:50:54 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-30c1110e-86f8-4206-87b7-42b76e2fb889 req-49d5d4ff-f132-4633-a7aa-54d5531c92a4 tempest-AttachVolumeNegativeTest-1896074937 None] Terminate volume connection completed successfully. Aug 10 12:50:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-30c1110e-86f8-4206-87b7-42b76e2fb889 req-49d5d4ff-f132-4633-a7aa-54d5531c92a4 tempest-AttachVolumeNegativeTest-1896074937 None] Deleting attachment 98c77a28-d10d-42e8-83cb-cf9a7e218850. {{(pid=89096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Aug 10 12:50:56 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bab96f8-ccac-4e21-910d-74573d66251a tempest-VolumesListAdminTestJSON-572089667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:50:56 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7bab96f8-ccac-4e21-910d-74573d66251a tempest-VolumesListAdminTestJSON-572089667 None] Flow 'volume_create_manager' (eb97f288-9699-47f9-bb34-8d85224fee9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:50:56 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7bab96f8-ccac-4e21-910d-74573d66251a tempest-VolumesListAdminTestJSON-572089667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32f0b4b3-ab89-4e2f-8fc7-9c42102fb4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:56 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7bab96f8-ccac-4e21-910d-74573d66251a tempest-VolumesListAdminTestJSON-572089667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32f0b4b3-ab89-4e2f-8fc7-9c42102fb4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1563091240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e093d05-876b-4320-bfb4-d371428cd092,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a399bca564a4352a0d5e32818149fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:50:57Z,use_quota=True,user_id='4adc12aa1ad84fadb2d7ffbd71b4a957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:56 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7bab96f8-ccac-4e21-910d-74573d66251a tempest-VolumesListAdminTestJSON-572089667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7b3519d-95f2-4d1f-8c73-a8d72aa6ff4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:56 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7bab96f8-ccac-4e21-910d-74573d66251a tempest-VolumesListAdminTestJSON-572089667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7b3519d-95f2-4d1f-8c73-a8d72aa6ff4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:56 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7bab96f8-ccac-4e21-910d-74573d66251a tempest-VolumesListAdminTestJSON-572089667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20a2e57f-d958-4e09-9137-40fb694beb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:56 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7bab96f8-ccac-4e21-910d-74573d66251a tempest-VolumesListAdminTestJSON-572089667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20a2e57f-d958-4e09-9137-40fb694beb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e093d05-876b-4320-bfb4-d371428cd092', 'volume_name': 'volume-6e093d05-876b-4320-bfb4-d371428cd092', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:56 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7bab96f8-ccac-4e21-910d-74573d66251a tempest-VolumesListAdminTestJSON-572089667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40235412-0996-4f4b-9def-ce424797796b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:56 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7bab96f8-ccac-4e21-910d-74573d66251a tempest-VolumesListAdminTestJSON-572089667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40235412-0996-4f4b-9def-ce424797796b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:56 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7bab96f8-ccac-4e21-910d-74573d66251a tempest-VolumesListAdminTestJSON-572089667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28642954-c18b-40f2-8d15-ea880a10d019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:56 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-7bab96f8-ccac-4e21-910d-74573d66251a tempest-VolumesListAdminTestJSON-572089667 None] Volume 6e093d05-876b-4320-bfb4-d371428cd092: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e093d05-876b-4320-bfb4-d371428cd092', 'volume_size': 1} Aug 10 12:50:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7bab96f8-ccac-4e21-910d-74573d66251a tempest-VolumesListAdminTestJSON-572089667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:50:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7bab96f8-ccac-4e21-910d-74573d66251a tempest-VolumesListAdminTestJSON-572089667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:50:56 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-7bab96f8-ccac-4e21-910d-74573d66251a tempest-VolumesListAdminTestJSON-572089667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1563091240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e093d05-876b-4320-bfb4-d371428cd092,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a399bca564a4352a0d5e32818149fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:50:57Z,use_quota=True,user_id='4adc12aa1ad84fadb2d7ffbd71b4a957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:50:56 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-7bab96f8-ccac-4e21-910d-74573d66251a tempest-VolumesListAdminTestJSON-572089667 None] Creating volume 6e093d05-876b-4320-bfb4-d371428cd092 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:50:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7bab96f8-ccac-4e21-910d-74573d66251a tempest-VolumesListAdminTestJSON-572089667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:50:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7bab96f8-ccac-4e21-910d-74573d66251a tempest-VolumesListAdminTestJSON-572089667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:50:56 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-7bab96f8-ccac-4e21-910d-74573d66251a tempest-VolumesListAdminTestJSON-572089667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:50:56 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-7bab96f8-ccac-4e21-910d-74573d66251a tempest-VolumesListAdminTestJSON-572089667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:50:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7bab96f8-ccac-4e21-910d-74573d66251a tempest-VolumesListAdminTestJSON-572089667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:50:56 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-7bab96f8-ccac-4e21-910d-74573d66251a tempest-VolumesListAdminTestJSON-572089667 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:50:56 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-7bab96f8-ccac-4e21-910d-74573d66251a tempest-VolumesListAdminTestJSON-572089667 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:50:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7bab96f8-ccac-4e21-910d-74573d66251a tempest-VolumesListAdminTestJSON-572089667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e093d05-876b-4320-bfb4-d371428cd092 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:56 devstack sudo[95125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e093d05-876b-4320-bfb4-d371428cd092 1073741824 Aug 10 12:50:56 devstack sudo[95125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:57 devstack sudo[95125]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7bab96f8-ccac-4e21-910d-74573d66251a tempest-VolumesListAdminTestJSON-572089667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e093d05-876b-4320-bfb4-d371428cd092 1073741824" returned: 0 in 0.605s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7bab96f8-ccac-4e21-910d-74573d66251a tempest-VolumesListAdminTestJSON-572089667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e093d05-876b-4320-bfb4-d371428cd092 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:57 devstack sudo[95133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e093d05-876b-4320-bfb4-d371428cd092 Aug 10 12:50:57 devstack sudo[95133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:57 devstack sudo[95133]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7bab96f8-ccac-4e21-910d-74573d66251a tempest-VolumesListAdminTestJSON-572089667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e093d05-876b-4320-bfb4-d371428cd092" returned: 0 in 0.377s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:57 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-7bab96f8-ccac-4e21-910d-74573d66251a tempest-VolumesListAdminTestJSON-572089667 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:50:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7bab96f8-ccac-4e21-910d-74573d66251a tempest-VolumesListAdminTestJSON-572089667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:50:57 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7bab96f8-ccac-4e21-910d-74573d66251a tempest-VolumesListAdminTestJSON-572089667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28642954-c18b-40f2-8d15-ea880a10d019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e093d05-876b-4320-bfb4-d371428cd092', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:57 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7bab96f8-ccac-4e21-910d-74573d66251a tempest-VolumesListAdminTestJSON-572089667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd30654-7af8-464f-9348-342caf9cdf13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:57 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-7bab96f8-ccac-4e21-910d-74573d66251a tempest-VolumesListAdminTestJSON-572089667 None] Volume volume-6e093d05-876b-4320-bfb4-d371428cd092 (6e093d05-876b-4320-bfb4-d371428cd092): created successfully Aug 10 12:50:57 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7bab96f8-ccac-4e21-910d-74573d66251a tempest-VolumesListAdminTestJSON-572089667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd30654-7af8-464f-9348-342caf9cdf13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:57 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7bab96f8-ccac-4e21-910d-74573d66251a tempest-VolumesListAdminTestJSON-572089667 None] Flow 'volume_create_manager' (eb97f288-9699-47f9-bb34-8d85224fee9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:50:57 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-7bab96f8-ccac-4e21-910d-74573d66251a tempest-VolumesListAdminTestJSON-572089667 None] Created volume successfully. Aug 10 12:50:59 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2011006-7f82-40e2-877e-a5290af210c9 tempest-VolumesListAdminTestJSON-572089667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:50:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b2011006-7f82-40e2-877e-a5290af210c9 tempest-VolumesListAdminTestJSON-572089667 None] Flow 'volume_create_manager' (0acdbe0a-6b53-47e3-a9e9-c9431273902e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:50:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b2011006-7f82-40e2-877e-a5290af210c9 tempest-VolumesListAdminTestJSON-572089667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88cf8d3d-cba3-44a1-b089-a2ef5cb661aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b2011006-7f82-40e2-877e-a5290af210c9 tempest-VolumesListAdminTestJSON-572089667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88cf8d3d-cba3-44a1-b089-a2ef5cb661aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:50:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-245059765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b699aa4-e129-4ec9-8e3f-633d7396a479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a399bca564a4352a0d5e32818149fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:50:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:50:59Z,use_quota=True,user_id='4adc12aa1ad84fadb2d7ffbd71b4a957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b2011006-7f82-40e2-877e-a5290af210c9 tempest-VolumesListAdminTestJSON-572089667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17140ea5-17b4-4321-a309-fae27a57f14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b2011006-7f82-40e2-877e-a5290af210c9 tempest-VolumesListAdminTestJSON-572089667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17140ea5-17b4-4321-a309-fae27a57f14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b2011006-7f82-40e2-877e-a5290af210c9 tempest-VolumesListAdminTestJSON-572089667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d8e8f22-9652-47fa-922e-dabc88605890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b2011006-7f82-40e2-877e-a5290af210c9 tempest-VolumesListAdminTestJSON-572089667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d8e8f22-9652-47fa-922e-dabc88605890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b699aa4-e129-4ec9-8e3f-633d7396a479', 'volume_name': 'volume-9b699aa4-e129-4ec9-8e3f-633d7396a479', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b2011006-7f82-40e2-877e-a5290af210c9 tempest-VolumesListAdminTestJSON-572089667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f25fb50-ba21-4921-99ac-6c6437292699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b2011006-7f82-40e2-877e-a5290af210c9 tempest-VolumesListAdminTestJSON-572089667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f25fb50-ba21-4921-99ac-6c6437292699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:50:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b2011006-7f82-40e2-877e-a5290af210c9 tempest-VolumesListAdminTestJSON-572089667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a547a76-8567-4345-bb4f-d7badc2ec27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:50:59 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-b2011006-7f82-40e2-877e-a5290af210c9 tempest-VolumesListAdminTestJSON-572089667 None] Volume 9b699aa4-e129-4ec9-8e3f-633d7396a479: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b699aa4-e129-4ec9-8e3f-633d7396a479', 'volume_size': 1} Aug 10 12:50:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b2011006-7f82-40e2-877e-a5290af210c9 tempest-VolumesListAdminTestJSON-572089667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:50:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b2011006-7f82-40e2-877e-a5290af210c9 tempest-VolumesListAdminTestJSON-572089667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:50:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b2011006-7f82-40e2-877e-a5290af210c9 tempest-VolumesListAdminTestJSON-572089667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:50:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-245059765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b699aa4-e129-4ec9-8e3f-633d7396a479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a399bca564a4352a0d5e32818149fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:50:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:50:59Z,use_quota=True,user_id='4adc12aa1ad84fadb2d7ffbd71b4a957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:50:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-b2011006-7f82-40e2-877e-a5290af210c9 tempest-VolumesListAdminTestJSON-572089667 None] Creating volume 9b699aa4-e129-4ec9-8e3f-633d7396a479 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:50:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b2011006-7f82-40e2-877e-a5290af210c9 tempest-VolumesListAdminTestJSON-572089667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:50:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b2011006-7f82-40e2-877e-a5290af210c9 tempest-VolumesListAdminTestJSON-572089667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:50:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b2011006-7f82-40e2-877e-a5290af210c9 tempest-VolumesListAdminTestJSON-572089667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:50:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b2011006-7f82-40e2-877e-a5290af210c9 tempest-VolumesListAdminTestJSON-572089667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:50:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b2011006-7f82-40e2-877e-a5290af210c9 tempest-VolumesListAdminTestJSON-572089667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:50:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b2011006-7f82-40e2-877e-a5290af210c9 tempest-VolumesListAdminTestJSON-572089667 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:50:59 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-b2011006-7f82-40e2-877e-a5290af210c9 tempest-VolumesListAdminTestJSON-572089667 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:50:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b2011006-7f82-40e2-877e-a5290af210c9 tempest-VolumesListAdminTestJSON-572089667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9b699aa4-e129-4ec9-8e3f-633d7396a479 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:59 devstack sudo[95139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9b699aa4-e129-4ec9-8e3f-633d7396a479 1073741824 Aug 10 12:50:59 devstack sudo[95139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:50:59 devstack sudo[95139]: pam_unix(sudo:session): session closed for user root Aug 10 12:50:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b2011006-7f82-40e2-877e-a5290af210c9 tempest-VolumesListAdminTestJSON-572089667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9b699aa4-e129-4ec9-8e3f-633d7396a479 1073741824" returned: 0 in 0.500s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:50:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b2011006-7f82-40e2-877e-a5290af210c9 tempest-VolumesListAdminTestJSON-572089667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9b699aa4-e129-4ec9-8e3f-633d7396a479 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:50:59 devstack sudo[95145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9b699aa4-e129-4ec9-8e3f-633d7396a479 Aug 10 12:50:59 devstack sudo[95145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:00 devstack sudo[95145]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b2011006-7f82-40e2-877e-a5290af210c9 tempest-VolumesListAdminTestJSON-572089667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9b699aa4-e129-4ec9-8e3f-633d7396a479" returned: 0 in 0.335s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:00 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b2011006-7f82-40e2-877e-a5290af210c9 tempest-VolumesListAdminTestJSON-572089667 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:51:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b2011006-7f82-40e2-877e-a5290af210c9 tempest-VolumesListAdminTestJSON-572089667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:51:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b2011006-7f82-40e2-877e-a5290af210c9 tempest-VolumesListAdminTestJSON-572089667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a547a76-8567-4345-bb4f-d7badc2ec27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b699aa4-e129-4ec9-8e3f-633d7396a479', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b2011006-7f82-40e2-877e-a5290af210c9 tempest-VolumesListAdminTestJSON-572089667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbd05ac8-e607-4030-ba35-395ef5f155cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:00 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-b2011006-7f82-40e2-877e-a5290af210c9 tempest-VolumesListAdminTestJSON-572089667 None] Volume volume-9b699aa4-e129-4ec9-8e3f-633d7396a479 (9b699aa4-e129-4ec9-8e3f-633d7396a479): created successfully Aug 10 12:51:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b2011006-7f82-40e2-877e-a5290af210c9 tempest-VolumesListAdminTestJSON-572089667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbd05ac8-e607-4030-ba35-395ef5f155cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b2011006-7f82-40e2-877e-a5290af210c9 tempest-VolumesListAdminTestJSON-572089667 None] Flow 'volume_create_manager' (0acdbe0a-6b53-47e3-a9e9-c9431273902e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:51:00 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-b2011006-7f82-40e2-877e-a5290af210c9 tempest-VolumesListAdminTestJSON-572089667 None] Created volume successfully. Aug 10 12:51:01 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-10063cf7-1b62-44b8-888c-778490223656 tempest-VolumesListAdminTestJSON-572089667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:51:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10063cf7-1b62-44b8-888c-778490223656 tempest-VolumesListAdminTestJSON-572089667 None] Flow 'volume_create_manager' (ad8e9776-8bd9-4b8b-af8c-10f3f343c9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:51:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10063cf7-1b62-44b8-888c-778490223656 tempest-VolumesListAdminTestJSON-572089667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47de9c64-6d71-4384-8877-d1ed86303c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10063cf7-1b62-44b8-888c-778490223656 tempest-VolumesListAdminTestJSON-572089667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47de9c64-6d71-4384-8877-d1ed86303c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:51:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-735882020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45080a09-6b76-46aa-9ab1-1cf425541068,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a399bca564a4352a0d5e32818149fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:51:02Z,use_quota=True,user_id='4adc12aa1ad84fadb2d7ffbd71b4a957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10063cf7-1b62-44b8-888c-778490223656 tempest-VolumesListAdminTestJSON-572089667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9fa23af-5932-4fdf-bf02-0d6ac9d801f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10063cf7-1b62-44b8-888c-778490223656 tempest-VolumesListAdminTestJSON-572089667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9fa23af-5932-4fdf-bf02-0d6ac9d801f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10063cf7-1b62-44b8-888c-778490223656 tempest-VolumesListAdminTestJSON-572089667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dead8ec0-8533-4642-97da-c01880e8682e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10063cf7-1b62-44b8-888c-778490223656 tempest-VolumesListAdminTestJSON-572089667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dead8ec0-8533-4642-97da-c01880e8682e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45080a09-6b76-46aa-9ab1-1cf425541068', 'volume_name': 'volume-45080a09-6b76-46aa-9ab1-1cf425541068', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10063cf7-1b62-44b8-888c-778490223656 tempest-VolumesListAdminTestJSON-572089667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15baaa92-1c32-4bf6-8836-adb26e28b73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10063cf7-1b62-44b8-888c-778490223656 tempest-VolumesListAdminTestJSON-572089667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15baaa92-1c32-4bf6-8836-adb26e28b73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10063cf7-1b62-44b8-888c-778490223656 tempest-VolumesListAdminTestJSON-572089667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d524425-552a-4a1e-a894-39d1222dd7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:02 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-10063cf7-1b62-44b8-888c-778490223656 tempest-VolumesListAdminTestJSON-572089667 None] Volume 45080a09-6b76-46aa-9ab1-1cf425541068: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45080a09-6b76-46aa-9ab1-1cf425541068', 'volume_size': 1} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-10063cf7-1b62-44b8-888c-778490223656 tempest-VolumesListAdminTestJSON-572089667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-10063cf7-1b62-44b8-888c-778490223656 tempest-VolumesListAdminTestJSON-572089667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-10063cf7-1b62-44b8-888c-778490223656 tempest-VolumesListAdminTestJSON-572089667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:51:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-735882020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45080a09-6b76-46aa-9ab1-1cf425541068,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a399bca564a4352a0d5e32818149fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:51:02Z,use_quota=True,user_id='4adc12aa1ad84fadb2d7ffbd71b4a957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-10063cf7-1b62-44b8-888c-778490223656 tempest-VolumesListAdminTestJSON-572089667 None] Creating volume 45080a09-6b76-46aa-9ab1-1cf425541068 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-10063cf7-1b62-44b8-888c-778490223656 tempest-VolumesListAdminTestJSON-572089667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-10063cf7-1b62-44b8-888c-778490223656 tempest-VolumesListAdminTestJSON-572089667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-10063cf7-1b62-44b8-888c-778490223656 tempest-VolumesListAdminTestJSON-572089667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-10063cf7-1b62-44b8-888c-778490223656 tempest-VolumesListAdminTestJSON-572089667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-10063cf7-1b62-44b8-888c-778490223656 tempest-VolumesListAdminTestJSON-572089667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-10063cf7-1b62-44b8-888c-778490223656 tempest-VolumesListAdminTestJSON-572089667 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:51:02 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-10063cf7-1b62-44b8-888c-778490223656 tempest-VolumesListAdminTestJSON-572089667 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-10063cf7-1b62-44b8-888c-778490223656 tempest-VolumesListAdminTestJSON-572089667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-45080a09-6b76-46aa-9ab1-1cf425541068 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:02 devstack sudo[95150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-45080a09-6b76-46aa-9ab1-1cf425541068 1073741824 Aug 10 12:51:02 devstack sudo[95150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-b888d66b-99d6-47ca-8c50-9570d7909ef8 tempest-VolumeQuotasAdminTestJSON-748476568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b888d66b-99d6-47ca-8c50-9570d7909ef8 tempest-VolumeQuotasAdminTestJSON-748476568 None] Flow 'volume_create_manager' (4d36a6ec-9eff-46a7-a721-7f507f04f5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b888d66b-99d6-47ca-8c50-9570d7909ef8 tempest-VolumeQuotasAdminTestJSON-748476568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44534c73-75a0-44f6-a802-d18661d0d130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b888d66b-99d6-47ca-8c50-9570d7909ef8 tempest-VolumeQuotasAdminTestJSON-748476568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44534c73-75a0-44f6-a802-d18661d0d130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:51:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1762945684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bd43f2c-f351-428d-94dd-766f8ee8c28d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9c695a98252467bbe1d3c8d8398b343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:51:02Z,use_quota=True,user_id='36b665e8f26f4c8097c0f6ada8a230b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b888d66b-99d6-47ca-8c50-9570d7909ef8 tempest-VolumeQuotasAdminTestJSON-748476568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9069788a-0b05-4fb8-8ad5-204fb66ca23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b888d66b-99d6-47ca-8c50-9570d7909ef8 tempest-VolumeQuotasAdminTestJSON-748476568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9069788a-0b05-4fb8-8ad5-204fb66ca23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b888d66b-99d6-47ca-8c50-9570d7909ef8 tempest-VolumeQuotasAdminTestJSON-748476568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee91f4fa-31e3-4ce3-aa30-26ba18127a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b888d66b-99d6-47ca-8c50-9570d7909ef8 tempest-VolumeQuotasAdminTestJSON-748476568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee91f4fa-31e3-4ce3-aa30-26ba18127a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bd43f2c-f351-428d-94dd-766f8ee8c28d', 'volume_name': 'volume-2bd43f2c-f351-428d-94dd-766f8ee8c28d', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b888d66b-99d6-47ca-8c50-9570d7909ef8 tempest-VolumeQuotasAdminTestJSON-748476568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2b6605c-9212-47bb-bdc4-317a8c6fbedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b888d66b-99d6-47ca-8c50-9570d7909ef8 tempest-VolumeQuotasAdminTestJSON-748476568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2b6605c-9212-47bb-bdc4-317a8c6fbedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:02 devstack sudo[95150]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b888d66b-99d6-47ca-8c50-9570d7909ef8 tempest-VolumeQuotasAdminTestJSON-748476568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae045e10-3e1a-4b7f-a379-a1f7724fe11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:02 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-b888d66b-99d6-47ca-8c50-9570d7909ef8 tempest-VolumeQuotasAdminTestJSON-748476568 None] Volume 2bd43f2c-f351-428d-94dd-766f8ee8c28d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bd43f2c-f351-428d-94dd-766f8ee8c28d', 'volume_size': 1} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b888d66b-99d6-47ca-8c50-9570d7909ef8 tempest-VolumeQuotasAdminTestJSON-748476568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-10063cf7-1b62-44b8-888c-778490223656 tempest-VolumesListAdminTestJSON-572089667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-45080a09-6b76-46aa-9ab1-1cf425541068 1073741824" returned: 0 in 0.542s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-10063cf7-1b62-44b8-888c-778490223656 tempest-VolumesListAdminTestJSON-572089667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-45080a09-6b76-46aa-9ab1-1cf425541068 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:02 devstack sudo[95156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-45080a09-6b76-46aa-9ab1-1cf425541068 Aug 10 12:51:02 devstack sudo[95156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:02 devstack sudo[95156]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-10063cf7-1b62-44b8-888c-778490223656 tempest-VolumesListAdminTestJSON-572089667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-45080a09-6b76-46aa-9ab1-1cf425541068" returned: 0 in 0.259s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-10063cf7-1b62-44b8-888c-778490223656 tempest-VolumesListAdminTestJSON-572089667 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-10063cf7-1b62-44b8-888c-778490223656 tempest-VolumesListAdminTestJSON-572089667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b888d66b-99d6-47ca-8c50-9570d7909ef8 tempest-VolumeQuotasAdminTestJSON-748476568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.300s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b888d66b-99d6-47ca-8c50-9570d7909ef8 tempest-VolumeQuotasAdminTestJSON-748476568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:51:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1762945684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bd43f2c-f351-428d-94dd-766f8ee8c28d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9c695a98252467bbe1d3c8d8398b343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:51:02Z,use_quota=True,user_id='36b665e8f26f4c8097c0f6ada8a230b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-b888d66b-99d6-47ca-8c50-9570d7909ef8 tempest-VolumeQuotasAdminTestJSON-748476568 None] Creating volume 2bd43f2c-f351-428d-94dd-766f8ee8c28d {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b888d66b-99d6-47ca-8c50-9570d7909ef8 tempest-VolumeQuotasAdminTestJSON-748476568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b888d66b-99d6-47ca-8c50-9570d7909ef8 tempest-VolumeQuotasAdminTestJSON-748476568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b888d66b-99d6-47ca-8c50-9570d7909ef8 tempest-VolumeQuotasAdminTestJSON-748476568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b888d66b-99d6-47ca-8c50-9570d7909ef8 tempest-VolumeQuotasAdminTestJSON-748476568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b888d66b-99d6-47ca-8c50-9570d7909ef8 tempest-VolumeQuotasAdminTestJSON-748476568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b888d66b-99d6-47ca-8c50-9570d7909ef8 tempest-VolumeQuotasAdminTestJSON-748476568 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:51:02 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-b888d66b-99d6-47ca-8c50-9570d7909ef8 tempest-VolumeQuotasAdminTestJSON-748476568 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b888d66b-99d6-47ca-8c50-9570d7909ef8 tempest-VolumeQuotasAdminTestJSON-748476568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2bd43f2c-f351-428d-94dd-766f8ee8c28d 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10063cf7-1b62-44b8-888c-778490223656 tempest-VolumesListAdminTestJSON-572089667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d524425-552a-4a1e-a894-39d1222dd7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45080a09-6b76-46aa-9ab1-1cf425541068', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10063cf7-1b62-44b8-888c-778490223656 tempest-VolumesListAdminTestJSON-572089667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f002a53-3770-41ce-b87d-26f6b23b9ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:02 devstack sudo[95159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2bd43f2c-f351-428d-94dd-766f8ee8c28d 1073741824 Aug 10 12:51:02 devstack sudo[95159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:02 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-10063cf7-1b62-44b8-888c-778490223656 tempest-VolumesListAdminTestJSON-572089667 None] Volume volume-45080a09-6b76-46aa-9ab1-1cf425541068 (45080a09-6b76-46aa-9ab1-1cf425541068): created successfully Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10063cf7-1b62-44b8-888c-778490223656 tempest-VolumesListAdminTestJSON-572089667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f002a53-3770-41ce-b87d-26f6b23b9ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10063cf7-1b62-44b8-888c-778490223656 tempest-VolumesListAdminTestJSON-572089667 None] Flow 'volume_create_manager' (ad8e9776-8bd9-4b8b-af8c-10f3f343c9fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:51:02 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-10063cf7-1b62-44b8-888c-778490223656 tempest-VolumesListAdminTestJSON-572089667 None] Created volume successfully. Aug 10 12:51:03 devstack sudo[95159]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b888d66b-99d6-47ca-8c50-9570d7909ef8 tempest-VolumeQuotasAdminTestJSON-748476568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2bd43f2c-f351-428d-94dd-766f8ee8c28d 1073741824" returned: 0 in 0.562s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b888d66b-99d6-47ca-8c50-9570d7909ef8 tempest-VolumeQuotasAdminTestJSON-748476568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2bd43f2c-f351-428d-94dd-766f8ee8c28d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:03 devstack sudo[95168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2bd43f2c-f351-428d-94dd-766f8ee8c28d Aug 10 12:51:03 devstack sudo[95168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:03 devstack sudo[95168]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b888d66b-99d6-47ca-8c50-9570d7909ef8 tempest-VolumeQuotasAdminTestJSON-748476568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2bd43f2c-f351-428d-94dd-766f8ee8c28d" returned: 0 in 0.253s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b888d66b-99d6-47ca-8c50-9570d7909ef8 tempest-VolumeQuotasAdminTestJSON-748476568 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:51:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b888d66b-99d6-47ca-8c50-9570d7909ef8 tempest-VolumeQuotasAdminTestJSON-748476568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:51:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b888d66b-99d6-47ca-8c50-9570d7909ef8 tempest-VolumeQuotasAdminTestJSON-748476568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae045e10-3e1a-4b7f-a379-a1f7724fe11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bd43f2c-f351-428d-94dd-766f8ee8c28d', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b888d66b-99d6-47ca-8c50-9570d7909ef8 tempest-VolumeQuotasAdminTestJSON-748476568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc83e596-a6e4-4570-b7ab-5ad437548da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:03 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-b888d66b-99d6-47ca-8c50-9570d7909ef8 tempest-VolumeQuotasAdminTestJSON-748476568 None] Volume volume-2bd43f2c-f351-428d-94dd-766f8ee8c28d (2bd43f2c-f351-428d-94dd-766f8ee8c28d): created successfully Aug 10 12:51:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b888d66b-99d6-47ca-8c50-9570d7909ef8 tempest-VolumeQuotasAdminTestJSON-748476568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc83e596-a6e4-4570-b7ab-5ad437548da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b888d66b-99d6-47ca-8c50-9570d7909ef8 tempest-VolumeQuotasAdminTestJSON-748476568 None] Flow 'volume_create_manager' (4d36a6ec-9eff-46a7-a721-7f507f04f5fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:51:03 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-b888d66b-99d6-47ca-8c50-9570d7909ef8 tempest-VolumeQuotasAdminTestJSON-748476568 None] Created volume successfully. Aug 10 12:51:03 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 12:51:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:51:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:51:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:51:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:51:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:51:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:03 devstack sudo[95172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:51:03 devstack sudo[95172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:04 devstack sudo[95172]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.303s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:04 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:51:04 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager._thread_info {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 12:51:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread count: 8 {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 12:51:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread info: [<_MainThread(MainThread, started 130607683133568)>, , , , , , , ] {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Aug 10 12:51:04 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b208b705-5db9-4e73-9078-f75f4437bfe3 tempest-VolumeQuotasAdminTestJSON-748476568 None] Acquiring lock "cinder-2bd43f2c-f351-428d-94dd-766f8ee8c28d-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:51:04 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b208b705-5db9-4e73-9078-f75f4437bfe3 tempest-VolumeQuotasAdminTestJSON-748476568 None] Lock "cinder-2bd43f2c-f351-428d-94dd-766f8ee8c28d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:51:04 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b208b705-5db9-4e73-9078-f75f4437bfe3 tempest-VolumeQuotasAdminTestJSON-748476568 None] Acquiring lock "cinder-quobyte-2bd43f2c-f351-428d-94dd-766f8ee8c28d" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:51:04 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b208b705-5db9-4e73-9078-f75f4437bfe3 tempest-VolumeQuotasAdminTestJSON-748476568 None] Lock "cinder-quobyte-2bd43f2c-f351-428d-94dd-766f8ee8c28d" acquired by "delete_volume" :: waited 0.022s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:51:04 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e1115f-ff92-4a52-925a-6809c075c125]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:51:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b208b705-5db9-4e73-9078-f75f4437bfe3 tempest-VolumeQuotasAdminTestJSON-748476568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2bd43f2c-f351-428d-94dd-766f8ee8c28d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:05 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2945822-5623-439b-aa6f-40f87f11e488 tempest-VolumesListAdminTestJSON-994863846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:51:05 devstack sudo[95186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2bd43f2c-f351-428d-94dd-766f8ee8c28d Aug 10 12:51:05 devstack sudo[95186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c2945822-5623-439b-aa6f-40f87f11e488 tempest-VolumesListAdminTestJSON-994863846 None] Flow 'volume_create_manager' (26b091da-65e9-4a9a-b1d9-1f97c6c2cd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:51:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c2945822-5623-439b-aa6f-40f87f11e488 tempest-VolumesListAdminTestJSON-994863846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce5a06f-aa0f-45df-b424-2290e110d665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c2945822-5623-439b-aa6f-40f87f11e488 tempest-VolumesListAdminTestJSON-994863846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce5a06f-aa0f-45df-b424-2290e110d665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=409a497e-4e6a-421d-9408-89f9fd0c72a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40d0f0b3840e4692be010b6392ef62aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:51:05Z,use_quota=True,user_id='e52ad9b606e746899850549157cc1d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c2945822-5623-439b-aa6f-40f87f11e488 tempest-VolumesListAdminTestJSON-994863846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dad96c05-b1a8-40f9-8344-17c25dd81e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c2945822-5623-439b-aa6f-40f87f11e488 tempest-VolumesListAdminTestJSON-994863846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dad96c05-b1a8-40f9-8344-17c25dd81e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c2945822-5623-439b-aa6f-40f87f11e488 tempest-VolumesListAdminTestJSON-994863846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fda7c6f4-8e31-44a3-a965-98b768a5fc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c2945822-5623-439b-aa6f-40f87f11e488 tempest-VolumesListAdminTestJSON-994863846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fda7c6f4-8e31-44a3-a965-98b768a5fc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '409a497e-4e6a-421d-9408-89f9fd0c72a8', 'volume_name': 'volume-409a497e-4e6a-421d-9408-89f9fd0c72a8', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c2945822-5623-439b-aa6f-40f87f11e488 tempest-VolumesListAdminTestJSON-994863846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b8901a6-4dc2-4576-b936-0dbcb8aff724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c2945822-5623-439b-aa6f-40f87f11e488 tempest-VolumesListAdminTestJSON-994863846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b8901a6-4dc2-4576-b936-0dbcb8aff724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c2945822-5623-439b-aa6f-40f87f11e488 tempest-VolumesListAdminTestJSON-994863846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0e40bdc-52ff-405b-ab38-7ee2ea277aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:05 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-c2945822-5623-439b-aa6f-40f87f11e488 tempest-VolumesListAdminTestJSON-994863846 None] Volume 409a497e-4e6a-421d-9408-89f9fd0c72a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-409a497e-4e6a-421d-9408-89f9fd0c72a8', 'volume_size': 1} Aug 10 12:51:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c2945822-5623-439b-aa6f-40f87f11e488 tempest-VolumesListAdminTestJSON-994863846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:51:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c2945822-5623-439b-aa6f-40f87f11e488 tempest-VolumesListAdminTestJSON-994863846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:51:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c2945822-5623-439b-aa6f-40f87f11e488 tempest-VolumesListAdminTestJSON-994863846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=409a497e-4e6a-421d-9408-89f9fd0c72a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40d0f0b3840e4692be010b6392ef62aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:51:05Z,use_quota=True,user_id='e52ad9b606e746899850549157cc1d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:51:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-c2945822-5623-439b-aa6f-40f87f11e488 tempest-VolumesListAdminTestJSON-994863846 None] Creating volume 409a497e-4e6a-421d-9408-89f9fd0c72a8 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:51:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c2945822-5623-439b-aa6f-40f87f11e488 tempest-VolumesListAdminTestJSON-994863846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:51:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c2945822-5623-439b-aa6f-40f87f11e488 tempest-VolumesListAdminTestJSON-994863846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:51:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c2945822-5623-439b-aa6f-40f87f11e488 tempest-VolumesListAdminTestJSON-994863846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:51:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c2945822-5623-439b-aa6f-40f87f11e488 tempest-VolumesListAdminTestJSON-994863846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:51:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c2945822-5623-439b-aa6f-40f87f11e488 tempest-VolumesListAdminTestJSON-994863846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:51:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c2945822-5623-439b-aa6f-40f87f11e488 tempest-VolumesListAdminTestJSON-994863846 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:51:05 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-c2945822-5623-439b-aa6f-40f87f11e488 tempest-VolumesListAdminTestJSON-994863846 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:51:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c2945822-5623-439b-aa6f-40f87f11e488 tempest-VolumesListAdminTestJSON-994863846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-409a497e-4e6a-421d-9408-89f9fd0c72a8 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:05 devstack sudo[95198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-409a497e-4e6a-421d-9408-89f9fd0c72a8 1073741824 Aug 10 12:51:05 devstack sudo[95198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:05 devstack sudo[95186]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b208b705-5db9-4e73-9078-f75f4437bfe3 tempest-VolumeQuotasAdminTestJSON-748476568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2bd43f2c-f351-428d-94dd-766f8ee8c28d" returned: 0 in 0.599s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b208b705-5db9-4e73-9078-f75f4437bfe3 tempest-VolumeQuotasAdminTestJSON-748476568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2bd43f2c-f351-428d-94dd-766f8ee8c28d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:05 devstack sudo[95206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2bd43f2c-f351-428d-94dd-766f8ee8c28d Aug 10 12:51:05 devstack sudo[95206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:05 devstack sudo[95206]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b208b705-5db9-4e73-9078-f75f4437bfe3 tempest-VolumeQuotasAdminTestJSON-748476568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2bd43f2c-f351-428d-94dd-766f8ee8c28d" returned: 0 in 0.361s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:05 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b208b705-5db9-4e73-9078-f75f4437bfe3 tempest-VolumeQuotasAdminTestJSON-748476568 None] Lock "cinder-quobyte-2bd43f2c-f351-428d-94dd-766f8ee8c28d" released by "delete_volume" :: held 1.041s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:51:05 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-b208b705-5db9-4e73-9078-f75f4437bfe3 tempest-VolumeQuotasAdminTestJSON-748476568 None] Created reservations ['7441a915-87f4-4265-8140-e59c28da03ac', 'c9843fff-477a-4de8-a44f-601afd6b43aa', 'e9b197ee-fe0f-483d-aa77-ced0aefdf015', 'a7b0d02f-cb96-40a5-9b52-4286cff0df93'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:51:06 devstack sudo[95198]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c2945822-5623-439b-aa6f-40f87f11e488 tempest-VolumesListAdminTestJSON-994863846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-409a497e-4e6a-421d-9408-89f9fd0c72a8 1073741824" returned: 0 in 0.708s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c2945822-5623-439b-aa6f-40f87f11e488 tempest-VolumesListAdminTestJSON-994863846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-409a497e-4e6a-421d-9408-89f9fd0c72a8 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b208b705-5db9-4e73-9078-f75f4437bfe3 tempest-VolumeQuotasAdminTestJSON-748476568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:51:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b208b705-5db9-4e73-9078-f75f4437bfe3 tempest-VolumeQuotasAdminTestJSON-748476568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:51:06 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b208b705-5db9-4e73-9078-f75f4437bfe3 tempest-VolumeQuotasAdminTestJSON-748476568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:51:06 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b208b705-5db9-4e73-9078-f75f4437bfe3 tempest-VolumeQuotasAdminTestJSON-748476568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:51:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b208b705-5db9-4e73-9078-f75f4437bfe3 tempest-VolumeQuotasAdminTestJSON-748476568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:51:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b208b705-5db9-4e73-9078-f75f4437bfe3 tempest-VolumeQuotasAdminTestJSON-748476568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:06 devstack sudo[95213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-409a497e-4e6a-421d-9408-89f9fd0c72a8 Aug 10 12:51:06 devstack sudo[95213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:06 devstack sudo[95214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:51:06 devstack sudo[95214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:06 devstack sudo[95213]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c2945822-5623-439b-aa6f-40f87f11e488 tempest-VolumesListAdminTestJSON-994863846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-409a497e-4e6a-421d-9408-89f9fd0c72a8" returned: 0 in 0.264s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:06 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c2945822-5623-439b-aa6f-40f87f11e488 tempest-VolumesListAdminTestJSON-994863846 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:51:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c2945822-5623-439b-aa6f-40f87f11e488 tempest-VolumesListAdminTestJSON-994863846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:51:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c2945822-5623-439b-aa6f-40f87f11e488 tempest-VolumesListAdminTestJSON-994863846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0e40bdc-52ff-405b-ab38-7ee2ea277aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-409a497e-4e6a-421d-9408-89f9fd0c72a8', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c2945822-5623-439b-aa6f-40f87f11e488 tempest-VolumesListAdminTestJSON-994863846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00f42a14-8742-40a5-bbd4-ed6a1bc0c403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:06 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-c2945822-5623-439b-aa6f-40f87f11e488 tempest-VolumesListAdminTestJSON-994863846 None] Volume volume-409a497e-4e6a-421d-9408-89f9fd0c72a8 (409a497e-4e6a-421d-9408-89f9fd0c72a8): created successfully Aug 10 12:51:06 devstack sudo[95214]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c2945822-5623-439b-aa6f-40f87f11e488 tempest-VolumesListAdminTestJSON-994863846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00f42a14-8742-40a5-bbd4-ed6a1bc0c403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c2945822-5623-439b-aa6f-40f87f11e488 tempest-VolumesListAdminTestJSON-994863846 None] Flow 'volume_create_manager' (26b091da-65e9-4a9a-b1d9-1f97c6c2cd0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:51:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b208b705-5db9-4e73-9078-f75f4437bfe3 tempest-VolumeQuotasAdminTestJSON-748476568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.295s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:06 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-b208b705-5db9-4e73-9078-f75f4437bfe3 tempest-VolumeQuotasAdminTestJSON-748476568 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:51:06 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-b208b705-5db9-4e73-9078-f75f4437bfe3 tempest-VolumeQuotasAdminTestJSON-748476568 None] Deleted volume successfully. Aug 10 12:51:06 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-c2945822-5623-439b-aa6f-40f87f11e488 tempest-VolumesListAdminTestJSON-994863846 None] Created volume successfully. Aug 10 12:51:06 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b208b705-5db9-4e73-9078-f75f4437bfe3 tempest-VolumeQuotasAdminTestJSON-748476568 None] Lock "cinder-2bd43f2c-f351-428d-94dd-766f8ee8c28d-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:51:07 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c197836c-2d83-4486-81f5-ab032aa34a55 tempest-VolumesListAdminTestJSON-994863846 None] Acquiring lock "cinder-409a497e-4e6a-421d-9408-89f9fd0c72a8-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:51:07 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c197836c-2d83-4486-81f5-ab032aa34a55 tempest-VolumesListAdminTestJSON-994863846 None] Lock "cinder-409a497e-4e6a-421d-9408-89f9fd0c72a8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:51:07 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c197836c-2d83-4486-81f5-ab032aa34a55 tempest-VolumesListAdminTestJSON-994863846 None] Acquiring lock "cinder-quobyte-409a497e-4e6a-421d-9408-89f9fd0c72a8" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:51:07 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c197836c-2d83-4486-81f5-ab032aa34a55 tempest-VolumesListAdminTestJSON-994863846 None] Lock "cinder-quobyte-409a497e-4e6a-421d-9408-89f9fd0c72a8" acquired by "delete_volume" :: waited 0.049s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:51:07 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f675caf-5601-47df-869f-d7dcd2a6c7b0]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:51:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c197836c-2d83-4486-81f5-ab032aa34a55 tempest-VolumesListAdminTestJSON-994863846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-409a497e-4e6a-421d-9408-89f9fd0c72a8 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:07 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-9662ef6f-5a42-4f4e-aaea-d15f43994530 tempest-VolumesListAdminTestJSON-572089667 None] Acquiring lock "cinder-45080a09-6b76-46aa-9ab1-1cf425541068-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:51:07 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-9662ef6f-5a42-4f4e-aaea-d15f43994530 tempest-VolumesListAdminTestJSON-572089667 None] Lock "cinder-45080a09-6b76-46aa-9ab1-1cf425541068-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:51:07 devstack sudo[95233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-409a497e-4e6a-421d-9408-89f9fd0c72a8 Aug 10 12:51:07 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-9662ef6f-5a42-4f4e-aaea-d15f43994530 tempest-VolumesListAdminTestJSON-572089667 None] Acquiring lock "cinder-quobyte-45080a09-6b76-46aa-9ab1-1cf425541068" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:51:07 devstack sudo[95233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:07 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-9662ef6f-5a42-4f4e-aaea-d15f43994530 tempest-VolumesListAdminTestJSON-572089667 None] Lock "cinder-quobyte-45080a09-6b76-46aa-9ab1-1cf425541068" acquired by "delete_volume" :: waited 0.028s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:51:07 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[494fb780-5144-45d7-b185-a6a75dc1a573]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:51:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9662ef6f-5a42-4f4e-aaea-d15f43994530 tempest-VolumesListAdminTestJSON-572089667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-45080a09-6b76-46aa-9ab1-1cf425541068 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:08 devstack sudo[95252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-45080a09-6b76-46aa-9ab1-1cf425541068 Aug 10 12:51:08 devstack sudo[95252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:08 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-4766b223-f027-4966-b9df-985646427bca tempest-VolumeQuotasAdminTestJSON-748476568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:51:08 devstack sudo[95233]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4766b223-f027-4966-b9df-985646427bca tempest-VolumeQuotasAdminTestJSON-748476568 None] Flow 'volume_create_manager' (0c1e62b3-fde8-4575-afa7-0f2a092578d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:51:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4766b223-f027-4966-b9df-985646427bca tempest-VolumeQuotasAdminTestJSON-748476568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e55d2b53-f7d0-41ce-bd58-b0ce83173c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c197836c-2d83-4486-81f5-ab032aa34a55 tempest-VolumesListAdminTestJSON-994863846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-409a497e-4e6a-421d-9408-89f9fd0c72a8" returned: 0 in 0.681s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c197836c-2d83-4486-81f5-ab032aa34a55 tempest-VolumesListAdminTestJSON-994863846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-409a497e-4e6a-421d-9408-89f9fd0c72a8 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:08 devstack sudo[95271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-409a497e-4e6a-421d-9408-89f9fd0c72a8 Aug 10 12:51:08 devstack sudo[95271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4766b223-f027-4966-b9df-985646427bca tempest-VolumeQuotasAdminTestJSON-748476568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e55d2b53-f7d0-41ce-bd58-b0ce83173c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-491671626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2bce97d-75be-4635-81f5-3b9e4ab2118b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9c695a98252467bbe1d3c8d8398b343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:51:08Z,use_quota=True,user_id='36b665e8f26f4c8097c0f6ada8a230b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4766b223-f027-4966-b9df-985646427bca tempest-VolumeQuotasAdminTestJSON-748476568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b56e6010-2160-45e6-b93a-7f1e0d5f92b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4766b223-f027-4966-b9df-985646427bca tempest-VolumeQuotasAdminTestJSON-748476568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b56e6010-2160-45e6-b93a-7f1e0d5f92b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4766b223-f027-4966-b9df-985646427bca tempest-VolumeQuotasAdminTestJSON-748476568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1ac3b60-d852-4350-93f6-deb4e24ce243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4766b223-f027-4966-b9df-985646427bca tempest-VolumeQuotasAdminTestJSON-748476568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1ac3b60-d852-4350-93f6-deb4e24ce243) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2bce97d-75be-4635-81f5-3b9e4ab2118b', 'volume_name': 'volume-f2bce97d-75be-4635-81f5-3b9e4ab2118b', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4766b223-f027-4966-b9df-985646427bca tempest-VolumeQuotasAdminTestJSON-748476568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f93eb011-ccec-4709-8004-bdcff70dd7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4766b223-f027-4966-b9df-985646427bca tempest-VolumeQuotasAdminTestJSON-748476568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f93eb011-ccec-4709-8004-bdcff70dd7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4766b223-f027-4966-b9df-985646427bca tempest-VolumeQuotasAdminTestJSON-748476568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95156807-b074-4f92-8bdc-9f7273d646ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:08 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-4766b223-f027-4966-b9df-985646427bca tempest-VolumeQuotasAdminTestJSON-748476568 None] Volume f2bce97d-75be-4635-81f5-3b9e4ab2118b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2bce97d-75be-4635-81f5-3b9e4ab2118b', 'volume_size': 1} Aug 10 12:51:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4766b223-f027-4966-b9df-985646427bca tempest-VolumeQuotasAdminTestJSON-748476568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:51:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4766b223-f027-4966-b9df-985646427bca tempest-VolumeQuotasAdminTestJSON-748476568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:51:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4766b223-f027-4966-b9df-985646427bca tempest-VolumeQuotasAdminTestJSON-748476568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-491671626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2bce97d-75be-4635-81f5-3b9e4ab2118b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9c695a98252467bbe1d3c8d8398b343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:51:08Z,use_quota=True,user_id='36b665e8f26f4c8097c0f6ada8a230b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:51:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-4766b223-f027-4966-b9df-985646427bca tempest-VolumeQuotasAdminTestJSON-748476568 None] Creating volume f2bce97d-75be-4635-81f5-3b9e4ab2118b {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:51:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4766b223-f027-4966-b9df-985646427bca tempest-VolumeQuotasAdminTestJSON-748476568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:51:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4766b223-f027-4966-b9df-985646427bca tempest-VolumeQuotasAdminTestJSON-748476568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:51:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4766b223-f027-4966-b9df-985646427bca tempest-VolumeQuotasAdminTestJSON-748476568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:51:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4766b223-f027-4966-b9df-985646427bca tempest-VolumeQuotasAdminTestJSON-748476568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:51:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4766b223-f027-4966-b9df-985646427bca tempest-VolumeQuotasAdminTestJSON-748476568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:51:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4766b223-f027-4966-b9df-985646427bca tempest-VolumeQuotasAdminTestJSON-748476568 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:51:08 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-4766b223-f027-4966-b9df-985646427bca tempest-VolumeQuotasAdminTestJSON-748476568 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:51:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4766b223-f027-4966-b9df-985646427bca tempest-VolumeQuotasAdminTestJSON-748476568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f2bce97d-75be-4635-81f5-3b9e4ab2118b 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:08 devstack sudo[95280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f2bce97d-75be-4635-81f5-3b9e4ab2118b 1073741824 Aug 10 12:51:08 devstack sudo[95280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:08 devstack sudo[95271]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c197836c-2d83-4486-81f5-ab032aa34a55 tempest-VolumesListAdminTestJSON-994863846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-409a497e-4e6a-421d-9408-89f9fd0c72a8" returned: 0 in 0.441s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:08 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c197836c-2d83-4486-81f5-ab032aa34a55 tempest-VolumesListAdminTestJSON-994863846 None] Lock "cinder-quobyte-409a497e-4e6a-421d-9408-89f9fd0c72a8" released by "delete_volume" :: held 1.202s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:51:08 devstack sudo[95252]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9662ef6f-5a42-4f4e-aaea-d15f43994530 tempest-VolumesListAdminTestJSON-572089667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-45080a09-6b76-46aa-9ab1-1cf425541068" returned: 0 in 0.866s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9662ef6f-5a42-4f4e-aaea-d15f43994530 tempest-VolumesListAdminTestJSON-572089667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-45080a09-6b76-46aa-9ab1-1cf425541068 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:08 devstack sudo[95296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-45080a09-6b76-46aa-9ab1-1cf425541068 Aug 10 12:51:08 devstack sudo[95296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:08 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-c197836c-2d83-4486-81f5-ab032aa34a55 tempest-VolumesListAdminTestJSON-994863846 None] Created reservations ['29dabd26-5314-42b1-9828-6b89c5d435f3', 'c2424c4f-d31a-4372-8ff5-ceab2d732986', 'a7f8ca67-13ba-4200-b91d-b936d13039ad', '52e50b29-7e61-4455-8b0b-afab7191abc9'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:51:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c197836c-2d83-4486-81f5-ab032aa34a55 tempest-VolumesListAdminTestJSON-994863846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:51:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c197836c-2d83-4486-81f5-ab032aa34a55 tempest-VolumesListAdminTestJSON-994863846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:51:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c197836c-2d83-4486-81f5-ab032aa34a55 tempest-VolumesListAdminTestJSON-994863846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:51:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c197836c-2d83-4486-81f5-ab032aa34a55 tempest-VolumesListAdminTestJSON-994863846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:51:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c197836c-2d83-4486-81f5-ab032aa34a55 tempest-VolumesListAdminTestJSON-994863846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:51:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c197836c-2d83-4486-81f5-ab032aa34a55 tempest-VolumesListAdminTestJSON-994863846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:09 devstack sudo[95313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:51:09 devstack sudo[95313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:09 devstack sudo[95296]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9662ef6f-5a42-4f4e-aaea-d15f43994530 tempest-VolumesListAdminTestJSON-572089667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-45080a09-6b76-46aa-9ab1-1cf425541068" returned: 0 in 0.457s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:09 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-9662ef6f-5a42-4f4e-aaea-d15f43994530 tempest-VolumesListAdminTestJSON-572089667 None] Lock "cinder-quobyte-45080a09-6b76-46aa-9ab1-1cf425541068" released by "delete_volume" :: held 1.372s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:51:09 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-9662ef6f-5a42-4f4e-aaea-d15f43994530 tempest-VolumesListAdminTestJSON-572089667 None] Created reservations ['17747436-4ea9-4db5-bdeb-be4d1b1b4b16', '0f75d4ff-0f13-4447-80c9-a7976998f35f', '2341e389-fc90-44f7-b6a4-7f660cf7fefe', 'db6c10da-ecf6-4cf4-bbba-66a3a57ca2ea'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:51:09 devstack sudo[95280]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4766b223-f027-4966-b9df-985646427bca tempest-VolumeQuotasAdminTestJSON-748476568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f2bce97d-75be-4635-81f5-3b9e4ab2118b 1073741824" returned: 0 in 0.895s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4766b223-f027-4966-b9df-985646427bca tempest-VolumeQuotasAdminTestJSON-748476568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f2bce97d-75be-4635-81f5-3b9e4ab2118b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9662ef6f-5a42-4f4e-aaea-d15f43994530 tempest-VolumesListAdminTestJSON-572089667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:51:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9662ef6f-5a42-4f4e-aaea-d15f43994530 tempest-VolumesListAdminTestJSON-572089667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:51:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9662ef6f-5a42-4f4e-aaea-d15f43994530 tempest-VolumesListAdminTestJSON-572089667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:51:09 devstack sudo[95313]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:09 devstack sudo[95328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f2bce97d-75be-4635-81f5-3b9e4ab2118b Aug 10 12:51:09 devstack sudo[95328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9662ef6f-5a42-4f4e-aaea-d15f43994530 tempest-VolumesListAdminTestJSON-572089667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:51:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9662ef6f-5a42-4f4e-aaea-d15f43994530 tempest-VolumesListAdminTestJSON-572089667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:51:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9662ef6f-5a42-4f4e-aaea-d15f43994530 tempest-VolumesListAdminTestJSON-572089667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c197836c-2d83-4486-81f5-ab032aa34a55 tempest-VolumesListAdminTestJSON-994863846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.328s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:09 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-c197836c-2d83-4486-81f5-ab032aa34a55 tempest-VolumesListAdminTestJSON-994863846 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:51:09 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-c197836c-2d83-4486-81f5-ab032aa34a55 tempest-VolumesListAdminTestJSON-994863846 None] Deleted volume successfully. Aug 10 12:51:09 devstack sudo[95330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:51:09 devstack sudo[95330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:09 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c197836c-2d83-4486-81f5-ab032aa34a55 tempest-VolumesListAdminTestJSON-994863846 None] Lock "cinder-409a497e-4e6a-421d-9408-89f9fd0c72a8-delete_volume" released by "delete_volume" :: held 2.141s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:51:09 devstack sudo[95328]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4766b223-f027-4966-b9df-985646427bca tempest-VolumeQuotasAdminTestJSON-748476568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f2bce97d-75be-4635-81f5-3b9e4ab2118b" returned: 0 in 0.325s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4766b223-f027-4966-b9df-985646427bca tempest-VolumeQuotasAdminTestJSON-748476568 None] <== create_volume: return (1294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:51:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4766b223-f027-4966-b9df-985646427bca tempest-VolumeQuotasAdminTestJSON-748476568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:51:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4766b223-f027-4966-b9df-985646427bca tempest-VolumeQuotasAdminTestJSON-748476568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95156807-b074-4f92-8bdc-9f7273d646ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2bce97d-75be-4635-81f5-3b9e4ab2118b', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4766b223-f027-4966-b9df-985646427bca tempest-VolumeQuotasAdminTestJSON-748476568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf4929f-3a8a-4379-8f0b-0601c8b9038d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:09 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-4766b223-f027-4966-b9df-985646427bca tempest-VolumeQuotasAdminTestJSON-748476568 None] Volume volume-f2bce97d-75be-4635-81f5-3b9e4ab2118b (f2bce97d-75be-4635-81f5-3b9e4ab2118b): created successfully Aug 10 12:51:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4766b223-f027-4966-b9df-985646427bca tempest-VolumeQuotasAdminTestJSON-748476568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf4929f-3a8a-4379-8f0b-0601c8b9038d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4766b223-f027-4966-b9df-985646427bca tempest-VolumeQuotasAdminTestJSON-748476568 None] Flow 'volume_create_manager' (0c1e62b3-fde8-4575-afa7-0f2a092578d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:51:09 devstack sudo[95330]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:09 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-4766b223-f027-4966-b9df-985646427bca tempest-VolumeQuotasAdminTestJSON-748476568 None] Created volume successfully. Aug 10 12:51:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9662ef6f-5a42-4f4e-aaea-d15f43994530 tempest-VolumesListAdminTestJSON-572089667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.384s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:09 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-9662ef6f-5a42-4f4e-aaea-d15f43994530 tempest-VolumesListAdminTestJSON-572089667 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:51:09 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-9662ef6f-5a42-4f4e-aaea-d15f43994530 tempest-VolumesListAdminTestJSON-572089667 None] Deleted volume successfully. Aug 10 12:51:09 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-9662ef6f-5a42-4f4e-aaea-d15f43994530 tempest-VolumesListAdminTestJSON-572089667 None] Lock "cinder-45080a09-6b76-46aa-9ab1-1cf425541068-delete_volume" released by "delete_volume" :: held 2.123s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:51:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-13b4f369-0ee1-440e-8004-3c052ec73308 tempest-VolumesListAdminTestJSON-572089667 None] Acquiring lock "cinder-9b699aa4-e129-4ec9-8e3f-633d7396a479-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:51:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-13b4f369-0ee1-440e-8004-3c052ec73308 tempest-VolumesListAdminTestJSON-572089667 None] Lock "cinder-9b699aa4-e129-4ec9-8e3f-633d7396a479-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:51:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-13b4f369-0ee1-440e-8004-3c052ec73308 tempest-VolumesListAdminTestJSON-572089667 None] Acquiring lock "cinder-quobyte-9b699aa4-e129-4ec9-8e3f-633d7396a479" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:51:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-13b4f369-0ee1-440e-8004-3c052ec73308 tempest-VolumesListAdminTestJSON-572089667 None] Lock "cinder-quobyte-9b699aa4-e129-4ec9-8e3f-633d7396a479" acquired by "delete_volume" :: waited 0.023s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:51:10 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[355da763-4bcb-4d65-a869-11ddab93730f]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:51:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-13b4f369-0ee1-440e-8004-3c052ec73308 tempest-VolumesListAdminTestJSON-572089667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9b699aa4-e129-4ec9-8e3f-633d7396a479 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:10 devstack sudo[95336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9b699aa4-e129-4ec9-8e3f-633d7396a479 Aug 10 12:51:10 devstack sudo[95336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:10 devstack sudo[95336]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-13b4f369-0ee1-440e-8004-3c052ec73308 tempest-VolumesListAdminTestJSON-572089667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9b699aa4-e129-4ec9-8e3f-633d7396a479" returned: 0 in 0.480s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-13b4f369-0ee1-440e-8004-3c052ec73308 tempest-VolumesListAdminTestJSON-572089667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9b699aa4-e129-4ec9-8e3f-633d7396a479 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:10 devstack sudo[95341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9b699aa4-e129-4ec9-8e3f-633d7396a479 Aug 10 12:51:10 devstack sudo[95341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:11 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-b75ec8ab-b4dc-46cc-b441-d564963d2b9b tempest-VolumeQuotasAdminTestJSON-1068283092 None] Transfer volume completed successfully. Aug 10 12:51:11 devstack sudo[95341]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-13b4f369-0ee1-440e-8004-3c052ec73308 tempest-VolumesListAdminTestJSON-572089667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9b699aa4-e129-4ec9-8e3f-633d7396a479" returned: 0 in 0.394s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:11 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-13b4f369-0ee1-440e-8004-3c052ec73308 tempest-VolumesListAdminTestJSON-572089667 None] Lock "cinder-quobyte-9b699aa4-e129-4ec9-8e3f-633d7396a479" released by "delete_volume" :: held 0.952s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:51:11 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-13b4f369-0ee1-440e-8004-3c052ec73308 tempest-VolumesListAdminTestJSON-572089667 None] Created reservations ['fbe533a1-aac0-4bb5-b5a6-2f6cdd40f04f', 'abcd93ca-d9a6-41ae-a517-3c13e51cea2b', 'e397213c-89a6-4ea1-9fca-9379b212f7bb', 'f0bfe8ce-bb89-456d-9c10-b00795676f97'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:51:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-13b4f369-0ee1-440e-8004-3c052ec73308 tempest-VolumesListAdminTestJSON-572089667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:51:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-13b4f369-0ee1-440e-8004-3c052ec73308 tempest-VolumesListAdminTestJSON-572089667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:51:11 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-13b4f369-0ee1-440e-8004-3c052ec73308 tempest-VolumesListAdminTestJSON-572089667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:51:11 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-13b4f369-0ee1-440e-8004-3c052ec73308 tempest-VolumesListAdminTestJSON-572089667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:51:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-13b4f369-0ee1-440e-8004-3c052ec73308 tempest-VolumesListAdminTestJSON-572089667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:51:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-13b4f369-0ee1-440e-8004-3c052ec73308 tempest-VolumesListAdminTestJSON-572089667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:11 devstack sudo[95344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:51:11 devstack sudo[95344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:11 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-22787af3-b523-458a-b908-a60e61b5720b tempest-VolumeQuotasAdminTestJSON-1067411710 None] Acquiring lock "cinder-f2bce97d-75be-4635-81f5-3b9e4ab2118b-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:51:11 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-22787af3-b523-458a-b908-a60e61b5720b tempest-VolumeQuotasAdminTestJSON-1067411710 None] Lock "cinder-f2bce97d-75be-4635-81f5-3b9e4ab2118b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:51:11 devstack sudo[95344]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:11 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-22787af3-b523-458a-b908-a60e61b5720b tempest-VolumeQuotasAdminTestJSON-1067411710 None] Acquiring lock "cinder-quobyte-f2bce97d-75be-4635-81f5-3b9e4ab2118b" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:51:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-13b4f369-0ee1-440e-8004-3c052ec73308 tempest-VolumesListAdminTestJSON-572089667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.451s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:11 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-13b4f369-0ee1-440e-8004-3c052ec73308 tempest-VolumesListAdminTestJSON-572089667 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:51:11 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-13b4f369-0ee1-440e-8004-3c052ec73308 tempest-VolumesListAdminTestJSON-572089667 None] Deleted volume successfully. Aug 10 12:51:11 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-22787af3-b523-458a-b908-a60e61b5720b tempest-VolumeQuotasAdminTestJSON-1067411710 None] Lock "cinder-quobyte-f2bce97d-75be-4635-81f5-3b9e4ab2118b" acquired by "delete_volume" :: waited 0.027s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:51:11 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[278fcba5-38bb-46b1-affd-50e7f43bcfd4]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:51:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-22787af3-b523-458a-b908-a60e61b5720b tempest-VolumeQuotasAdminTestJSON-1067411710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f2bce97d-75be-4635-81f5-3b9e4ab2118b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:12 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-13b4f369-0ee1-440e-8004-3c052ec73308 tempest-VolumesListAdminTestJSON-572089667 None] Lock "cinder-9b699aa4-e129-4ec9-8e3f-633d7396a479-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:51:12 devstack sudo[95347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f2bce97d-75be-4635-81f5-3b9e4ab2118b Aug 10 12:51:12 devstack sudo[95347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:12 devstack sudo[95347]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-22787af3-b523-458a-b908-a60e61b5720b tempest-VolumeQuotasAdminTestJSON-1067411710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f2bce97d-75be-4635-81f5-3b9e4ab2118b" returned: 0 in 0.440s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-22787af3-b523-458a-b908-a60e61b5720b tempest-VolumeQuotasAdminTestJSON-1067411710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f2bce97d-75be-4635-81f5-3b9e4ab2118b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:12 devstack sudo[95352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f2bce97d-75be-4635-81f5-3b9e4ab2118b Aug 10 12:51:12 devstack sudo[95352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:12 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-377b1fbc-d65d-48aa-be41-f76e493182b8 tempest-VolumesListAdminTestJSON-572089667 None] Acquiring lock "cinder-6e093d05-876b-4320-bfb4-d371428cd092-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:51:12 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-377b1fbc-d65d-48aa-be41-f76e493182b8 tempest-VolumesListAdminTestJSON-572089667 None] Lock "cinder-6e093d05-876b-4320-bfb4-d371428cd092-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:51:12 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-377b1fbc-d65d-48aa-be41-f76e493182b8 tempest-VolumesListAdminTestJSON-572089667 None] Acquiring lock "cinder-quobyte-6e093d05-876b-4320-bfb4-d371428cd092" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:51:12 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-377b1fbc-d65d-48aa-be41-f76e493182b8 tempest-VolumesListAdminTestJSON-572089667 None] Lock "cinder-quobyte-6e093d05-876b-4320-bfb4-d371428cd092" acquired by "delete_volume" :: waited 0.020s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:51:12 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfe1de2-0686-4317-b708-865a8ea23f66]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:51:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-377b1fbc-d65d-48aa-be41-f76e493182b8 tempest-VolumesListAdminTestJSON-572089667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e093d05-876b-4320-bfb4-d371428cd092 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:12 devstack sudo[95354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e093d05-876b-4320-bfb4-d371428cd092 Aug 10 12:51:12 devstack sudo[95354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:12 devstack sudo[95352]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-22787af3-b523-458a-b908-a60e61b5720b tempest-VolumeQuotasAdminTestJSON-1067411710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f2bce97d-75be-4635-81f5-3b9e4ab2118b" returned: 0 in 0.498s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:12 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-22787af3-b523-458a-b908-a60e61b5720b tempest-VolumeQuotasAdminTestJSON-1067411710 None] Lock "cinder-quobyte-f2bce97d-75be-4635-81f5-3b9e4ab2118b" released by "delete_volume" :: held 1.004s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:51:13 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-22787af3-b523-458a-b908-a60e61b5720b tempest-VolumeQuotasAdminTestJSON-1067411710 None] Created reservations ['db2529f4-2592-439e-ada4-70aad4294be1', '56a3ffe0-34d3-47ea-aad5-1046d2fbdc79', 'a949cc94-8096-48af-8506-6cc831e36131', '5b124667-338c-44e3-8a5b-7af43d2f99b8'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:51:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-22787af3-b523-458a-b908-a60e61b5720b tempest-VolumeQuotasAdminTestJSON-1067411710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:51:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-22787af3-b523-458a-b908-a60e61b5720b tempest-VolumeQuotasAdminTestJSON-1067411710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:51:13 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-22787af3-b523-458a-b908-a60e61b5720b tempest-VolumeQuotasAdminTestJSON-1067411710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:51:13 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-22787af3-b523-458a-b908-a60e61b5720b tempest-VolumeQuotasAdminTestJSON-1067411710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:51:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-22787af3-b523-458a-b908-a60e61b5720b tempest-VolumeQuotasAdminTestJSON-1067411710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:51:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-22787af3-b523-458a-b908-a60e61b5720b tempest-VolumeQuotasAdminTestJSON-1067411710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:13 devstack sudo[95361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:51:13 devstack sudo[95354]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:13 devstack sudo[95361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-377b1fbc-d65d-48aa-be41-f76e493182b8 tempest-VolumesListAdminTestJSON-572089667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e093d05-876b-4320-bfb4-d371428cd092" returned: 0 in 0.585s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-377b1fbc-d65d-48aa-be41-f76e493182b8 tempest-VolumesListAdminTestJSON-572089667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e093d05-876b-4320-bfb4-d371428cd092 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:13 devstack sudo[95364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e093d05-876b-4320-bfb4-d371428cd092 Aug 10 12:51:13 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:13 devstack sudo[95361]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-22787af3-b523-458a-b908-a60e61b5720b tempest-VolumeQuotasAdminTestJSON-1067411710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.334s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:13 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-22787af3-b523-458a-b908-a60e61b5720b tempest-VolumeQuotasAdminTestJSON-1067411710 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:51:13 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-22787af3-b523-458a-b908-a60e61b5720b tempest-VolumeQuotasAdminTestJSON-1067411710 None] Deleted volume successfully. Aug 10 12:51:13 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-22787af3-b523-458a-b908-a60e61b5720b tempest-VolumeQuotasAdminTestJSON-1067411710 None] Lock "cinder-f2bce97d-75be-4635-81f5-3b9e4ab2118b-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:51:13 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-377b1fbc-d65d-48aa-be41-f76e493182b8 tempest-VolumesListAdminTestJSON-572089667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e093d05-876b-4320-bfb4-d371428cd092" returned: 0 in 0.367s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:13 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-377b1fbc-d65d-48aa-be41-f76e493182b8 tempest-VolumesListAdminTestJSON-572089667 None] Lock "cinder-quobyte-6e093d05-876b-4320-bfb4-d371428cd092" released by "delete_volume" :: held 1.039s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:51:13 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-377b1fbc-d65d-48aa-be41-f76e493182b8 tempest-VolumesListAdminTestJSON-572089667 None] Created reservations ['dece8d1e-ae9c-409e-b837-1229cdc5a833', 'ae69d297-8acd-419f-af38-8a8628b2bdc6', '711b13d3-ad2b-4703-a417-e421a263f046', 'c411ed43-bb76-48df-81c5-4aa50fedb201'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:51:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-377b1fbc-d65d-48aa-be41-f76e493182b8 tempest-VolumesListAdminTestJSON-572089667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:51:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-377b1fbc-d65d-48aa-be41-f76e493182b8 tempest-VolumesListAdminTestJSON-572089667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:51:13 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-377b1fbc-d65d-48aa-be41-f76e493182b8 tempest-VolumesListAdminTestJSON-572089667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:51:13 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-377b1fbc-d65d-48aa-be41-f76e493182b8 tempest-VolumesListAdminTestJSON-572089667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:51:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-377b1fbc-d65d-48aa-be41-f76e493182b8 tempest-VolumesListAdminTestJSON-572089667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:51:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-377b1fbc-d65d-48aa-be41-f76e493182b8 tempest-VolumesListAdminTestJSON-572089667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:13 devstack sudo[95368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:51:13 devstack sudo[95368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:14 devstack sudo[95368]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-377b1fbc-d65d-48aa-be41-f76e493182b8 tempest-VolumesListAdminTestJSON-572089667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.265s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:14 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-377b1fbc-d65d-48aa-be41-f76e493182b8 tempest-VolumesListAdminTestJSON-572089667 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:51:14 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-377b1fbc-d65d-48aa-be41-f76e493182b8 tempest-VolumesListAdminTestJSON-572089667 None] Deleted volume successfully. Aug 10 12:51:14 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-377b1fbc-d65d-48aa-be41-f76e493182b8 tempest-VolumesListAdminTestJSON-572089667 None] Lock "cinder-6e093d05-876b-4320-bfb4-d371428cd092-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:51:23 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-29491683-1f6a-4e23-8955-1f049d367705 tempest-VolumesServicesTestJSON-1715401666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:51:23 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-29491683-1f6a-4e23-8955-1f049d367705 tempest-VolumesServicesTestJSON-1715401666 None] Flow 'volume_create_manager' (e6898d3b-22cc-443a-b5ef-7dd16c2607bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:51:23 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-29491683-1f6a-4e23-8955-1f049d367705 tempest-VolumesServicesTestJSON-1715401666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11144056-0fa6-4129-9eda-30e5b5b6f310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:23 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-29491683-1f6a-4e23-8955-1f049d367705 tempest-VolumesServicesTestJSON-1715401666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11144056-0fa6-4129-9eda-30e5b5b6f310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2137401388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a11713b7-6895-4522-a5ba-bd6f92688d55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df8ecbbb4c644a40903d83fca72d52de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:51:23Z,use_quota=True,user_id='2d49659e32454e92a3adc1fbaf8bd7d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:23 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-29491683-1f6a-4e23-8955-1f049d367705 tempest-VolumesServicesTestJSON-1715401666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e5d77e5-2353-423e-a8b3-9b84c48fc323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:23 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-29491683-1f6a-4e23-8955-1f049d367705 tempest-VolumesServicesTestJSON-1715401666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e5d77e5-2353-423e-a8b3-9b84c48fc323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:23 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-29491683-1f6a-4e23-8955-1f049d367705 tempest-VolumesServicesTestJSON-1715401666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e592b83-8d66-4f2f-8569-835a37a02387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:23 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-29491683-1f6a-4e23-8955-1f049d367705 tempest-VolumesServicesTestJSON-1715401666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e592b83-8d66-4f2f-8569-835a37a02387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a11713b7-6895-4522-a5ba-bd6f92688d55', 'volume_name': 'volume-a11713b7-6895-4522-a5ba-bd6f92688d55', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:23 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-29491683-1f6a-4e23-8955-1f049d367705 tempest-VolumesServicesTestJSON-1715401666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ba1af1c-42e4-4426-be9c-18e39ec4ca36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:23 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-29491683-1f6a-4e23-8955-1f049d367705 tempest-VolumesServicesTestJSON-1715401666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ba1af1c-42e4-4426-be9c-18e39ec4ca36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:23 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-29491683-1f6a-4e23-8955-1f049d367705 tempest-VolumesServicesTestJSON-1715401666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (172bb9ca-da69-4e6f-a09c-825be6bb837c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:23 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-29491683-1f6a-4e23-8955-1f049d367705 tempest-VolumesServicesTestJSON-1715401666 None] Volume a11713b7-6895-4522-a5ba-bd6f92688d55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a11713b7-6895-4522-a5ba-bd6f92688d55', 'volume_size': 1} Aug 10 12:51:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-29491683-1f6a-4e23-8955-1f049d367705 tempest-VolumesServicesTestJSON-1715401666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:51:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-29491683-1f6a-4e23-8955-1f049d367705 tempest-VolumesServicesTestJSON-1715401666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:51:23 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-29491683-1f6a-4e23-8955-1f049d367705 tempest-VolumesServicesTestJSON-1715401666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2137401388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a11713b7-6895-4522-a5ba-bd6f92688d55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df8ecbbb4c644a40903d83fca72d52de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:51:23Z,use_quota=True,user_id='2d49659e32454e92a3adc1fbaf8bd7d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:51:23 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-29491683-1f6a-4e23-8955-1f049d367705 tempest-VolumesServicesTestJSON-1715401666 None] Creating volume a11713b7-6895-4522-a5ba-bd6f92688d55 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:51:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-29491683-1f6a-4e23-8955-1f049d367705 tempest-VolumesServicesTestJSON-1715401666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:51:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-29491683-1f6a-4e23-8955-1f049d367705 tempest-VolumesServicesTestJSON-1715401666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:51:23 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-29491683-1f6a-4e23-8955-1f049d367705 tempest-VolumesServicesTestJSON-1715401666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:51:23 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-29491683-1f6a-4e23-8955-1f049d367705 tempest-VolumesServicesTestJSON-1715401666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:51:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-29491683-1f6a-4e23-8955-1f049d367705 tempest-VolumesServicesTestJSON-1715401666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:51:23 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-29491683-1f6a-4e23-8955-1f049d367705 tempest-VolumesServicesTestJSON-1715401666 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:51:23 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-29491683-1f6a-4e23-8955-1f049d367705 tempest-VolumesServicesTestJSON-1715401666 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:51:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-29491683-1f6a-4e23-8955-1f049d367705 tempest-VolumesServicesTestJSON-1715401666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a11713b7-6895-4522-a5ba-bd6f92688d55 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:23 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a11713b7-6895-4522-a5ba-bd6f92688d55 1073741824 Aug 10 12:51:23 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:23 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:51:23 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Flow 'volume_create_manager' (afb21c26-b6c4-4ab7-81be-25ca665e4ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:51:23 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1871199-1f6e-4bff-956b-b9112a9ee375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:23 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1871199-1f6e-4bff-956b-b9112a9ee375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1258004924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dd2ed21-c424-41bc-8282-a49dbc8fb68e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='681b4250d8e149a99a74c0a88aed9147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:51:24Z,use_quota=True,user_id='79333c04d8ab4480a97a4d677049567c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:23 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c6f674c-b1e5-443a-95fd-04e18bc3e304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:23 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c6f674c-b1e5-443a-95fd-04e18bc3e304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:23 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d9e7a6-04eb-42aa-bf56-7a9148f6319c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:23 devstack cinder-volume[89096]: DEBUG cinder.image.glance [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Creating Keystone auth plugin from conf {{(pid=89096) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 10 12:51:23 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-29491683-1f6a-4e23-8955-1f049d367705 tempest-VolumesServicesTestJSON-1715401666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a11713b7-6895-4522-a5ba-bd6f92688d55 1073741824" returned: 0 in 0.472s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-29491683-1f6a-4e23-8955-1f049d367705 tempest-VolumesServicesTestJSON-1715401666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a11713b7-6895-4522-a5ba-bd6f92688d55 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:23 devstack sudo[95439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a11713b7-6895-4522-a5ba-bd6f92688d55 Aug 10 12:51:23 devstack sudo[95439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:24 devstack sudo[95439]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-29491683-1f6a-4e23-8955-1f049d367705 tempest-VolumesServicesTestJSON-1715401666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a11713b7-6895-4522-a5ba-bd6f92688d55" returned: 0 in 0.275s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:24 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-29491683-1f6a-4e23-8955-1f049d367705 tempest-VolumesServicesTestJSON-1715401666 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:51:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-29491683-1f6a-4e23-8955-1f049d367705 tempest-VolumesServicesTestJSON-1715401666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:51:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-29491683-1f6a-4e23-8955-1f049d367705 tempest-VolumesServicesTestJSON-1715401666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (172bb9ca-da69-4e6f-a09c-825be6bb837c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a11713b7-6895-4522-a5ba-bd6f92688d55', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-29491683-1f6a-4e23-8955-1f049d367705 tempest-VolumesServicesTestJSON-1715401666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9522fc2-4894-4283-b4a2-ec88bf2b70b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:24 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-29491683-1f6a-4e23-8955-1f049d367705 tempest-VolumesServicesTestJSON-1715401666 None] Volume volume-a11713b7-6895-4522-a5ba-bd6f92688d55 (a11713b7-6895-4522-a5ba-bd6f92688d55): created successfully Aug 10 12:51:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-29491683-1f6a-4e23-8955-1f049d367705 tempest-VolumesServicesTestJSON-1715401666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9522fc2-4894-4283-b4a2-ec88bf2b70b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-29491683-1f6a-4e23-8955-1f049d367705 tempest-VolumesServicesTestJSON-1715401666 None] Flow 'volume_create_manager' (e6898d3b-22cc-443a-b5ef-7dd16c2607bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:51:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d9e7a6-04eb-42aa-bf56-7a9148f6319c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8dd2ed21-c424-41bc-8282-a49dbc8fb68e', 'volume_name': 'volume-8dd2ed21-c424-41bc-8282-a49dbc8fb68e', 'volume_size': 1, 'image_id': 'd127b0c1-c6db-4978-8f85-71a25140f15c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d127b0c1-c6db-4978-8f85-71a25140f15c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '84a7884b15744611bf66a9a12c498e2b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd127b0c1-c6db-4978-8f85-71a25140f15c', 'created_at': datetime.datetime(2026, 8, 10, 10, 40, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 10, 40, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d127b0c1-c6db-4978-8f85-71a25140f15c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57ca5ab2-2727-4801-976d-eab6d6c2e94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57ca5ab2-2727-4801-976d-eab6d6c2e94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cce96c65-e74b-4ca1-ad93-a8985fade5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:24 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Volume 8dd2ed21-c424-41bc-8282-a49dbc8fb68e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8dd2ed21-c424-41bc-8282-a49dbc8fb68e', 'volume_size': 1, 'image_id': 'd127b0c1-c6db-4978-8f85-71a25140f15c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d127b0c1-c6db-4978-8f85-71a25140f15c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '84a7884b15744611bf66a9a12c498e2b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd127b0c1-c6db-4978-8f85-71a25140f15c', 'created_at': datetime.datetime(2026, 8, 10, 10, 40, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 10, 40, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d127b0c1-c6db-4978-8f85-71a25140f15c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 10 12:51:24 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Trying to clone 8dd2ed21-c424-41bc-8282-a49dbc8fb68e from image d127b0c1-c6db-4978-8f85-71a25140f15c at location (None, [{'url': 'file:///opt/stack/data/glance/images/d127b0c1-c6db-4978-8f85-71a25140f15c', 'metadata': {}}]). {{(pid=89096) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 10 12:51:24 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-29491683-1f6a-4e23-8955-1f049d367705 tempest-VolumesServicesTestJSON-1715401666 None] Created volume successfully. Aug 10 12:51:24 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_oat9yn8ddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89096) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 10 12:51:24 devstack cinder-volume[89096]: INFO cinder.image.image_utils [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Image download 20.69 MB at 20.69 MB/s Aug 10 12:51:24 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c32698-fc91-4650-911c-25c4e56c9232]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:51:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_oat9yn8ddevstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:24 devstack sudo[95463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_oat9yn8ddevstack@QuobyteHD Aug 10 12:51:24 devstack sudo[95463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:24 devstack sudo[95463]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_oat9yn8ddevstack@QuobyteHD" returned: 0 in 0.328s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:24 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Temporary image d127b0c1-c6db-4978-8f85-71a25140f15c is fetched for user 79333c04d8ab4480a97a4d677049567c. {{(pid=89096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 10 12:51:24 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bc8d51-5adf-4ed5-8930-e9d3531891a0]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:51:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_oat9yn8ddevstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:25 devstack sudo[95468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_oat9yn8ddevstack@QuobyteHD Aug 10 12:51:25 devstack sudo[95468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:25 devstack sudo[95468]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_oat9yn8ddevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:51:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:51:25 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1258004924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dd2ed21-c424-41bc-8282-a49dbc8fb68e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='681b4250d8e149a99a74c0a88aed9147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:51:24Z,use_quota=True,user_id='79333c04d8ab4480a97a4d677049567c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:51:25 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Creating volume 8dd2ed21-c424-41bc-8282-a49dbc8fb68e {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:51:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:51:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:51:25 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:51:25 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:51:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:51:25 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:51:25 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:51:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8dd2ed21-c424-41bc-8282-a49dbc8fb68e 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:25 devstack sudo[95473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8dd2ed21-c424-41bc-8282-a49dbc8fb68e 1073741824 Aug 10 12:51:25 devstack sudo[95473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f2b14bd0-d674-4730-a0e8-c85f10f4d733 tempest-VolumesServicesTestJSON-1715401666 None] Acquiring lock "cinder-a11713b7-6895-4522-a5ba-bd6f92688d55-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:51:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f2b14bd0-d674-4730-a0e8-c85f10f4d733 tempest-VolumesServicesTestJSON-1715401666 None] Lock "cinder-a11713b7-6895-4522-a5ba-bd6f92688d55-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:51:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f2b14bd0-d674-4730-a0e8-c85f10f4d733 tempest-VolumesServicesTestJSON-1715401666 None] Acquiring lock "cinder-quobyte-a11713b7-6895-4522-a5ba-bd6f92688d55" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:51:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f2b14bd0-d674-4730-a0e8-c85f10f4d733 tempest-VolumesServicesTestJSON-1715401666 None] Lock "cinder-quobyte-a11713b7-6895-4522-a5ba-bd6f92688d55" acquired by "delete_volume" :: waited 0.019s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:51:25 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[2211296d-8bf7-4b4f-8988-86f03ebf28ad]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:51:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f2b14bd0-d674-4730-a0e8-c85f10f4d733 tempest-VolumesServicesTestJSON-1715401666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a11713b7-6895-4522-a5ba-bd6f92688d55 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:25 devstack sudo[95478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a11713b7-6895-4522-a5ba-bd6f92688d55 Aug 10 12:51:25 devstack sudo[95478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:25 devstack sudo[95473]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8dd2ed21-c424-41bc-8282-a49dbc8fb68e 1073741824" returned: 0 in 0.486s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8dd2ed21-c424-41bc-8282-a49dbc8fb68e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:25 devstack sudo[95480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8dd2ed21-c424-41bc-8282-a49dbc8fb68e Aug 10 12:51:25 devstack sudo[95480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:25 devstack sudo[95478]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f2b14bd0-d674-4730-a0e8-c85f10f4d733 tempest-VolumesServicesTestJSON-1715401666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a11713b7-6895-4522-a5ba-bd6f92688d55" returned: 0 in 0.392s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f2b14bd0-d674-4730-a0e8-c85f10f4d733 tempest-VolumesServicesTestJSON-1715401666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a11713b7-6895-4522-a5ba-bd6f92688d55 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:25 devstack sudo[95485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a11713b7-6895-4522-a5ba-bd6f92688d55 Aug 10 12:51:25 devstack sudo[95485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:26 devstack sudo[95480]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8dd2ed21-c424-41bc-8282-a49dbc8fb68e" returned: 0 in 0.252s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:26 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:51:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:51:26 devstack cinder-volume[89096]: DEBUG cinder.volume.volume_utils [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Attempting download of d127b0c1-c6db-4978-8f85-71a25140f15c ((None, [{'url': 'file:///opt/stack/data/glance/images/d127b0c1-c6db-4978-8f85-71a25140f15c', 'metadata': {}}])) to volume 8dd2ed21-c424-41bc-8282-a49dbc8fb68e. {{(pid=89096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 10 12:51:26 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[747c2b36-405e-4ea5-adf3-d0b43ac1b754]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:51:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d127b0c1-c6db-4978-8f85-71a25140f15c_4p1j3iit {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:26 devstack sudo[95485]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f2b14bd0-d674-4730-a0e8-c85f10f4d733 tempest-VolumesServicesTestJSON-1715401666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a11713b7-6895-4522-a5ba-bd6f92688d55" returned: 0 in 0.255s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:26 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f2b14bd0-d674-4730-a0e8-c85f10f4d733 tempest-VolumesServicesTestJSON-1715401666 None] Lock "cinder-quobyte-a11713b7-6895-4522-a5ba-bd6f92688d55" released by "delete_volume" :: held 0.687s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:51:26 devstack sudo[95488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d127b0c1-c6db-4978-8f85-71a25140f15c_4p1j3iit Aug 10 12:51:26 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:26 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-f2b14bd0-d674-4730-a0e8-c85f10f4d733 tempest-VolumesServicesTestJSON-1715401666 None] Created reservations ['9a2c46f3-f827-48ea-ac5e-9e9f2cd2008d', '19dfc02c-6f56-4dbb-8d20-62674f58a774', '81f55f9b-2af2-4328-bd9b-0bde4b5ffb9d', '83f1ba7a-9521-45e5-9402-3cc069e7caf6'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:51:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f2b14bd0-d674-4730-a0e8-c85f10f4d733 tempest-VolumesServicesTestJSON-1715401666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:51:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f2b14bd0-d674-4730-a0e8-c85f10f4d733 tempest-VolumesServicesTestJSON-1715401666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:51:26 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f2b14bd0-d674-4730-a0e8-c85f10f4d733 tempest-VolumesServicesTestJSON-1715401666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:51:26 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f2b14bd0-d674-4730-a0e8-c85f10f4d733 tempest-VolumesServicesTestJSON-1715401666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:51:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f2b14bd0-d674-4730-a0e8-c85f10f4d733 tempest-VolumesServicesTestJSON-1715401666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:51:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f2b14bd0-d674-4730-a0e8-c85f10f4d733 tempest-VolumesServicesTestJSON-1715401666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:26 devstack sudo[95491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:51:26 devstack sudo[95491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:26 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d127b0c1-c6db-4978-8f85-71a25140f15c_4p1j3iit" returned: 0 in 0.327s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d127b0c1-c6db-4978-8f85-71a25140f15c_4p1j3iit {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:26 devstack sudo[95495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d127b0c1-c6db-4978-8f85-71a25140f15c_4p1j3iit Aug 10 12:51:26 devstack sudo[95495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:26 devstack sudo[95491]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f2b14bd0-d674-4730-a0e8-c85f10f4d733 tempest-VolumesServicesTestJSON-1715401666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.283s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:26 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-f2b14bd0-d674-4730-a0e8-c85f10f4d733 tempest-VolumesServicesTestJSON-1715401666 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:51:26 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-f2b14bd0-d674-4730-a0e8-c85f10f4d733 tempest-VolumesServicesTestJSON-1715401666 None] Deleted volume successfully. Aug 10 12:51:26 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f2b14bd0-d674-4730-a0e8-c85f10f4d733 tempest-VolumesServicesTestJSON-1715401666 None] Lock "cinder-a11713b7-6895-4522-a5ba-bd6f92688d55-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:51:26 devstack sudo[95495]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d127b0c1-c6db-4978-8f85-71a25140f15c_4p1j3iit" returned: 1 in 0.356s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d127b0c1-c6db-4978-8f85-71a25140f15c_4p1j3iit' failed. Not Retrying. {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 12:51:26 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae343aa1-be1a-45b6-b2b1-0611c65d71f0]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:51:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_oat9yn8ddevstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:26 devstack sudo[95500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_oat9yn8ddevstack@QuobyteHD Aug 10 12:51:26 devstack sudo[95500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:27 devstack sudo[95500]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_oat9yn8ddevstack@QuobyteHD" returned: 0 in 0.334s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:27 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] d127b0c1-c6db-4978-8f85-71a25140f15c was qcow2, converting to qcow2 {{(pid=89096) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 10 12:51:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_oat9yn8ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8dd2ed21-c424-41bc-8282-a49dbc8fb68e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:27 devstack sudo[95505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_oat9yn8ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8dd2ed21-c424-41bc-8282-a49dbc8fb68e Aug 10 12:51:27 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:29 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_oat9yn8ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8dd2ed21-c424-41bc-8282-a49dbc8fb68e" returned: 0 in 2.046s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:29 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_oat9yn8ddevstack@QuobyteHD, size 112.00 MB, duration 2.05 sec, destination /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8dd2ed21-c424-41bc-8282-a49dbc8fb68e {{(pid=89096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 12:51:29 devstack cinder-volume[89096]: INFO cinder.image.image_utils [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Converted 112.00 MB image at 54.70 MB/s Aug 10 12:51:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8dd2ed21-c424-41bc-8282-a49dbc8fb68e 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:29 devstack sudo[95516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8dd2ed21-c424-41bc-8282-a49dbc8fb68e 1G Aug 10 12:51:29 devstack sudo[95516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:29 devstack sudo[95516]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8dd2ed21-c424-41bc-8282-a49dbc8fb68e 1G" returned: 0 in 0.372s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:29 devstack cinder-volume[89096]: DEBUG cinder.volume.volume_utils [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Downloaded image d127b0c1-c6db-4978-8f85-71a25140f15c ((None, [{'url': 'file:///opt/stack/data/glance/images/d127b0c1-c6db-4978-8f85-71a25140f15c', 'metadata': {}}])) to volume 8dd2ed21-c424-41bc-8282-a49dbc8fb68e successfully. {{(pid=89096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 10 12:51:29 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Temporary image d127b0c1-c6db-4978-8f85-71a25140f15c for user 79333c04d8ab4480a97a4d677049567c is deleted. {{(pid=89096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 10 12:51:29 devstack cinder-volume[89096]: DEBUG cinder.volume.volume_utils [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Marking volume 8dd2ed21-c424-41bc-8282-a49dbc8fb68e as bootable. {{(pid=89096) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 10 12:51:29 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Copying metadata from image d127b0c1-c6db-4978-8f85-71a25140f15c to 8dd2ed21-c424-41bc-8282-a49dbc8fb68e. {{(pid=89096) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 10 12:51:29 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Creating volume glance metadata for volume 8dd2ed21-c424-41bc-8282-a49dbc8fb68e backed by image d127b0c1-c6db-4978-8f85-71a25140f15c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd127b0c1-c6db-4978-8f85-71a25140f15c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89096) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 10 12:51:29 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cce96c65-e74b-4ca1-ad93-a8985fade5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dd2ed21-c424-41bc-8282-a49dbc8fb68e', 'volume_size': 1, 'image_id': 'd127b0c1-c6db-4978-8f85-71a25140f15c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d127b0c1-c6db-4978-8f85-71a25140f15c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '84a7884b15744611bf66a9a12c498e2b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd127b0c1-c6db-4978-8f85-71a25140f15c', 'created_at': datetime.datetime(2026, 8, 10, 10, 40, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 10, 40, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d127b0c1-c6db-4978-8f85-71a25140f15c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:29 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6be8a8d-8995-47c4-a045-15e26895c6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:29 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Volume volume-8dd2ed21-c424-41bc-8282-a49dbc8fb68e (8dd2ed21-c424-41bc-8282-a49dbc8fb68e): created successfully Aug 10 12:51:29 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6be8a8d-8995-47c4-a045-15e26895c6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:29 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Flow 'volume_create_manager' (afb21c26-b6c4-4ab7-81be-25ca665e4ca6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:51:29 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-1caac09f-3b22-4a07-93ab-97bbc2fb2199 tempest-VolumesImageMetadata-733862515 None] Created volume successfully. Aug 10 12:51:30 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d45971bf-448d-4416-af9a-a074097e1b53 tempest-VolumesImageMetadata-733862515 None] Acquiring lock "cinder-8dd2ed21-c424-41bc-8282-a49dbc8fb68e-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:51:30 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d45971bf-448d-4416-af9a-a074097e1b53 tempest-VolumesImageMetadata-733862515 None] Lock "cinder-8dd2ed21-c424-41bc-8282-a49dbc8fb68e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:51:30 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d45971bf-448d-4416-af9a-a074097e1b53 tempest-VolumesImageMetadata-733862515 None] Acquiring lock "cinder-quobyte-8dd2ed21-c424-41bc-8282-a49dbc8fb68e" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:51:30 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d45971bf-448d-4416-af9a-a074097e1b53 tempest-VolumesImageMetadata-733862515 None] Lock "cinder-quobyte-8dd2ed21-c424-41bc-8282-a49dbc8fb68e" acquired by "delete_volume" :: waited 0.033s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:51:30 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c73334-c923-4a3f-9e1e-416751ca475e]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:51:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d45971bf-448d-4416-af9a-a074097e1b53 tempest-VolumesImageMetadata-733862515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8dd2ed21-c424-41bc-8282-a49dbc8fb68e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:30 devstack sudo[95521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8dd2ed21-c424-41bc-8282-a49dbc8fb68e Aug 10 12:51:30 devstack sudo[95521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:30 devstack sudo[95521]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d45971bf-448d-4416-af9a-a074097e1b53 tempest-VolumesImageMetadata-733862515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8dd2ed21-c424-41bc-8282-a49dbc8fb68e" returned: 0 in 0.404s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d45971bf-448d-4416-af9a-a074097e1b53 tempest-VolumesImageMetadata-733862515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8dd2ed21-c424-41bc-8282-a49dbc8fb68e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:30 devstack sudo[95527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8dd2ed21-c424-41bc-8282-a49dbc8fb68e Aug 10 12:51:30 devstack sudo[95527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:31 devstack sudo[95527]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d45971bf-448d-4416-af9a-a074097e1b53 tempest-VolumesImageMetadata-733862515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8dd2ed21-c424-41bc-8282-a49dbc8fb68e" returned: 0 in 0.270s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:31 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d45971bf-448d-4416-af9a-a074097e1b53 tempest-VolumesImageMetadata-733862515 None] Lock "cinder-quobyte-8dd2ed21-c424-41bc-8282-a49dbc8fb68e" released by "delete_volume" :: held 0.721s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:51:31 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-d45971bf-448d-4416-af9a-a074097e1b53 tempest-VolumesImageMetadata-733862515 None] Created reservations ['474417ae-ffa0-4a6f-b060-d372c1b64c34', 'caccb8b2-4f5c-4acb-9618-69f50505ebe7', 'c1455452-867e-407f-a6e2-42cbebc4ef1a', '69e466b7-abe2-4873-959a-788fd4d04ac2'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:51:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d45971bf-448d-4416-af9a-a074097e1b53 tempest-VolumesImageMetadata-733862515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:51:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d45971bf-448d-4416-af9a-a074097e1b53 tempest-VolumesImageMetadata-733862515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:51:31 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-d45971bf-448d-4416-af9a-a074097e1b53 tempest-VolumesImageMetadata-733862515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:51:31 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-d45971bf-448d-4416-af9a-a074097e1b53 tempest-VolumesImageMetadata-733862515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:51:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d45971bf-448d-4416-af9a-a074097e1b53 tempest-VolumesImageMetadata-733862515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:51:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d45971bf-448d-4416-af9a-a074097e1b53 tempest-VolumesImageMetadata-733862515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:31 devstack sudo[95530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:51:31 devstack sudo[95530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:31 devstack sudo[95530]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d45971bf-448d-4416-af9a-a074097e1b53 tempest-VolumesImageMetadata-733862515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.255s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:31 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-d45971bf-448d-4416-af9a-a074097e1b53 tempest-VolumesImageMetadata-733862515 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:51:31 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-d45971bf-448d-4416-af9a-a074097e1b53 tempest-VolumesImageMetadata-733862515 None] Deleted volume successfully. Aug 10 12:51:31 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d45971bf-448d-4416-af9a-a074097e1b53 tempest-VolumesImageMetadata-733862515 None] Lock "cinder-8dd2ed21-c424-41bc-8282-a49dbc8fb68e-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:51:33 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-be2ddceb-ec66-4926-9680-f60a5b5bc937 tempest-AttachVolumeNegativeTest-1896074937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:51:33 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-be2ddceb-ec66-4926-9680-f60a5b5bc937 tempest-AttachVolumeNegativeTest-1896074937 None] Flow 'volume_create_manager' (59e9218f-e6db-4c26-9a03-50458c44b5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:51:33 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-be2ddceb-ec66-4926-9680-f60a5b5bc937 tempest-AttachVolumeNegativeTest-1896074937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18b69645-ea46-4bf7-8fdc-3efac27cbf81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:33 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-be2ddceb-ec66-4926-9680-f60a5b5bc937 tempest-AttachVolumeNegativeTest-1896074937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18b69645-ea46-4bf7-8fdc-3efac27cbf81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-101347559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db622a62-1813-4ff6-baae-fd3a8fdbd58d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5b7c20bff74031ba08276f3ede2b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:51:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:51:34Z,use_quota=True,user_id='d1f4d36b032f47449d58b9d791297bf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:33 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-be2ddceb-ec66-4926-9680-f60a5b5bc937 tempest-AttachVolumeNegativeTest-1896074937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (531960c4-e194-4a33-87ac-e1190dbfe51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:33 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-be2ddceb-ec66-4926-9680-f60a5b5bc937 tempest-AttachVolumeNegativeTest-1896074937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (531960c4-e194-4a33-87ac-e1190dbfe51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:33 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-be2ddceb-ec66-4926-9680-f60a5b5bc937 tempest-AttachVolumeNegativeTest-1896074937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae6c894-67e7-4bad-8164-b70b4426a57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:33 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-be2ddceb-ec66-4926-9680-f60a5b5bc937 tempest-AttachVolumeNegativeTest-1896074937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae6c894-67e7-4bad-8164-b70b4426a57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db622a62-1813-4ff6-baae-fd3a8fdbd58d', 'volume_name': 'volume-db622a62-1813-4ff6-baae-fd3a8fdbd58d', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:33 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-be2ddceb-ec66-4926-9680-f60a5b5bc937 tempest-AttachVolumeNegativeTest-1896074937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (171ee96c-1181-42be-a3e3-1a49513c87cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:33 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-be2ddceb-ec66-4926-9680-f60a5b5bc937 tempest-AttachVolumeNegativeTest-1896074937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (171ee96c-1181-42be-a3e3-1a49513c87cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:33 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-be2ddceb-ec66-4926-9680-f60a5b5bc937 tempest-AttachVolumeNegativeTest-1896074937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58f7eef0-c2a0-40b3-ad31-ac9b69e38dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:33 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-be2ddceb-ec66-4926-9680-f60a5b5bc937 tempest-AttachVolumeNegativeTest-1896074937 None] Volume db622a62-1813-4ff6-baae-fd3a8fdbd58d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db622a62-1813-4ff6-baae-fd3a8fdbd58d', 'volume_size': 1} Aug 10 12:51:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-be2ddceb-ec66-4926-9680-f60a5b5bc937 tempest-AttachVolumeNegativeTest-1896074937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:51:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-be2ddceb-ec66-4926-9680-f60a5b5bc937 tempest-AttachVolumeNegativeTest-1896074937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:51:33 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-be2ddceb-ec66-4926-9680-f60a5b5bc937 tempest-AttachVolumeNegativeTest-1896074937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-101347559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db622a62-1813-4ff6-baae-fd3a8fdbd58d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5b7c20bff74031ba08276f3ede2b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:51:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:51:34Z,use_quota=True,user_id='d1f4d36b032f47449d58b9d791297bf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:51:33 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-be2ddceb-ec66-4926-9680-f60a5b5bc937 tempest-AttachVolumeNegativeTest-1896074937 None] Creating volume db622a62-1813-4ff6-baae-fd3a8fdbd58d {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:51:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-be2ddceb-ec66-4926-9680-f60a5b5bc937 tempest-AttachVolumeNegativeTest-1896074937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:51:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-be2ddceb-ec66-4926-9680-f60a5b5bc937 tempest-AttachVolumeNegativeTest-1896074937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:51:33 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-be2ddceb-ec66-4926-9680-f60a5b5bc937 tempest-AttachVolumeNegativeTest-1896074937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:51:33 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-be2ddceb-ec66-4926-9680-f60a5b5bc937 tempest-AttachVolumeNegativeTest-1896074937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:51:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-be2ddceb-ec66-4926-9680-f60a5b5bc937 tempest-AttachVolumeNegativeTest-1896074937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:51:33 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-be2ddceb-ec66-4926-9680-f60a5b5bc937 tempest-AttachVolumeNegativeTest-1896074937 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:51:33 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-be2ddceb-ec66-4926-9680-f60a5b5bc937 tempest-AttachVolumeNegativeTest-1896074937 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:51:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-be2ddceb-ec66-4926-9680-f60a5b5bc937 tempest-AttachVolumeNegativeTest-1896074937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-db622a62-1813-4ff6-baae-fd3a8fdbd58d 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:33 devstack sudo[95535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-db622a62-1813-4ff6-baae-fd3a8fdbd58d 1073741824 Aug 10 12:51:33 devstack sudo[95535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:34 devstack sudo[95535]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-be2ddceb-ec66-4926-9680-f60a5b5bc937 tempest-AttachVolumeNegativeTest-1896074937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-db622a62-1813-4ff6-baae-fd3a8fdbd58d 1073741824" returned: 0 in 0.555s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-be2ddceb-ec66-4926-9680-f60a5b5bc937 tempest-AttachVolumeNegativeTest-1896074937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-db622a62-1813-4ff6-baae-fd3a8fdbd58d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:34 devstack sudo[95540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-db622a62-1813-4ff6-baae-fd3a8fdbd58d Aug 10 12:51:34 devstack sudo[95540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:34 devstack sudo[95540]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-be2ddceb-ec66-4926-9680-f60a5b5bc937 tempest-AttachVolumeNegativeTest-1896074937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-db622a62-1813-4ff6-baae-fd3a8fdbd58d" returned: 0 in 0.314s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:34 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-be2ddceb-ec66-4926-9680-f60a5b5bc937 tempest-AttachVolumeNegativeTest-1896074937 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:51:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-be2ddceb-ec66-4926-9680-f60a5b5bc937 tempest-AttachVolumeNegativeTest-1896074937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:51:34 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-be2ddceb-ec66-4926-9680-f60a5b5bc937 tempest-AttachVolumeNegativeTest-1896074937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58f7eef0-c2a0-40b3-ad31-ac9b69e38dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db622a62-1813-4ff6-baae-fd3a8fdbd58d', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:34 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-be2ddceb-ec66-4926-9680-f60a5b5bc937 tempest-AttachVolumeNegativeTest-1896074937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89bf3c3c-9590-4e48-9ab3-d154b3796bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:34 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-be2ddceb-ec66-4926-9680-f60a5b5bc937 tempest-AttachVolumeNegativeTest-1896074937 None] Volume volume-db622a62-1813-4ff6-baae-fd3a8fdbd58d (db622a62-1813-4ff6-baae-fd3a8fdbd58d): created successfully Aug 10 12:51:34 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-be2ddceb-ec66-4926-9680-f60a5b5bc937 tempest-AttachVolumeNegativeTest-1896074937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89bf3c3c-9590-4e48-9ab3-d154b3796bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:34 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-be2ddceb-ec66-4926-9680-f60a5b5bc937 tempest-AttachVolumeNegativeTest-1896074937 None] Flow 'volume_create_manager' (59e9218f-e6db-4c26-9a03-50458c44b5ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:51:34 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-be2ddceb-ec66-4926-9680-f60a5b5bc937 tempest-AttachVolumeNegativeTest-1896074937 None] Created volume successfully. Aug 10 12:51:35 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb72968e-f695-4abf-98a3-d8eda647cff6 tempest-AbsoluteLimitsTests-58706951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:51:35 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-eb72968e-f695-4abf-98a3-d8eda647cff6 tempest-AbsoluteLimitsTests-58706951 None] Flow 'volume_create_manager' (1a6f4caa-e0b5-46e6-bb84-bd4cd016f856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:51:35 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-eb72968e-f695-4abf-98a3-d8eda647cff6 tempest-AbsoluteLimitsTests-58706951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3be76d85-2bc4-473c-a27d-6eefb90bda53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:35 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-eb72968e-f695-4abf-98a3-d8eda647cff6 tempest-AbsoluteLimitsTests-58706951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3be76d85-2bc4-473c-a27d-6eefb90bda53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:51:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-524092790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f1a36b-6fba-408b-9764-68305f5dd42c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce17f75d2fa41dcac3adb9850288db2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:51:36Z,use_quota=True,user_id='e4854b29a28f460b95d77a66c0df8a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:35 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-eb72968e-f695-4abf-98a3-d8eda647cff6 tempest-AbsoluteLimitsTests-58706951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b32d90a9-4c43-43d7-bdf8-0f10a2579588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:35 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-eb72968e-f695-4abf-98a3-d8eda647cff6 tempest-AbsoluteLimitsTests-58706951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b32d90a9-4c43-43d7-bdf8-0f10a2579588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:35 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-eb72968e-f695-4abf-98a3-d8eda647cff6 tempest-AbsoluteLimitsTests-58706951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77684458-213c-4430-84a9-6c494341a5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:35 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-eb72968e-f695-4abf-98a3-d8eda647cff6 tempest-AbsoluteLimitsTests-58706951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77684458-213c-4430-84a9-6c494341a5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61f1a36b-6fba-408b-9764-68305f5dd42c', 'volume_name': 'volume-61f1a36b-6fba-408b-9764-68305f5dd42c', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:35 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-eb72968e-f695-4abf-98a3-d8eda647cff6 tempest-AbsoluteLimitsTests-58706951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac3753eb-7e0f-4be1-83f0-92e4335acc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:35 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-eb72968e-f695-4abf-98a3-d8eda647cff6 tempest-AbsoluteLimitsTests-58706951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac3753eb-7e0f-4be1-83f0-92e4335acc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:35 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-eb72968e-f695-4abf-98a3-d8eda647cff6 tempest-AbsoluteLimitsTests-58706951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4042f85-b909-4c77-abe4-f699b1c2af7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:35 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-eb72968e-f695-4abf-98a3-d8eda647cff6 tempest-AbsoluteLimitsTests-58706951 None] Volume 61f1a36b-6fba-408b-9764-68305f5dd42c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61f1a36b-6fba-408b-9764-68305f5dd42c', 'volume_size': 1} Aug 10 12:51:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-eb72968e-f695-4abf-98a3-d8eda647cff6 tempest-AbsoluteLimitsTests-58706951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:51:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-eb72968e-f695-4abf-98a3-d8eda647cff6 tempest-AbsoluteLimitsTests-58706951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:51:35 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-eb72968e-f695-4abf-98a3-d8eda647cff6 tempest-AbsoluteLimitsTests-58706951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:51:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-524092790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f1a36b-6fba-408b-9764-68305f5dd42c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce17f75d2fa41dcac3adb9850288db2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:51:36Z,use_quota=True,user_id='e4854b29a28f460b95d77a66c0df8a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:51:35 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-eb72968e-f695-4abf-98a3-d8eda647cff6 tempest-AbsoluteLimitsTests-58706951 None] Creating volume 61f1a36b-6fba-408b-9764-68305f5dd42c {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:51:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-eb72968e-f695-4abf-98a3-d8eda647cff6 tempest-AbsoluteLimitsTests-58706951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:51:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-eb72968e-f695-4abf-98a3-d8eda647cff6 tempest-AbsoluteLimitsTests-58706951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:51:35 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-eb72968e-f695-4abf-98a3-d8eda647cff6 tempest-AbsoluteLimitsTests-58706951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:51:35 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-eb72968e-f695-4abf-98a3-d8eda647cff6 tempest-AbsoluteLimitsTests-58706951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:51:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-eb72968e-f695-4abf-98a3-d8eda647cff6 tempest-AbsoluteLimitsTests-58706951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:51:35 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-eb72968e-f695-4abf-98a3-d8eda647cff6 tempest-AbsoluteLimitsTests-58706951 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:51:35 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-eb72968e-f695-4abf-98a3-d8eda647cff6 tempest-AbsoluteLimitsTests-58706951 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:51:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-eb72968e-f695-4abf-98a3-d8eda647cff6 tempest-AbsoluteLimitsTests-58706951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-61f1a36b-6fba-408b-9764-68305f5dd42c 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:35 devstack sudo[95547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-61f1a36b-6fba-408b-9764-68305f5dd42c 1073741824 Aug 10 12:51:35 devstack sudo[95547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-b0fe43b3-d68a-4234-bfd9-5f2a5ee2285e req-f8b41fa8-8c41-4099-9f55-151a9c8e8063 tempest-AttachVolumeNegativeTest-1896074937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:51:36 devstack sudo[95547]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-eb72968e-f695-4abf-98a3-d8eda647cff6 tempest-AbsoluteLimitsTests-58706951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-61f1a36b-6fba-408b-9764-68305f5dd42c 1073741824" returned: 0 in 0.575s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-eb72968e-f695-4abf-98a3-d8eda647cff6 tempest-AbsoluteLimitsTests-58706951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-61f1a36b-6fba-408b-9764-68305f5dd42c {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:36 devstack sudo[95562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-61f1a36b-6fba-408b-9764-68305f5dd42c Aug 10 12:51:36 devstack sudo[95562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:36 devstack sudo[95562]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-eb72968e-f695-4abf-98a3-d8eda647cff6 tempest-AbsoluteLimitsTests-58706951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-61f1a36b-6fba-408b-9764-68305f5dd42c" returned: 0 in 0.268s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:36 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-eb72968e-f695-4abf-98a3-d8eda647cff6 tempest-AbsoluteLimitsTests-58706951 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:51:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-eb72968e-f695-4abf-98a3-d8eda647cff6 tempest-AbsoluteLimitsTests-58706951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:51:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-b0fe43b3-d68a-4234-bfd9-5f2a5ee2285e req-f8b41fa8-8c41-4099-9f55-151a9c8e8063 tempest-AttachVolumeNegativeTest-1896074937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.344s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:51:36 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-eb72968e-f695-4abf-98a3-d8eda647cff6 tempest-AbsoluteLimitsTests-58706951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4042f85-b909-4c77-abe4-f699b1c2af7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61f1a36b-6fba-408b-9764-68305f5dd42c', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:36 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-eb72968e-f695-4abf-98a3-d8eda647cff6 tempest-AbsoluteLimitsTests-58706951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (add78a83-d2b7-483c-9e2a-4047cd403d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-b0fe43b3-d68a-4234-bfd9-5f2a5ee2285e req-f8b41fa8-8c41-4099-9f55-151a9c8e8063 tempest-AttachVolumeNegativeTest-1896074937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:51:36 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-eb72968e-f695-4abf-98a3-d8eda647cff6 tempest-AbsoluteLimitsTests-58706951 None] Volume volume-61f1a36b-6fba-408b-9764-68305f5dd42c (61f1a36b-6fba-408b-9764-68305f5dd42c): created successfully Aug 10 12:51:36 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-eb72968e-f695-4abf-98a3-d8eda647cff6 tempest-AbsoluteLimitsTests-58706951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (add78a83-d2b7-483c-9e2a-4047cd403d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:36 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-eb72968e-f695-4abf-98a3-d8eda647cff6 tempest-AbsoluteLimitsTests-58706951 None] Flow 'volume_create_manager' (1a6f4caa-e0b5-46e6-bb84-bd4cd016f856) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:51:36 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-eb72968e-f695-4abf-98a3-d8eda647cff6 tempest-AbsoluteLimitsTests-58706951 None] Created volume successfully. Aug 10 12:51:36 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-b0fe43b3-d68a-4234-bfd9-5f2a5ee2285e req-f8b41fa8-8c41-4099-9f55-151a9c8e8063 tempest-AttachVolumeNegativeTest-1896074937 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d', 'name': 'volume-db622a62-1813-4ff6-baae-fd3a8fdbd58d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eea8f35c-ca6b-42d8-9652-6428a7de1132', 'enforce_multipath': True} {{(pid=89096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Aug 10 12:51:36 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-b0fe43b3-d68a-4234-bfd9-5f2a5ee2285e req-f8b41fa8-8c41-4099-9f55-151a9c8e8063 tempest-AttachVolumeNegativeTest-1896074937 None] attachment_update completed successfully. Aug 10 12:51:38 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-396c3a7e-f5b6-4126-9fdf-f7708953d19f tempest-AbsoluteLimitsTests-58706951 None] Acquiring lock "cinder-61f1a36b-6fba-408b-9764-68305f5dd42c-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:51:38 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-396c3a7e-f5b6-4126-9fdf-f7708953d19f tempest-AbsoluteLimitsTests-58706951 None] Lock "cinder-61f1a36b-6fba-408b-9764-68305f5dd42c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:51:38 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-396c3a7e-f5b6-4126-9fdf-f7708953d19f tempest-AbsoluteLimitsTests-58706951 None] Acquiring lock "cinder-quobyte-61f1a36b-6fba-408b-9764-68305f5dd42c" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:51:38 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-396c3a7e-f5b6-4126-9fdf-f7708953d19f tempest-AbsoluteLimitsTests-58706951 None] Lock "cinder-quobyte-61f1a36b-6fba-408b-9764-68305f5dd42c" acquired by "delete_volume" :: waited 0.016s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:51:38 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd5ceaa-da3a-460c-a1e3-f2aa6e08c614]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:51:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-396c3a7e-f5b6-4126-9fdf-f7708953d19f tempest-AbsoluteLimitsTests-58706951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-61f1a36b-6fba-408b-9764-68305f5dd42c {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:38 devstack sudo[95951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-61f1a36b-6fba-408b-9764-68305f5dd42c Aug 10 12:51:38 devstack sudo[95951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:38 devstack sudo[95951]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-396c3a7e-f5b6-4126-9fdf-f7708953d19f tempest-AbsoluteLimitsTests-58706951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-61f1a36b-6fba-408b-9764-68305f5dd42c" returned: 0 in 0.420s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-396c3a7e-f5b6-4126-9fdf-f7708953d19f tempest-AbsoluteLimitsTests-58706951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-61f1a36b-6fba-408b-9764-68305f5dd42c {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:38 devstack sudo[95957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-61f1a36b-6fba-408b-9764-68305f5dd42c Aug 10 12:51:38 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:38 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-396c3a7e-f5b6-4126-9fdf-f7708953d19f tempest-AbsoluteLimitsTests-58706951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-61f1a36b-6fba-408b-9764-68305f5dd42c" returned: 0 in 0.270s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:38 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-396c3a7e-f5b6-4126-9fdf-f7708953d19f tempest-AbsoluteLimitsTests-58706951 None] Lock "cinder-quobyte-61f1a36b-6fba-408b-9764-68305f5dd42c" released by "delete_volume" :: held 0.738s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:51:38 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-396c3a7e-f5b6-4126-9fdf-f7708953d19f tempest-AbsoluteLimitsTests-58706951 None] Created reservations ['1de86537-f45d-4577-80b4-aacd6b6705f7', '105e14eb-5423-43c3-9c43-e8ef564729c8', '8c1a84f5-e2ec-4c32-a379-5c49df3c0dbb', '29839ddb-0ad6-4779-9093-e80cf4685a36'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:51:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-396c3a7e-f5b6-4126-9fdf-f7708953d19f tempest-AbsoluteLimitsTests-58706951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:51:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-396c3a7e-f5b6-4126-9fdf-f7708953d19f tempest-AbsoluteLimitsTests-58706951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:51:39 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-396c3a7e-f5b6-4126-9fdf-f7708953d19f tempest-AbsoluteLimitsTests-58706951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:51:39 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-396c3a7e-f5b6-4126-9fdf-f7708953d19f tempest-AbsoluteLimitsTests-58706951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:51:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-396c3a7e-f5b6-4126-9fdf-f7708953d19f tempest-AbsoluteLimitsTests-58706951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:51:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-396c3a7e-f5b6-4126-9fdf-f7708953d19f tempest-AbsoluteLimitsTests-58706951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:39 devstack sudo[95961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:51:39 devstack sudo[95961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:39 devstack sudo[95961]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-396c3a7e-f5b6-4126-9fdf-f7708953d19f tempest-AbsoluteLimitsTests-58706951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.316s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:39 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-396c3a7e-f5b6-4126-9fdf-f7708953d19f tempest-AbsoluteLimitsTests-58706951 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:51:39 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-396c3a7e-f5b6-4126-9fdf-f7708953d19f tempest-AbsoluteLimitsTests-58706951 None] Deleted volume successfully. Aug 10 12:51:39 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-396c3a7e-f5b6-4126-9fdf-f7708953d19f tempest-AbsoluteLimitsTests-58706951 None] Lock "cinder-61f1a36b-6fba-408b-9764-68305f5dd42c-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:51:39 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-99717b81-2a3a-49b3-b9e1-b55b9c9a52f7 req-9f3f5287-b1d6-4e23-8a98-5def842ee705 tempest-AttachVolumeNegativeTest-1896074937 None] Terminate volume connection completed successfully. Aug 10 12:51:39 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-99717b81-2a3a-49b3-b9e1-b55b9c9a52f7 req-9f3f5287-b1d6-4e23-8a98-5def842ee705 tempest-AttachVolumeNegativeTest-1896074937 None] Deleting attachment eea8f35c-ca6b-42d8-9652-6428a7de1132. {{(pid=89096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Aug 10 12:51:46 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-baa64dce-f4fc-4378-bcad-6cdd091497d9 tempest-VolumesTransfersV355Test-441164047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:51:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-baa64dce-f4fc-4378-bcad-6cdd091497d9 tempest-VolumesTransfersV355Test-441164047 None] Flow 'volume_create_manager' (6d06c690-ea5f-4633-a863-cf97010b77b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:51:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-baa64dce-f4fc-4378-bcad-6cdd091497d9 tempest-VolumesTransfersV355Test-441164047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43574df8-134e-4d45-9bcd-fc947a092a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-baa64dce-f4fc-4378-bcad-6cdd091497d9 tempest-VolumesTransfersV355Test-441164047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43574df8-134e-4d45-9bcd-fc947a092a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1819344313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=981d404d-c881-41bf-aa3b-1abc0493ea09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949f06bcfcf6422f9a1081a3eb6c027c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:51:47Z,use_quota=True,user_id='faf4f18905894812ac9aabec62ccea3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-baa64dce-f4fc-4378-bcad-6cdd091497d9 tempest-VolumesTransfersV355Test-441164047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21906e23-bb0c-4965-9375-7b95501a176a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-baa64dce-f4fc-4378-bcad-6cdd091497d9 tempest-VolumesTransfersV355Test-441164047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21906e23-bb0c-4965-9375-7b95501a176a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-baa64dce-f4fc-4378-bcad-6cdd091497d9 tempest-VolumesTransfersV355Test-441164047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1197512-1e34-4cd9-a126-7f61c870f7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-baa64dce-f4fc-4378-bcad-6cdd091497d9 tempest-VolumesTransfersV355Test-441164047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1197512-1e34-4cd9-a126-7f61c870f7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '981d404d-c881-41bf-aa3b-1abc0493ea09', 'volume_name': 'volume-981d404d-c881-41bf-aa3b-1abc0493ea09', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-baa64dce-f4fc-4378-bcad-6cdd091497d9 tempest-VolumesTransfersV355Test-441164047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92feaff8-71bd-4ef8-8c08-f180dc9ebb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-baa64dce-f4fc-4378-bcad-6cdd091497d9 tempest-VolumesTransfersV355Test-441164047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92feaff8-71bd-4ef8-8c08-f180dc9ebb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-baa64dce-f4fc-4378-bcad-6cdd091497d9 tempest-VolumesTransfersV355Test-441164047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00210180-75f9-4442-b0fb-3996456b42d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:46 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-baa64dce-f4fc-4378-bcad-6cdd091497d9 tempest-VolumesTransfersV355Test-441164047 None] Volume 981d404d-c881-41bf-aa3b-1abc0493ea09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-981d404d-c881-41bf-aa3b-1abc0493ea09', 'volume_size': 1} Aug 10 12:51:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-baa64dce-f4fc-4378-bcad-6cdd091497d9 tempest-VolumesTransfersV355Test-441164047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:51:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-baa64dce-f4fc-4378-bcad-6cdd091497d9 tempest-VolumesTransfersV355Test-441164047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:51:46 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-baa64dce-f4fc-4378-bcad-6cdd091497d9 tempest-VolumesTransfersV355Test-441164047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1819344313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=981d404d-c881-41bf-aa3b-1abc0493ea09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949f06bcfcf6422f9a1081a3eb6c027c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:51:47Z,use_quota=True,user_id='faf4f18905894812ac9aabec62ccea3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:51:46 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-baa64dce-f4fc-4378-bcad-6cdd091497d9 tempest-VolumesTransfersV355Test-441164047 None] Creating volume 981d404d-c881-41bf-aa3b-1abc0493ea09 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:51:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-baa64dce-f4fc-4378-bcad-6cdd091497d9 tempest-VolumesTransfersV355Test-441164047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:51:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-baa64dce-f4fc-4378-bcad-6cdd091497d9 tempest-VolumesTransfersV355Test-441164047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:51:46 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-baa64dce-f4fc-4378-bcad-6cdd091497d9 tempest-VolumesTransfersV355Test-441164047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:51:46 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-baa64dce-f4fc-4378-bcad-6cdd091497d9 tempest-VolumesTransfersV355Test-441164047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:51:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-baa64dce-f4fc-4378-bcad-6cdd091497d9 tempest-VolumesTransfersV355Test-441164047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:51:46 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-baa64dce-f4fc-4378-bcad-6cdd091497d9 tempest-VolumesTransfersV355Test-441164047 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:51:46 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-baa64dce-f4fc-4378-bcad-6cdd091497d9 tempest-VolumesTransfersV355Test-441164047 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:51:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-baa64dce-f4fc-4378-bcad-6cdd091497d9 tempest-VolumesTransfersV355Test-441164047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-981d404d-c881-41bf-aa3b-1abc0493ea09 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:46 devstack sudo[96028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-981d404d-c881-41bf-aa3b-1abc0493ea09 1073741824 Aug 10 12:51:46 devstack sudo[96028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:47 devstack sudo[96028]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-baa64dce-f4fc-4378-bcad-6cdd091497d9 tempest-VolumesTransfersV355Test-441164047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-981d404d-c881-41bf-aa3b-1abc0493ea09 1073741824" returned: 0 in 0.582s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-baa64dce-f4fc-4378-bcad-6cdd091497d9 tempest-VolumesTransfersV355Test-441164047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-981d404d-c881-41bf-aa3b-1abc0493ea09 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:47 devstack sudo[96034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-981d404d-c881-41bf-aa3b-1abc0493ea09 Aug 10 12:51:47 devstack sudo[96034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:47 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fb04389-6073-4005-8ec6-d79e8db18e4e tempest-VolumesMetadataTest-1757493847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:51:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0fb04389-6073-4005-8ec6-d79e8db18e4e tempest-VolumesMetadataTest-1757493847 None] Flow 'volume_create_manager' (e5f5e391-4fe5-416a-8e10-cd1a4d3bc49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:51:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0fb04389-6073-4005-8ec6-d79e8db18e4e tempest-VolumesMetadataTest-1757493847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76748173-2124-4c77-9468-c1b829ec7b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0fb04389-6073-4005-8ec6-d79e8db18e4e tempest-VolumesMetadataTest-1757493847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76748173-2124-4c77-9468-c1b829ec7b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:51:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1552317143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f851ac02-8f52-41dd-a27c-d0f1684c5db6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efcf00a17d6c4f53ae4078e266dea02a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:51:47Z,use_quota=True,user_id='ffccee357df44f09bec471768016aa22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0fb04389-6073-4005-8ec6-d79e8db18e4e tempest-VolumesMetadataTest-1757493847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba45994f-908e-4557-ae02-8af3bf47eab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0fb04389-6073-4005-8ec6-d79e8db18e4e tempest-VolumesMetadataTest-1757493847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba45994f-908e-4557-ae02-8af3bf47eab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0fb04389-6073-4005-8ec6-d79e8db18e4e tempest-VolumesMetadataTest-1757493847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc2ac15a-a0cf-48f7-a746-efe685c52a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0fb04389-6073-4005-8ec6-d79e8db18e4e tempest-VolumesMetadataTest-1757493847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc2ac15a-a0cf-48f7-a746-efe685c52a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f851ac02-8f52-41dd-a27c-d0f1684c5db6', 'volume_name': 'volume-f851ac02-8f52-41dd-a27c-d0f1684c5db6', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0fb04389-6073-4005-8ec6-d79e8db18e4e tempest-VolumesMetadataTest-1757493847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7c4c3c1-59cb-4a66-bb14-42f78408e4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0fb04389-6073-4005-8ec6-d79e8db18e4e tempest-VolumesMetadataTest-1757493847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7c4c3c1-59cb-4a66-bb14-42f78408e4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0fb04389-6073-4005-8ec6-d79e8db18e4e tempest-VolumesMetadataTest-1757493847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f83689db-2c4b-4b3c-a654-66e6d60b1558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:47 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-0fb04389-6073-4005-8ec6-d79e8db18e4e tempest-VolumesMetadataTest-1757493847 None] Volume f851ac02-8f52-41dd-a27c-d0f1684c5db6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f851ac02-8f52-41dd-a27c-d0f1684c5db6', 'volume_size': 1} Aug 10 12:51:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0fb04389-6073-4005-8ec6-d79e8db18e4e tempest-VolumesMetadataTest-1757493847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:51:47 devstack sudo[96034]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-baa64dce-f4fc-4378-bcad-6cdd091497d9 tempest-VolumesTransfersV355Test-441164047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-981d404d-c881-41bf-aa3b-1abc0493ea09" returned: 0 in 0.315s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:47 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-baa64dce-f4fc-4378-bcad-6cdd091497d9 tempest-VolumesTransfersV355Test-441164047 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:51:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-baa64dce-f4fc-4378-bcad-6cdd091497d9 tempest-VolumesTransfersV355Test-441164047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:51:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0fb04389-6073-4005-8ec6-d79e8db18e4e tempest-VolumesMetadataTest-1757493847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.113s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:51:47 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0fb04389-6073-4005-8ec6-d79e8db18e4e tempest-VolumesMetadataTest-1757493847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:51:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1552317143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f851ac02-8f52-41dd-a27c-d0f1684c5db6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efcf00a17d6c4f53ae4078e266dea02a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:51:47Z,use_quota=True,user_id='ffccee357df44f09bec471768016aa22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:51:47 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-0fb04389-6073-4005-8ec6-d79e8db18e4e tempest-VolumesMetadataTest-1757493847 None] Creating volume f851ac02-8f52-41dd-a27c-d0f1684c5db6 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:51:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0fb04389-6073-4005-8ec6-d79e8db18e4e tempest-VolumesMetadataTest-1757493847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:51:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0fb04389-6073-4005-8ec6-d79e8db18e4e tempest-VolumesMetadataTest-1757493847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:51:47 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0fb04389-6073-4005-8ec6-d79e8db18e4e tempest-VolumesMetadataTest-1757493847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:51:47 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0fb04389-6073-4005-8ec6-d79e8db18e4e tempest-VolumesMetadataTest-1757493847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:51:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0fb04389-6073-4005-8ec6-d79e8db18e4e tempest-VolumesMetadataTest-1757493847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:51:47 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0fb04389-6073-4005-8ec6-d79e8db18e4e tempest-VolumesMetadataTest-1757493847 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:51:47 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-0fb04389-6073-4005-8ec6-d79e8db18e4e tempest-VolumesMetadataTest-1757493847 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:51:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0fb04389-6073-4005-8ec6-d79e8db18e4e tempest-VolumesMetadataTest-1757493847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f851ac02-8f52-41dd-a27c-d0f1684c5db6 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:47 devstack sudo[96037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f851ac02-8f52-41dd-a27c-d0f1684c5db6 1073741824 Aug 10 12:51:47 devstack sudo[96037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-baa64dce-f4fc-4378-bcad-6cdd091497d9 tempest-VolumesTransfersV355Test-441164047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00210180-75f9-4442-b0fb-3996456b42d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-981d404d-c881-41bf-aa3b-1abc0493ea09', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-baa64dce-f4fc-4378-bcad-6cdd091497d9 tempest-VolumesTransfersV355Test-441164047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af192389-d733-4f3c-80bc-9427c87cabcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:47 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-baa64dce-f4fc-4378-bcad-6cdd091497d9 tempest-VolumesTransfersV355Test-441164047 None] Volume volume-981d404d-c881-41bf-aa3b-1abc0493ea09 (981d404d-c881-41bf-aa3b-1abc0493ea09): created successfully Aug 10 12:51:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-baa64dce-f4fc-4378-bcad-6cdd091497d9 tempest-VolumesTransfersV355Test-441164047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af192389-d733-4f3c-80bc-9427c87cabcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-baa64dce-f4fc-4378-bcad-6cdd091497d9 tempest-VolumesTransfersV355Test-441164047 None] Flow 'volume_create_manager' (6d06c690-ea5f-4633-a863-cf97010b77b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:51:47 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-baa64dce-f4fc-4378-bcad-6cdd091497d9 tempest-VolumesTransfersV355Test-441164047 None] Created volume successfully. Aug 10 12:51:48 devstack sudo[96037]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0fb04389-6073-4005-8ec6-d79e8db18e4e tempest-VolumesMetadataTest-1757493847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f851ac02-8f52-41dd-a27c-d0f1684c5db6 1073741824" returned: 0 in 0.459s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0fb04389-6073-4005-8ec6-d79e8db18e4e tempest-VolumesMetadataTest-1757493847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f851ac02-8f52-41dd-a27c-d0f1684c5db6 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:48 devstack sudo[96044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f851ac02-8f52-41dd-a27c-d0f1684c5db6 Aug 10 12:51:48 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:48 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0fb04389-6073-4005-8ec6-d79e8db18e4e tempest-VolumesMetadataTest-1757493847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f851ac02-8f52-41dd-a27c-d0f1684c5db6" returned: 0 in 0.257s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:48 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0fb04389-6073-4005-8ec6-d79e8db18e4e tempest-VolumesMetadataTest-1757493847 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:51:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0fb04389-6073-4005-8ec6-d79e8db18e4e tempest-VolumesMetadataTest-1757493847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:51:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0fb04389-6073-4005-8ec6-d79e8db18e4e tempest-VolumesMetadataTest-1757493847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f83689db-2c4b-4b3c-a654-66e6d60b1558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f851ac02-8f52-41dd-a27c-d0f1684c5db6', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0fb04389-6073-4005-8ec6-d79e8db18e4e tempest-VolumesMetadataTest-1757493847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2553c86-0940-4542-b14b-0ee6a2a4d629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:48 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-0fb04389-6073-4005-8ec6-d79e8db18e4e tempest-VolumesMetadataTest-1757493847 None] Volume volume-f851ac02-8f52-41dd-a27c-d0f1684c5db6 (f851ac02-8f52-41dd-a27c-d0f1684c5db6): created successfully Aug 10 12:51:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0fb04389-6073-4005-8ec6-d79e8db18e4e tempest-VolumesMetadataTest-1757493847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2553c86-0940-4542-b14b-0ee6a2a4d629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0fb04389-6073-4005-8ec6-d79e8db18e4e tempest-VolumesMetadataTest-1757493847 None] Flow 'volume_create_manager' (e5f5e391-4fe5-416a-8e10-cd1a4d3bc49b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:51:48 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-0fb04389-6073-4005-8ec6-d79e8db18e4e tempest-VolumesMetadataTest-1757493847 None] Created volume successfully. Aug 10 12:51:49 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-be205fc7-b6a3-41b8-b146-2495b52a20da tempest-VolumesTransfersV355Test-535346412 None] Transfer volume completed successfully. Aug 10 12:51:50 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-af7094be-a954-4bb5-a942-c9174fc4610b tempest-VolumesTransfersV355Test-1988082847 None] Acquiring lock "cinder-981d404d-c881-41bf-aa3b-1abc0493ea09-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:51:50 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-af7094be-a954-4bb5-a942-c9174fc4610b tempest-VolumesTransfersV355Test-1988082847 None] Lock "cinder-981d404d-c881-41bf-aa3b-1abc0493ea09-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:51:50 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-af7094be-a954-4bb5-a942-c9174fc4610b tempest-VolumesTransfersV355Test-1988082847 None] Acquiring lock "cinder-quobyte-981d404d-c881-41bf-aa3b-1abc0493ea09" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:51:50 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-af7094be-a954-4bb5-a942-c9174fc4610b tempest-VolumesTransfersV355Test-1988082847 None] Lock "cinder-quobyte-981d404d-c881-41bf-aa3b-1abc0493ea09" acquired by "delete_volume" :: waited 0.022s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:51:50 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac26906a-7222-45f3-9734-f078089fe320]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:51:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af7094be-a954-4bb5-a942-c9174fc4610b tempest-VolumesTransfersV355Test-1988082847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-981d404d-c881-41bf-aa3b-1abc0493ea09 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:50 devstack sudo[96052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-981d404d-c881-41bf-aa3b-1abc0493ea09 Aug 10 12:51:50 devstack sudo[96052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:50 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-559cae33-3734-402b-bad9-d99701839022 tempest-VolumesMetadataTest-1757493847 None] Acquiring lock "cinder-f851ac02-8f52-41dd-a27c-d0f1684c5db6-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:51:50 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-559cae33-3734-402b-bad9-d99701839022 tempest-VolumesMetadataTest-1757493847 None] Lock "cinder-f851ac02-8f52-41dd-a27c-d0f1684c5db6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:51:50 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=94,cinder:UPDATE=111,cinder:INSERT=31,cinder:DELETE=6 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:51:50 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-559cae33-3734-402b-bad9-d99701839022 tempest-VolumesMetadataTest-1757493847 None] Acquiring lock "cinder-quobyte-f851ac02-8f52-41dd-a27c-d0f1684c5db6" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:51:50 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-559cae33-3734-402b-bad9-d99701839022 tempest-VolumesMetadataTest-1757493847 None] Lock "cinder-quobyte-f851ac02-8f52-41dd-a27c-d0f1684c5db6" acquired by "delete_volume" :: waited 0.020s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:51:50 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51d8c08-bcdf-4000-bf24-87eac856c069]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:51:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-559cae33-3734-402b-bad9-d99701839022 tempest-VolumesMetadataTest-1757493847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f851ac02-8f52-41dd-a27c-d0f1684c5db6 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:50 devstack sudo[96052]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af7094be-a954-4bb5-a942-c9174fc4610b tempest-VolumesTransfersV355Test-1988082847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-981d404d-c881-41bf-aa3b-1abc0493ea09" returned: 0 in 0.591s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af7094be-a954-4bb5-a942-c9174fc4610b tempest-VolumesTransfersV355Test-1988082847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-981d404d-c881-41bf-aa3b-1abc0493ea09 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:50 devstack sudo[96071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-981d404d-c881-41bf-aa3b-1abc0493ea09 Aug 10 12:51:50 devstack sudo[96071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:51 devstack sudo[96069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f851ac02-8f52-41dd-a27c-d0f1684c5db6 Aug 10 12:51:51 devstack sudo[96069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:51 devstack sudo[96071]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af7094be-a954-4bb5-a942-c9174fc4610b tempest-VolumesTransfersV355Test-1988082847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-981d404d-c881-41bf-aa3b-1abc0493ea09" returned: 0 in 0.430s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:51 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-af7094be-a954-4bb5-a942-c9174fc4610b tempest-VolumesTransfersV355Test-1988082847 None] Lock "cinder-quobyte-981d404d-c881-41bf-aa3b-1abc0493ea09" released by "delete_volume" :: held 1.077s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:51:51 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=84,cinder:UPDATE=114,cinder:DELETE=15,cinder:INSERT=30 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:51:51 devstack sudo[96069]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-559cae33-3734-402b-bad9-d99701839022 tempest-VolumesMetadataTest-1757493847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f851ac02-8f52-41dd-a27c-d0f1684c5db6" returned: 0 in 0.621s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-559cae33-3734-402b-bad9-d99701839022 tempest-VolumesMetadataTest-1757493847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f851ac02-8f52-41dd-a27c-d0f1684c5db6 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:51 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-af7094be-a954-4bb5-a942-c9174fc4610b tempest-VolumesTransfersV355Test-1988082847 None] Created reservations ['571207d9-312c-4967-91a2-17ee4a0e47b8', '4e525766-a2ca-4ce6-9256-c61f6a3b1fcb', 'ea97eb93-7cca-4590-a438-3667278428a6', '37252a28-148f-453b-9a2b-f0b0b6d502ac'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:51:51 devstack sudo[96081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f851ac02-8f52-41dd-a27c-d0f1684c5db6 Aug 10 12:51:51 devstack sudo[96081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-af7094be-a954-4bb5-a942-c9174fc4610b tempest-VolumesTransfersV355Test-1988082847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:51:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-af7094be-a954-4bb5-a942-c9174fc4610b tempest-VolumesTransfersV355Test-1988082847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:51:51 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-af7094be-a954-4bb5-a942-c9174fc4610b tempest-VolumesTransfersV355Test-1988082847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:51:51 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-af7094be-a954-4bb5-a942-c9174fc4610b tempest-VolumesTransfersV355Test-1988082847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:51:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-af7094be-a954-4bb5-a942-c9174fc4610b tempest-VolumesTransfersV355Test-1988082847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:51:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af7094be-a954-4bb5-a942-c9174fc4610b tempest-VolumesTransfersV355Test-1988082847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:51 devstack sudo[96083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:51:51 devstack sudo[96083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:51 devstack sudo[96081]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-559cae33-3734-402b-bad9-d99701839022 tempest-VolumesMetadataTest-1757493847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f851ac02-8f52-41dd-a27c-d0f1684c5db6" returned: 0 in 0.292s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:51 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-559cae33-3734-402b-bad9-d99701839022 tempest-VolumesMetadataTest-1757493847 None] Lock "cinder-quobyte-f851ac02-8f52-41dd-a27c-d0f1684c5db6" released by "delete_volume" :: held 0.985s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:51:51 devstack sudo[96083]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af7094be-a954-4bb5-a942-c9174fc4610b tempest-VolumesTransfersV355Test-1988082847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.289s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:51 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-af7094be-a954-4bb5-a942-c9174fc4610b tempest-VolumesTransfersV355Test-1988082847 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:51:51 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-559cae33-3734-402b-bad9-d99701839022 tempest-VolumesMetadataTest-1757493847 None] Created reservations ['05a58cae-56a1-446b-a996-d40dda732aee', 'dc52f017-6d6b-4717-acdd-0899591617dc', 'a650a6e0-0664-4239-8095-29d1ea3a45ec', 'ba9bed98-719d-42f7-a1ed-27c92b029bf7'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:51:51 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-af7094be-a954-4bb5-a942-c9174fc4610b tempest-VolumesTransfersV355Test-1988082847 None] Deleted volume successfully. Aug 10 12:51:51 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-af7094be-a954-4bb5-a942-c9174fc4610b tempest-VolumesTransfersV355Test-1988082847 None] Lock "cinder-981d404d-c881-41bf-aa3b-1abc0493ea09-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:51:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-559cae33-3734-402b-bad9-d99701839022 tempest-VolumesMetadataTest-1757493847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:51:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-559cae33-3734-402b-bad9-d99701839022 tempest-VolumesMetadataTest-1757493847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:51:51 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-559cae33-3734-402b-bad9-d99701839022 tempest-VolumesMetadataTest-1757493847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:51:51 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-559cae33-3734-402b-bad9-d99701839022 tempest-VolumesMetadataTest-1757493847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:51:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-559cae33-3734-402b-bad9-d99701839022 tempest-VolumesMetadataTest-1757493847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:51:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-559cae33-3734-402b-bad9-d99701839022 tempest-VolumesMetadataTest-1757493847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:51 devstack sudo[96087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:51:51 devstack sudo[96087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:52 devstack sudo[96087]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-559cae33-3734-402b-bad9-d99701839022 tempest-VolumesMetadataTest-1757493847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.250s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:52 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-559cae33-3734-402b-bad9-d99701839022 tempest-VolumesMetadataTest-1757493847 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:51:52 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-559cae33-3734-402b-bad9-d99701839022 tempest-VolumesMetadataTest-1757493847 None] Deleted volume successfully. Aug 10 12:51:52 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-559cae33-3734-402b-bad9-d99701839022 tempest-VolumesMetadataTest-1757493847 None] Lock "cinder-f851ac02-8f52-41dd-a27c-d0f1684c5db6-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:51:53 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-503e2864-99d2-4e1b-acde-2e2b444d2e7e tempest-VolumesTransfersV355Test-441164047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:51:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-503e2864-99d2-4e1b-acde-2e2b444d2e7e tempest-VolumesTransfersV355Test-441164047 None] Flow 'volume_create_manager' (3cfc9f29-2a29-443a-8557-9ffaa6a1db3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:51:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-503e2864-99d2-4e1b-acde-2e2b444d2e7e tempest-VolumesTransfersV355Test-441164047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d3b2d0b-0d7b-4c54-965e-9f84ef57c717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-503e2864-99d2-4e1b-acde-2e2b444d2e7e tempest-VolumesTransfersV355Test-441164047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d3b2d0b-0d7b-4c54-965e-9f84ef57c717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-529864715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a0995a-4d93-4d46-a77c-4be29b6bcaae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949f06bcfcf6422f9a1081a3eb6c027c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:51:53Z,use_quota=True,user_id='faf4f18905894812ac9aabec62ccea3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-503e2864-99d2-4e1b-acde-2e2b444d2e7e tempest-VolumesTransfersV355Test-441164047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (103ec3f5-f496-4041-8622-bd0e09922578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-503e2864-99d2-4e1b-acde-2e2b444d2e7e tempest-VolumesTransfersV355Test-441164047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (103ec3f5-f496-4041-8622-bd0e09922578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-503e2864-99d2-4e1b-acde-2e2b444d2e7e tempest-VolumesTransfersV355Test-441164047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3a0b230-f180-48b7-8ad6-e6c8df9b1885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-503e2864-99d2-4e1b-acde-2e2b444d2e7e tempest-VolumesTransfersV355Test-441164047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3a0b230-f180-48b7-8ad6-e6c8df9b1885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19a0995a-4d93-4d46-a77c-4be29b6bcaae', 'volume_name': 'volume-19a0995a-4d93-4d46-a77c-4be29b6bcaae', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-503e2864-99d2-4e1b-acde-2e2b444d2e7e tempest-VolumesTransfersV355Test-441164047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0ad34ce-8a18-447d-a702-fbf2c87989e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-503e2864-99d2-4e1b-acde-2e2b444d2e7e tempest-VolumesTransfersV355Test-441164047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0ad34ce-8a18-447d-a702-fbf2c87989e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-503e2864-99d2-4e1b-acde-2e2b444d2e7e tempest-VolumesTransfersV355Test-441164047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a989e1bb-27aa-4b03-a740-a94172aec4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:53 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-503e2864-99d2-4e1b-acde-2e2b444d2e7e tempest-VolumesTransfersV355Test-441164047 None] Volume 19a0995a-4d93-4d46-a77c-4be29b6bcaae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19a0995a-4d93-4d46-a77c-4be29b6bcaae', 'volume_size': 1} Aug 10 12:51:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-503e2864-99d2-4e1b-acde-2e2b444d2e7e tempest-VolumesTransfersV355Test-441164047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:51:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-503e2864-99d2-4e1b-acde-2e2b444d2e7e tempest-VolumesTransfersV355Test-441164047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:51:53 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-503e2864-99d2-4e1b-acde-2e2b444d2e7e tempest-VolumesTransfersV355Test-441164047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-529864715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a0995a-4d93-4d46-a77c-4be29b6bcaae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949f06bcfcf6422f9a1081a3eb6c027c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:51:53Z,use_quota=True,user_id='faf4f18905894812ac9aabec62ccea3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:51:53 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-503e2864-99d2-4e1b-acde-2e2b444d2e7e tempest-VolumesTransfersV355Test-441164047 None] Creating volume 19a0995a-4d93-4d46-a77c-4be29b6bcaae {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:51:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-503e2864-99d2-4e1b-acde-2e2b444d2e7e tempest-VolumesTransfersV355Test-441164047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:51:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-503e2864-99d2-4e1b-acde-2e2b444d2e7e tempest-VolumesTransfersV355Test-441164047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:51:53 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-503e2864-99d2-4e1b-acde-2e2b444d2e7e tempest-VolumesTransfersV355Test-441164047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:51:53 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-503e2864-99d2-4e1b-acde-2e2b444d2e7e tempest-VolumesTransfersV355Test-441164047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:51:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-503e2864-99d2-4e1b-acde-2e2b444d2e7e tempest-VolumesTransfersV355Test-441164047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:51:53 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-503e2864-99d2-4e1b-acde-2e2b444d2e7e tempest-VolumesTransfersV355Test-441164047 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:51:53 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-503e2864-99d2-4e1b-acde-2e2b444d2e7e tempest-VolumesTransfersV355Test-441164047 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:51:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-503e2864-99d2-4e1b-acde-2e2b444d2e7e tempest-VolumesTransfersV355Test-441164047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-19a0995a-4d93-4d46-a77c-4be29b6bcaae 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:53 devstack sudo[96122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-19a0995a-4d93-4d46-a77c-4be29b6bcaae 1073741824 Aug 10 12:51:53 devstack sudo[96122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:54 devstack sudo[96122]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-503e2864-99d2-4e1b-acde-2e2b444d2e7e tempest-VolumesTransfersV355Test-441164047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-19a0995a-4d93-4d46-a77c-4be29b6bcaae 1073741824" returned: 0 in 0.841s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-503e2864-99d2-4e1b-acde-2e2b444d2e7e tempest-VolumesTransfersV355Test-441164047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-19a0995a-4d93-4d46-a77c-4be29b6bcaae {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:54 devstack sudo[96163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-19a0995a-4d93-4d46-a77c-4be29b6bcaae Aug 10 12:51:54 devstack sudo[96163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:54 devstack sudo[96163]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-503e2864-99d2-4e1b-acde-2e2b444d2e7e tempest-VolumesTransfersV355Test-441164047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-19a0995a-4d93-4d46-a77c-4be29b6bcaae" returned: 0 in 0.323s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-503e2864-99d2-4e1b-acde-2e2b444d2e7e tempest-VolumesTransfersV355Test-441164047 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:51:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-503e2864-99d2-4e1b-acde-2e2b444d2e7e tempest-VolumesTransfersV355Test-441164047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:51:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-503e2864-99d2-4e1b-acde-2e2b444d2e7e tempest-VolumesTransfersV355Test-441164047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a989e1bb-27aa-4b03-a740-a94172aec4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19a0995a-4d93-4d46-a77c-4be29b6bcaae', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-503e2864-99d2-4e1b-acde-2e2b444d2e7e tempest-VolumesTransfersV355Test-441164047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50303750-3315-4e78-a9e7-417cd3adb2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:51:54 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-503e2864-99d2-4e1b-acde-2e2b444d2e7e tempest-VolumesTransfersV355Test-441164047 None] Volume volume-19a0995a-4d93-4d46-a77c-4be29b6bcaae (19a0995a-4d93-4d46-a77c-4be29b6bcaae): created successfully Aug 10 12:51:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-503e2864-99d2-4e1b-acde-2e2b444d2e7e tempest-VolumesTransfersV355Test-441164047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50303750-3315-4e78-a9e7-417cd3adb2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:51:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-503e2864-99d2-4e1b-acde-2e2b444d2e7e tempest-VolumesTransfersV355Test-441164047 None] Flow 'volume_create_manager' (3cfc9f29-2a29-443a-8557-9ffaa6a1db3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:51:54 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-503e2864-99d2-4e1b-acde-2e2b444d2e7e tempest-VolumesTransfersV355Test-441164047 None] Created volume successfully. Aug 10 12:51:55 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e39e8931-a23d-48b3-b9ba-de2922369bbe tempest-VolumesTransfersV355Test-1988082847 None] Acquiring lock "cinder-19a0995a-4d93-4d46-a77c-4be29b6bcaae-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:51:55 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e39e8931-a23d-48b3-b9ba-de2922369bbe tempest-VolumesTransfersV355Test-1988082847 None] Lock "cinder-19a0995a-4d93-4d46-a77c-4be29b6bcaae-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:51:55 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e39e8931-a23d-48b3-b9ba-de2922369bbe tempest-VolumesTransfersV355Test-1988082847 None] Acquiring lock "cinder-quobyte-19a0995a-4d93-4d46-a77c-4be29b6bcaae" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:51:55 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e39e8931-a23d-48b3-b9ba-de2922369bbe tempest-VolumesTransfersV355Test-1988082847 None] Lock "cinder-quobyte-19a0995a-4d93-4d46-a77c-4be29b6bcaae" acquired by "delete_volume" :: waited 0.037s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:51:55 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec591a80-4c7a-44bc-a674-2ef4538b528a]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:51:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e39e8931-a23d-48b3-b9ba-de2922369bbe tempest-VolumesTransfersV355Test-1988082847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-19a0995a-4d93-4d46-a77c-4be29b6bcaae {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:55 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-19a0995a-4d93-4d46-a77c-4be29b6bcaae Aug 10 12:51:55 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:56 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e39e8931-a23d-48b3-b9ba-de2922369bbe tempest-VolumesTransfersV355Test-1988082847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-19a0995a-4d93-4d46-a77c-4be29b6bcaae" returned: 0 in 0.573s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e39e8931-a23d-48b3-b9ba-de2922369bbe tempest-VolumesTransfersV355Test-1988082847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-19a0995a-4d93-4d46-a77c-4be29b6bcaae {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:56 devstack sudo[96190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-19a0995a-4d93-4d46-a77c-4be29b6bcaae Aug 10 12:51:56 devstack sudo[96190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:56 devstack sudo[96190]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e39e8931-a23d-48b3-b9ba-de2922369bbe tempest-VolumesTransfersV355Test-1988082847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-19a0995a-4d93-4d46-a77c-4be29b6bcaae" returned: 0 in 0.343s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:56 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e39e8931-a23d-48b3-b9ba-de2922369bbe tempest-VolumesTransfersV355Test-1988082847 None] Lock "cinder-quobyte-19a0995a-4d93-4d46-a77c-4be29b6bcaae" released by "delete_volume" :: held 1.007s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:51:56 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-e39e8931-a23d-48b3-b9ba-de2922369bbe tempest-VolumesTransfersV355Test-1988082847 None] Created reservations ['92c1f6f7-5d21-42a9-bfdc-2352f2513e3e', '58cdad38-ee52-4725-bfd4-f3be4a65d566', 'f529595d-4be8-40fe-9935-24421f049449', '7381cfbd-f8e9-4048-8459-ede4d4554303'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:51:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e39e8931-a23d-48b3-b9ba-de2922369bbe tempest-VolumesTransfersV355Test-1988082847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:51:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e39e8931-a23d-48b3-b9ba-de2922369bbe tempest-VolumesTransfersV355Test-1988082847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:51:56 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e39e8931-a23d-48b3-b9ba-de2922369bbe tempest-VolumesTransfersV355Test-1988082847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:51:56 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e39e8931-a23d-48b3-b9ba-de2922369bbe tempest-VolumesTransfersV355Test-1988082847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:51:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e39e8931-a23d-48b3-b9ba-de2922369bbe tempest-VolumesTransfersV355Test-1988082847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:51:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e39e8931-a23d-48b3-b9ba-de2922369bbe tempest-VolumesTransfersV355Test-1988082847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:51:56 devstack sudo[96193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:51:56 devstack sudo[96193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:51:57 devstack sudo[96193]: pam_unix(sudo:session): session closed for user root Aug 10 12:51:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e39e8931-a23d-48b3-b9ba-de2922369bbe tempest-VolumesTransfersV355Test-1988082847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.331s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:51:57 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-e39e8931-a23d-48b3-b9ba-de2922369bbe tempest-VolumesTransfersV355Test-1988082847 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:51:57 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-e39e8931-a23d-48b3-b9ba-de2922369bbe tempest-VolumesTransfersV355Test-1988082847 None] Deleted volume successfully. Aug 10 12:51:57 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e39e8931-a23d-48b3-b9ba-de2922369bbe tempest-VolumesTransfersV355Test-1988082847 None] Lock "cinder-19a0995a-4d93-4d46-a77c-4be29b6bcaae-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:51:59 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b032019-5828-4b90-b856-d7dd0e8a0240 tempest-VolumesTransfersV357Test-1070483281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:52:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0b032019-5828-4b90-b856-d7dd0e8a0240 tempest-VolumesTransfersV357Test-1070483281 None] Flow 'volume_create_manager' (7b9a0079-d697-484a-8f1b-33cfda0f2a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:52:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0b032019-5828-4b90-b856-d7dd0e8a0240 tempest-VolumesTransfersV357Test-1070483281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ad83175-027d-4287-81de-4ac46c2d71c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0b032019-5828-4b90-b856-d7dd0e8a0240 tempest-VolumesTransfersV357Test-1070483281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ad83175-027d-4287-81de-4ac46c2d71c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1568639302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d704c64-8a62-465a-bf21-b21011fa19b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f34a617c828547dab7b9024f50c984d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:52:00Z,use_quota=True,user_id='4dd290a4ec154f6692ba833e613d45b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0b032019-5828-4b90-b856-d7dd0e8a0240 tempest-VolumesTransfersV357Test-1070483281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bcd5ef7-d622-4052-84bd-e5bc3867cfe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0b032019-5828-4b90-b856-d7dd0e8a0240 tempest-VolumesTransfersV357Test-1070483281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bcd5ef7-d622-4052-84bd-e5bc3867cfe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0b032019-5828-4b90-b856-d7dd0e8a0240 tempest-VolumesTransfersV357Test-1070483281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d760c38-ee2d-4597-9e9c-0c0973a169d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0b032019-5828-4b90-b856-d7dd0e8a0240 tempest-VolumesTransfersV357Test-1070483281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d760c38-ee2d-4597-9e9c-0c0973a169d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d704c64-8a62-465a-bf21-b21011fa19b0', 'volume_name': 'volume-8d704c64-8a62-465a-bf21-b21011fa19b0', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0b032019-5828-4b90-b856-d7dd0e8a0240 tempest-VolumesTransfersV357Test-1070483281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72dd5952-a10c-4d0e-92b4-32f57b9b30e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0b032019-5828-4b90-b856-d7dd0e8a0240 tempest-VolumesTransfersV357Test-1070483281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72dd5952-a10c-4d0e-92b4-32f57b9b30e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0b032019-5828-4b90-b856-d7dd0e8a0240 tempest-VolumesTransfersV357Test-1070483281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e06f44-de32-4880-891e-7da9410e3cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:00 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-0b032019-5828-4b90-b856-d7dd0e8a0240 tempest-VolumesTransfersV357Test-1070483281 None] Volume 8d704c64-8a62-465a-bf21-b21011fa19b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d704c64-8a62-465a-bf21-b21011fa19b0', 'volume_size': 1} Aug 10 12:52:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0b032019-5828-4b90-b856-d7dd0e8a0240 tempest-VolumesTransfersV357Test-1070483281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:52:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0b032019-5828-4b90-b856-d7dd0e8a0240 tempest-VolumesTransfersV357Test-1070483281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:52:00 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0b032019-5828-4b90-b856-d7dd0e8a0240 tempest-VolumesTransfersV357Test-1070483281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1568639302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d704c64-8a62-465a-bf21-b21011fa19b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f34a617c828547dab7b9024f50c984d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:52:00Z,use_quota=True,user_id='4dd290a4ec154f6692ba833e613d45b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:52:00 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-0b032019-5828-4b90-b856-d7dd0e8a0240 tempest-VolumesTransfersV357Test-1070483281 None] Creating volume 8d704c64-8a62-465a-bf21-b21011fa19b0 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:52:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0b032019-5828-4b90-b856-d7dd0e8a0240 tempest-VolumesTransfersV357Test-1070483281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:52:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0b032019-5828-4b90-b856-d7dd0e8a0240 tempest-VolumesTransfersV357Test-1070483281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:52:00 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0b032019-5828-4b90-b856-d7dd0e8a0240 tempest-VolumesTransfersV357Test-1070483281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:52:00 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0b032019-5828-4b90-b856-d7dd0e8a0240 tempest-VolumesTransfersV357Test-1070483281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:52:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0b032019-5828-4b90-b856-d7dd0e8a0240 tempest-VolumesTransfersV357Test-1070483281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:52:00 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0b032019-5828-4b90-b856-d7dd0e8a0240 tempest-VolumesTransfersV357Test-1070483281 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:52:00 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-0b032019-5828-4b90-b856-d7dd0e8a0240 tempest-VolumesTransfersV357Test-1070483281 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:52:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0b032019-5828-4b90-b856-d7dd0e8a0240 tempest-VolumesTransfersV357Test-1070483281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8d704c64-8a62-465a-bf21-b21011fa19b0 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:00 devstack sudo[96200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8d704c64-8a62-465a-bf21-b21011fa19b0 1073741824 Aug 10 12:52:00 devstack sudo[96200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:00 devstack sudo[96200]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0b032019-5828-4b90-b856-d7dd0e8a0240 tempest-VolumesTransfersV357Test-1070483281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8d704c64-8a62-465a-bf21-b21011fa19b0 1073741824" returned: 0 in 0.523s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0b032019-5828-4b90-b856-d7dd0e8a0240 tempest-VolumesTransfersV357Test-1070483281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8d704c64-8a62-465a-bf21-b21011fa19b0 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:00 devstack sudo[96206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8d704c64-8a62-465a-bf21-b21011fa19b0 Aug 10 12:52:00 devstack sudo[96206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:00 devstack sudo[96206]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0b032019-5828-4b90-b856-d7dd0e8a0240 tempest-VolumesTransfersV357Test-1070483281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8d704c64-8a62-465a-bf21-b21011fa19b0" returned: 0 in 0.286s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:00 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0b032019-5828-4b90-b856-d7dd0e8a0240 tempest-VolumesTransfersV357Test-1070483281 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:52:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0b032019-5828-4b90-b856-d7dd0e8a0240 tempest-VolumesTransfersV357Test-1070483281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:52:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0b032019-5828-4b90-b856-d7dd0e8a0240 tempest-VolumesTransfersV357Test-1070483281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e06f44-de32-4880-891e-7da9410e3cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d704c64-8a62-465a-bf21-b21011fa19b0', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0b032019-5828-4b90-b856-d7dd0e8a0240 tempest-VolumesTransfersV357Test-1070483281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d01cd20a-9a28-41a8-b091-a05cac6866f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:01 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-0b032019-5828-4b90-b856-d7dd0e8a0240 tempest-VolumesTransfersV357Test-1070483281 None] Volume volume-8d704c64-8a62-465a-bf21-b21011fa19b0 (8d704c64-8a62-465a-bf21-b21011fa19b0): created successfully Aug 10 12:52:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0b032019-5828-4b90-b856-d7dd0e8a0240 tempest-VolumesTransfersV357Test-1070483281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d01cd20a-9a28-41a8-b091-a05cac6866f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0b032019-5828-4b90-b856-d7dd0e8a0240 tempest-VolumesTransfersV357Test-1070483281 None] Flow 'volume_create_manager' (7b9a0079-d697-484a-8f1b-33cfda0f2a0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:52:01 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-0b032019-5828-4b90-b856-d7dd0e8a0240 tempest-VolumesTransfersV357Test-1070483281 None] Created volume successfully. Aug 10 12:52:02 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-a830c040-4639-4813-b524-04e7d143cd56 tempest-VolumesTransfersV357Test-1688319034 None] Transfer volume completed successfully. Aug 10 12:52:03 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7723a52d-b7e0-489a-a34c-b37f30c6e01c tempest-VolumesTransfersV357Test-718469626 None] Acquiring lock "cinder-8d704c64-8a62-465a-bf21-b21011fa19b0-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:52:03 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7723a52d-b7e0-489a-a34c-b37f30c6e01c tempest-VolumesTransfersV357Test-718469626 None] Lock "cinder-8d704c64-8a62-465a-bf21-b21011fa19b0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:52:03 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7723a52d-b7e0-489a-a34c-b37f30c6e01c tempest-VolumesTransfersV357Test-718469626 None] Acquiring lock "cinder-quobyte-8d704c64-8a62-465a-bf21-b21011fa19b0" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:52:03 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7723a52d-b7e0-489a-a34c-b37f30c6e01c tempest-VolumesTransfersV357Test-718469626 None] Lock "cinder-quobyte-8d704c64-8a62-465a-bf21-b21011fa19b0" acquired by "delete_volume" :: waited 0.022s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:52:03 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 12:52:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:52:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:52:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:52:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:52:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:52:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:03 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[614a996b-6a00-4260-9ab5-a6c169d97e98]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:52:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7723a52d-b7e0-489a-a34c-b37f30c6e01c tempest-VolumesTransfersV357Test-718469626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8d704c64-8a62-465a-bf21-b21011fa19b0 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:03 devstack sudo[96211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:52:03 devstack sudo[96211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:04 devstack sudo[96212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8d704c64-8a62-465a-bf21-b21011fa19b0 Aug 10 12:52:04 devstack sudo[96212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:04 devstack sudo[96211]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.373s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:04 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:52:04 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager._thread_info {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 12:52:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread count: 28 {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 12:52:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread info: [<_MainThread(MainThread, started 130607683133568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Aug 10 12:52:04 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-21c2d15f-42d1-46fb-ac2e-a4f3ca862b4c tempest-VolumesCloneTest-1733365271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:52:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-21c2d15f-42d1-46fb-ac2e-a4f3ca862b4c tempest-VolumesCloneTest-1733365271 None] Flow 'volume_create_manager' (a512682b-3444-43bc-a004-e642b418b99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:52:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-21c2d15f-42d1-46fb-ac2e-a4f3ca862b4c tempest-VolumesCloneTest-1733365271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db5f6435-f0ad-49f9-ba15-8b17b879baa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-21c2d15f-42d1-46fb-ac2e-a4f3ca862b4c tempest-VolumesCloneTest-1733365271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db5f6435-f0ad-49f9-ba15-8b17b879baa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1977646627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd722b4c-79b2-4117-a863-d7f8b8d9cb7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d486b8460114f85ba443f020ae87814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:52:04Z,use_quota=True,user_id='83eef95b17064f7f8d2359ff4dc6cfdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-21c2d15f-42d1-46fb-ac2e-a4f3ca862b4c tempest-VolumesCloneTest-1733365271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4af7fd58-a2ab-4cf2-ad1a-63a8862e1c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-21c2d15f-42d1-46fb-ac2e-a4f3ca862b4c tempest-VolumesCloneTest-1733365271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4af7fd58-a2ab-4cf2-ad1a-63a8862e1c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-21c2d15f-42d1-46fb-ac2e-a4f3ca862b4c tempest-VolumesCloneTest-1733365271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60f4c681-2349-49ce-832e-fc1aa75d2914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-21c2d15f-42d1-46fb-ac2e-a4f3ca862b4c tempest-VolumesCloneTest-1733365271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60f4c681-2349-49ce-832e-fc1aa75d2914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd722b4c-79b2-4117-a863-d7f8b8d9cb7f', 'volume_name': 'volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-21c2d15f-42d1-46fb-ac2e-a4f3ca862b4c tempest-VolumesCloneTest-1733365271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (785f974c-1d91-47d3-b930-226bb1ba5364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-21c2d15f-42d1-46fb-ac2e-a4f3ca862b4c tempest-VolumesCloneTest-1733365271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (785f974c-1d91-47d3-b930-226bb1ba5364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-21c2d15f-42d1-46fb-ac2e-a4f3ca862b4c tempest-VolumesCloneTest-1733365271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9708bb3d-08c2-4398-9860-77039402889b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:04 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-21c2d15f-42d1-46fb-ac2e-a4f3ca862b4c tempest-VolumesCloneTest-1733365271 None] Volume dd722b4c-79b2-4117-a863-d7f8b8d9cb7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f', 'volume_size': 1} Aug 10 12:52:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-21c2d15f-42d1-46fb-ac2e-a4f3ca862b4c tempest-VolumesCloneTest-1733365271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:52:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-21c2d15f-42d1-46fb-ac2e-a4f3ca862b4c tempest-VolumesCloneTest-1733365271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:52:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-21c2d15f-42d1-46fb-ac2e-a4f3ca862b4c tempest-VolumesCloneTest-1733365271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1977646627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd722b4c-79b2-4117-a863-d7f8b8d9cb7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d486b8460114f85ba443f020ae87814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:52:04Z,use_quota=True,user_id='83eef95b17064f7f8d2359ff4dc6cfdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:52:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-21c2d15f-42d1-46fb-ac2e-a4f3ca862b4c tempest-VolumesCloneTest-1733365271 None] Creating volume dd722b4c-79b2-4117-a863-d7f8b8d9cb7f {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:52:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-21c2d15f-42d1-46fb-ac2e-a4f3ca862b4c tempest-VolumesCloneTest-1733365271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:52:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-21c2d15f-42d1-46fb-ac2e-a4f3ca862b4c tempest-VolumesCloneTest-1733365271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:52:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-21c2d15f-42d1-46fb-ac2e-a4f3ca862b4c tempest-VolumesCloneTest-1733365271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:52:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-21c2d15f-42d1-46fb-ac2e-a4f3ca862b4c tempest-VolumesCloneTest-1733365271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:52:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-21c2d15f-42d1-46fb-ac2e-a4f3ca862b4c tempest-VolumesCloneTest-1733365271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:52:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-21c2d15f-42d1-46fb-ac2e-a4f3ca862b4c tempest-VolumesCloneTest-1733365271 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:52:04 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-21c2d15f-42d1-46fb-ac2e-a4f3ca862b4c tempest-VolumesCloneTest-1733365271 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:52:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-21c2d15f-42d1-46fb-ac2e-a4f3ca862b4c tempest-VolumesCloneTest-1733365271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:04 devstack sudo[96212]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7723a52d-b7e0-489a-a34c-b37f30c6e01c tempest-VolumesTransfersV357Test-718469626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8d704c64-8a62-465a-bf21-b21011fa19b0" returned: 0 in 0.561s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7723a52d-b7e0-489a-a34c-b37f30c6e01c tempest-VolumesTransfersV357Test-718469626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8d704c64-8a62-465a-bf21-b21011fa19b0 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:04 devstack sudo[96219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f 1073741824 Aug 10 12:52:04 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:04 devstack sudo[96220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8d704c64-8a62-465a-bf21-b21011fa19b0 Aug 10 12:52:04 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:04 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7723a52d-b7e0-489a-a34c-b37f30c6e01c tempest-VolumesTransfersV357Test-718469626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8d704c64-8a62-465a-bf21-b21011fa19b0" returned: 0 in 0.268s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:04 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7723a52d-b7e0-489a-a34c-b37f30c6e01c tempest-VolumesTransfersV357Test-718469626 None] Lock "cinder-quobyte-8d704c64-8a62-465a-bf21-b21011fa19b0" released by "delete_volume" :: held 0.900s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:52:04 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-7723a52d-b7e0-489a-a34c-b37f30c6e01c tempest-VolumesTransfersV357Test-718469626 None] Created reservations ['93efcd18-dab2-49c2-a35f-63578969c54a', '145f0441-d73e-4575-8899-f994ac3b64e7', 'f601a116-95ef-4785-a056-2e02af560ef5', 'fa1df4e9-5995-4238-abca-fd9bb1bc7e35'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:52:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7723a52d-b7e0-489a-a34c-b37f30c6e01c tempest-VolumesTransfersV357Test-718469626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:52:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7723a52d-b7e0-489a-a34c-b37f30c6e01c tempest-VolumesTransfersV357Test-718469626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:52:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-7723a52d-b7e0-489a-a34c-b37f30c6e01c tempest-VolumesTransfersV357Test-718469626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:52:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-7723a52d-b7e0-489a-a34c-b37f30c6e01c tempest-VolumesTransfersV357Test-718469626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:52:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7723a52d-b7e0-489a-a34c-b37f30c6e01c tempest-VolumesTransfersV357Test-718469626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:52:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7723a52d-b7e0-489a-a34c-b37f30c6e01c tempest-VolumesTransfersV357Test-718469626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:04 devstack sudo[96230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:52:04 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:05 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-21c2d15f-42d1-46fb-ac2e-a4f3ca862b4c tempest-VolumesCloneTest-1733365271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f 1073741824" returned: 0 in 0.586s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-21c2d15f-42d1-46fb-ac2e-a4f3ca862b4c tempest-VolumesCloneTest-1733365271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:05 devstack sudo[96232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f Aug 10 12:52:05 devstack sudo[96232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:05 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7723a52d-b7e0-489a-a34c-b37f30c6e01c tempest-VolumesTransfersV357Test-718469626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.423s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:05 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-7723a52d-b7e0-489a-a34c-b37f30c6e01c tempest-VolumesTransfersV357Test-718469626 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:52:05 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-7723a52d-b7e0-489a-a34c-b37f30c6e01c tempest-VolumesTransfersV357Test-718469626 None] Deleted volume successfully. Aug 10 12:52:05 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7723a52d-b7e0-489a-a34c-b37f30c6e01c tempest-VolumesTransfersV357Test-718469626 None] Lock "cinder-8d704c64-8a62-465a-bf21-b21011fa19b0-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:52:05 devstack sudo[96232]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-21c2d15f-42d1-46fb-ac2e-a4f3ca862b4c tempest-VolumesCloneTest-1733365271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f" returned: 0 in 0.469s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-21c2d15f-42d1-46fb-ac2e-a4f3ca862b4c tempest-VolumesCloneTest-1733365271 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:52:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-21c2d15f-42d1-46fb-ac2e-a4f3ca862b4c tempest-VolumesCloneTest-1733365271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:52:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-21c2d15f-42d1-46fb-ac2e-a4f3ca862b4c tempest-VolumesCloneTest-1733365271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9708bb3d-08c2-4398-9860-77039402889b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-21c2d15f-42d1-46fb-ac2e-a4f3ca862b4c tempest-VolumesCloneTest-1733365271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7db98658-1af1-4669-a169-b7a78f21a2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:05 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-21c2d15f-42d1-46fb-ac2e-a4f3ca862b4c tempest-VolumesCloneTest-1733365271 None] Volume volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f (dd722b4c-79b2-4117-a863-d7f8b8d9cb7f): created successfully Aug 10 12:52:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-21c2d15f-42d1-46fb-ac2e-a4f3ca862b4c tempest-VolumesCloneTest-1733365271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7db98658-1af1-4669-a169-b7a78f21a2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-21c2d15f-42d1-46fb-ac2e-a4f3ca862b4c tempest-VolumesCloneTest-1733365271 None] Flow 'volume_create_manager' (a512682b-3444-43bc-a004-e642b418b99d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:52:05 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-21c2d15f-42d1-46fb-ac2e-a4f3ca862b4c tempest-VolumesCloneTest-1733365271 None] Created volume successfully. Aug 10 12:52:05 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-569b9f87-d2f5-497b-a9f4-c18b95874b35 tempest-VolumesTransfersV357Test-1070483281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:52:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-569b9f87-d2f5-497b-a9f4-c18b95874b35 tempest-VolumesTransfersV357Test-1070483281 None] Flow 'volume_create_manager' (a67baf6e-96fb-4e19-9269-ef1a161c8674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:52:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-569b9f87-d2f5-497b-a9f4-c18b95874b35 tempest-VolumesTransfersV357Test-1070483281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af4481b9-03e9-45c7-bcec-553afc713ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-569b9f87-d2f5-497b-a9f4-c18b95874b35 tempest-VolumesTransfersV357Test-1070483281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af4481b9-03e9-45c7-bcec-553afc713ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-650763238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0300bb49-c279-4c76-8674-2063b5df803e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f34a617c828547dab7b9024f50c984d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:52:06Z,use_quota=True,user_id='4dd290a4ec154f6692ba833e613d45b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-569b9f87-d2f5-497b-a9f4-c18b95874b35 tempest-VolumesTransfersV357Test-1070483281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db277634-8ec4-45b0-b1de-ed0d717270c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-569b9f87-d2f5-497b-a9f4-c18b95874b35 tempest-VolumesTransfersV357Test-1070483281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db277634-8ec4-45b0-b1de-ed0d717270c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-569b9f87-d2f5-497b-a9f4-c18b95874b35 tempest-VolumesTransfersV357Test-1070483281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17aff17b-289e-4293-858c-4711b2fb75e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-569b9f87-d2f5-497b-a9f4-c18b95874b35 tempest-VolumesTransfersV357Test-1070483281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17aff17b-289e-4293-858c-4711b2fb75e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0300bb49-c279-4c76-8674-2063b5df803e', 'volume_name': 'volume-0300bb49-c279-4c76-8674-2063b5df803e', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-569b9f87-d2f5-497b-a9f4-c18b95874b35 tempest-VolumesTransfersV357Test-1070483281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (238db76f-d0ab-44eb-9c97-bfddbd2af9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-569b9f87-d2f5-497b-a9f4-c18b95874b35 tempest-VolumesTransfersV357Test-1070483281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (238db76f-d0ab-44eb-9c97-bfddbd2af9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-569b9f87-d2f5-497b-a9f4-c18b95874b35 tempest-VolumesTransfersV357Test-1070483281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c7eaf7d-e5b7-46c0-a67e-53be83f208b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:05 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-569b9f87-d2f5-497b-a9f4-c18b95874b35 tempest-VolumesTransfersV357Test-1070483281 None] Volume 0300bb49-c279-4c76-8674-2063b5df803e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0300bb49-c279-4c76-8674-2063b5df803e', 'volume_size': 1} Aug 10 12:52:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-569b9f87-d2f5-497b-a9f4-c18b95874b35 tempest-VolumesTransfersV357Test-1070483281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:52:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-569b9f87-d2f5-497b-a9f4-c18b95874b35 tempest-VolumesTransfersV357Test-1070483281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:52:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-569b9f87-d2f5-497b-a9f4-c18b95874b35 tempest-VolumesTransfersV357Test-1070483281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-650763238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0300bb49-c279-4c76-8674-2063b5df803e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f34a617c828547dab7b9024f50c984d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:52:06Z,use_quota=True,user_id='4dd290a4ec154f6692ba833e613d45b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:52:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-569b9f87-d2f5-497b-a9f4-c18b95874b35 tempest-VolumesTransfersV357Test-1070483281 None] Creating volume 0300bb49-c279-4c76-8674-2063b5df803e {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:52:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-569b9f87-d2f5-497b-a9f4-c18b95874b35 tempest-VolumesTransfersV357Test-1070483281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:52:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-569b9f87-d2f5-497b-a9f4-c18b95874b35 tempest-VolumesTransfersV357Test-1070483281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:52:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-569b9f87-d2f5-497b-a9f4-c18b95874b35 tempest-VolumesTransfersV357Test-1070483281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:52:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-569b9f87-d2f5-497b-a9f4-c18b95874b35 tempest-VolumesTransfersV357Test-1070483281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:52:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-569b9f87-d2f5-497b-a9f4-c18b95874b35 tempest-VolumesTransfersV357Test-1070483281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:52:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-569b9f87-d2f5-497b-a9f4-c18b95874b35 tempest-VolumesTransfersV357Test-1070483281 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:52:05 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-569b9f87-d2f5-497b-a9f4-c18b95874b35 tempest-VolumesTransfersV357Test-1070483281 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:52:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-569b9f87-d2f5-497b-a9f4-c18b95874b35 tempest-VolumesTransfersV357Test-1070483281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0300bb49-c279-4c76-8674-2063b5df803e 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:05 devstack sudo[96251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0300bb49-c279-4c76-8674-2063b5df803e 1073741824 Aug 10 12:52:05 devstack sudo[96251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:06 devstack sudo[96251]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-569b9f87-d2f5-497b-a9f4-c18b95874b35 tempest-VolumesTransfersV357Test-1070483281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0300bb49-c279-4c76-8674-2063b5df803e 1073741824" returned: 0 in 0.460s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-569b9f87-d2f5-497b-a9f4-c18b95874b35 tempest-VolumesTransfersV357Test-1070483281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0300bb49-c279-4c76-8674-2063b5df803e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:06 devstack sudo[96256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0300bb49-c279-4c76-8674-2063b5df803e Aug 10 12:52:06 devstack sudo[96256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:06 devstack sudo[96256]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-569b9f87-d2f5-497b-a9f4-c18b95874b35 tempest-VolumesTransfersV357Test-1070483281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0300bb49-c279-4c76-8674-2063b5df803e" returned: 0 in 0.329s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:06 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-569b9f87-d2f5-497b-a9f4-c18b95874b35 tempest-VolumesTransfersV357Test-1070483281 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:52:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-569b9f87-d2f5-497b-a9f4-c18b95874b35 tempest-VolumesTransfersV357Test-1070483281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:52:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-569b9f87-d2f5-497b-a9f4-c18b95874b35 tempest-VolumesTransfersV357Test-1070483281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c7eaf7d-e5b7-46c0-a67e-53be83f208b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0300bb49-c279-4c76-8674-2063b5df803e', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-569b9f87-d2f5-497b-a9f4-c18b95874b35 tempest-VolumesTransfersV357Test-1070483281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d0a335-7831-41fd-8140-e04c34edbf01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:06 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-569b9f87-d2f5-497b-a9f4-c18b95874b35 tempest-VolumesTransfersV357Test-1070483281 None] Volume volume-0300bb49-c279-4c76-8674-2063b5df803e (0300bb49-c279-4c76-8674-2063b5df803e): created successfully Aug 10 12:52:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-569b9f87-d2f5-497b-a9f4-c18b95874b35 tempest-VolumesTransfersV357Test-1070483281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d0a335-7831-41fd-8140-e04c34edbf01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-569b9f87-d2f5-497b-a9f4-c18b95874b35 tempest-VolumesTransfersV357Test-1070483281 None] Flow 'volume_create_manager' (a67baf6e-96fb-4e19-9269-ef1a161c8674) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:52:06 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-569b9f87-d2f5-497b-a9f4-c18b95874b35 tempest-VolumesTransfersV357Test-1070483281 None] Created volume successfully. Aug 10 12:52:06 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:52:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Flow 'volume_create_manager' (52564671-9eab-489d-95a7-af4d41d66acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:52:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bca1726-b622-4334-922c-24e2fe1fbd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:07 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bca1726-b622-4334-922c-24e2fe1fbd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1758517454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74fbd8b0-b1f4-46b1-ac97-051414893f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d486b8460114f85ba443f020ae87814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:52:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=dd722b4c-79b2-4117-a863-d7f8b8d9cb7f,status='creating',terminated_at=None,updated_at=2026-08-10T10:52:07Z,use_quota=True,user_id='83eef95b17064f7f8d2359ff4dc6cfdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:07 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0ca47e6-b12e-4743-8def-dc0221592c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:07 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0ca47e6-b12e-4743-8def-dc0221592c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:07 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33fc728f-34cf-4070-8f0a-470ab20b6d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:07 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33fc728f-34cf-4070-8f0a-470ab20b6d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '74fbd8b0-b1f4-46b1-ac97-051414893f27', 'volume_name': 'volume-74fbd8b0-b1f4-46b1-ac97-051414893f27', 'volume_size': 2, 'source_volid': 'dd722b4c-79b2-4117-a863-d7f8b8d9cb7f', 'source_volstatus': 'available'}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:07 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6443c09b-0e76-4e3c-ac53-da3460aa1711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:07 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6443c09b-0e76-4e3c-ac53-da3460aa1711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:07 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fbb83e3-81a9-4169-a893-13765f1cc80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:07 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Volume 74fbd8b0-b1f4-46b1-ac97-051414893f27: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-74fbd8b0-b1f4-46b1-ac97-051414893f27', 'volume_size': 2, 'source_volid': 'dd722b4c-79b2-4117-a863-d7f8b8d9cb7f', 'source_volstatus': 'available'} Aug 10 12:52:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:52:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:52:07 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Cloning volume dd722b4c-79b2-4117-a863-d7f8b8d9cb7f to volume 74fbd8b0-b1f4-46b1-ac97-051414893f27 Aug 10 12:52:07 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Creating offline snapshot b9fd9c1b-c5fa-4cc6-b9b7-d519d11e1952 of volume dd722b4c-79b2-4117-a863-d7f8b8d9cb7f {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 12:52:07 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65f4da4-78bd-4e70-8118-2846baa39b92]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:52:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:07 devstack sudo[96259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f Aug 10 12:52:07 devstack sudo[96259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:07 devstack sudo[96259]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f" returned: 0 in 0.368s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f.b9fd9c1b-c5fa-4cc6-b9b7-d519d11e1952 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:07 devstack sudo[96264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f.b9fd9c1b-c5fa-4cc6-b9b7-d519d11e1952 1G Aug 10 12:52:07 devstack sudo[96264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:07 devstack sudo[96264]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f.b9fd9c1b-c5fa-4cc6-b9b7-d519d11e1952 1G" returned: 0 in 0.482s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f.b9fd9c1b-c5fa-4cc6-b9b7-d519d11e1952 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:08 devstack sudo[96300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f.b9fd9c1b-c5fa-4cc6-b9b7-d519d11e1952 Aug 10 12:52:08 devstack sudo[96300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:08 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ab4031cf-935a-4188-804c-f7657962271b tempest-VolumesTransfersV357Test-718469626 None] Acquiring lock "cinder-0300bb49-c279-4c76-8674-2063b5df803e-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:52:08 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ab4031cf-935a-4188-804c-f7657962271b tempest-VolumesTransfersV357Test-718469626 None] Lock "cinder-0300bb49-c279-4c76-8674-2063b5df803e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:52:08 devstack sudo[96300]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f.b9fd9c1b-c5fa-4cc6-b9b7-d519d11e1952" returned: 0 in 0.334s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:08 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f.b9fd9c1b-c5fa-4cc6-b9b7-d519d11e1952 is being set with open permissions: ugo+rw Aug 10 12:52:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f.b9fd9c1b-c5fa-4cc6-b9b7-d519d11e1952 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:08 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ab4031cf-935a-4188-804c-f7657962271b tempest-VolumesTransfersV357Test-718469626 None] Acquiring lock "cinder-quobyte-0300bb49-c279-4c76-8674-2063b5df803e" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:52:08 devstack sudo[96305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f.b9fd9c1b-c5fa-4cc6-b9b7-d519d11e1952 Aug 10 12:52:08 devstack sudo[96305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:08 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ab4031cf-935a-4188-804c-f7657962271b tempest-VolumesTransfersV357Test-718469626 None] Lock "cinder-quobyte-0300bb49-c279-4c76-8674-2063b5df803e" acquired by "delete_volume" :: waited 0.020s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:52:08 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bde17e1-e05f-4cd2-a16c-858a691fe9ab]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:52:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ab4031cf-935a-4188-804c-f7657962271b tempest-VolumesTransfersV357Test-718469626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0300bb49-c279-4c76-8674-2063b5df803e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:08 devstack sudo[96307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0300bb49-c279-4c76-8674-2063b5df803e Aug 10 12:52:08 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:08 devstack sudo[96305]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f.b9fd9c1b-c5fa-4cc6-b9b7-d519d11e1952" returned: 0 in 0.257s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:08 devstack sudo[96310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f.info Aug 10 12:52:08 devstack sudo[96310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:08 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ab4031cf-935a-4188-804c-f7657962271b tempest-VolumesTransfersV357Test-718469626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0300bb49-c279-4c76-8674-2063b5df803e" returned: 0 in 0.370s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ab4031cf-935a-4188-804c-f7657962271b tempest-VolumesTransfersV357Test-718469626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0300bb49-c279-4c76-8674-2063b5df803e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:08 devstack sudo[96315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0300bb49-c279-4c76-8674-2063b5df803e Aug 10 12:52:08 devstack sudo[96315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:08 devstack sudo[96310]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f.info" returned: 0 in 0.250s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:08 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f.info is being set with open permissions: ugo+rw Aug 10 12:52:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:08 devstack sudo[96318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f.info Aug 10 12:52:08 devstack sudo[96318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:09 devstack sudo[96315]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ab4031cf-935a-4188-804c-f7657962271b tempest-VolumesTransfersV357Test-718469626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0300bb49-c279-4c76-8674-2063b5df803e" returned: 0 in 0.257s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:09 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ab4031cf-935a-4188-804c-f7657962271b tempest-VolumesTransfersV357Test-718469626 None] Lock "cinder-quobyte-0300bb49-c279-4c76-8674-2063b5df803e" released by "delete_volume" :: held 0.682s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:52:09 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-ab4031cf-935a-4188-804c-f7657962271b tempest-VolumesTransfersV357Test-718469626 None] Created reservations ['a7357aff-27a6-492d-84fb-4a8d7848049b', 'cca8f04e-4e8a-4665-b8aa-fbf57724bb54', '3fddac76-5610-4887-b3f0-d23655764606', '4bfaae1e-3943-4015-8f26-d9220fa779e8'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:52:09 devstack sudo[96318]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f.info" returned: 0 in 0.261s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:09 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Acquiring lock "cinder-quobyte-74fbd8b0-b1f4-46b1-ac97-051414893f27" by "_copy_volume_from_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:52:09 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Lock "cinder-quobyte-74fbd8b0-b1f4-46b1-ac97-051414893f27" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:52:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] snapshot: b9fd9c1b-c5fa-4cc6-b9b7-d519d11e1952, volume: 74fbd8b0-b1f4-46b1-ac97-051414893f27, {{(pid=89096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 10 12:52:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:52:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:52:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:52:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:52:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:52:09 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c4d78d-496e-4bc6-9c0f-d7fd530ced22]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:52:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f.b9fd9c1b-c5fa-4cc6-b9b7-d519d11e1952 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ab4031cf-935a-4188-804c-f7657962271b tempest-VolumesTransfersV357Test-718469626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:52:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ab4031cf-935a-4188-804c-f7657962271b tempest-VolumesTransfersV357Test-718469626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:52:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ab4031cf-935a-4188-804c-f7657962271b tempest-VolumesTransfersV357Test-718469626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:52:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ab4031cf-935a-4188-804c-f7657962271b tempest-VolumesTransfersV357Test-718469626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:52:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ab4031cf-935a-4188-804c-f7657962271b tempest-VolumesTransfersV357Test-718469626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:52:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ab4031cf-935a-4188-804c-f7657962271b tempest-VolumesTransfersV357Test-718469626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:09 devstack sudo[96323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:52:09 devstack sudo[96323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:09 devstack sudo[96322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f.b9fd9c1b-c5fa-4cc6-b9b7-d519d11e1952 Aug 10 12:52:09 devstack sudo[96322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:09 devstack sudo[96323]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ab4031cf-935a-4188-804c-f7657962271b tempest-VolumesTransfersV357Test-718469626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.267s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:09 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-ab4031cf-935a-4188-804c-f7657962271b tempest-VolumesTransfersV357Test-718469626 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:52:09 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-ab4031cf-935a-4188-804c-f7657962271b tempest-VolumesTransfersV357Test-718469626 None] Deleted volume successfully. Aug 10 12:52:09 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ab4031cf-935a-4188-804c-f7657962271b tempest-VolumesTransfersV357Test-718469626 None] Lock "cinder-0300bb49-c279-4c76-8674-2063b5df803e-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:52:09 devstack sudo[96322]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f.b9fd9c1b-c5fa-4cc6-b9b7-d519d11e1952" returned: 0 in 0.401s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 12:52:09 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e093d6-0c38-4706-986a-8e7a1062f81f]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:52:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:09 devstack sudo[96330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f Aug 10 12:52:09 devstack sudo[96330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:09 devstack sudo[96330]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f" returned: 0 in 0.374s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f {{(pid=89096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 10 12:52:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Creating direct copy from snapshot {{(pid=89096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 10 12:52:09 devstack cinder-volume[89096]: DEBUG cinder.utils [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Path /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-74fbd8b0-b1f4-46b1-ac97-051414893f27 not found in is_blk_device check {{(pid=89096) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 10 12:52:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-74fbd8b0-b1f4-46b1-ac97-051414893f27 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:10 devstack sudo[96335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-74fbd8b0-b1f4-46b1-ac97-051414893f27 Aug 10 12:52:10 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:15 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-74fbd8b0-b1f4-46b1-ac97-051414893f27" returned: 0 in 5.031s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:15 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Image conversion details: src /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f, size 1024.00 MB, duration 5.03 sec, destination /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-74fbd8b0-b1f4-46b1-ac97-051414893f27 {{(pid=89096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 12:52:15 devstack cinder-volume[89096]: INFO cinder.image.image_utils [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Converted 1024.00 MB image at 203.48 MB/s Aug 10 12:52:15 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-74fbd8b0-b1f4-46b1-ac97-051414893f27 is being set with open permissions: ugo+rw Aug 10 12:52:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-74fbd8b0-b1f4-46b1-ac97-051414893f27 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:15 devstack sudo[96348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-74fbd8b0-b1f4-46b1-ac97-051414893f27 Aug 10 12:52:15 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:15 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-74fbd8b0-b1f4-46b1-ac97-051414893f27" returned: 0 in 0.257s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:15 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Lock "cinder-quobyte-74fbd8b0-b1f4-46b1-ac97-051414893f27" released by "_copy_volume_from_snapshot" :: held 6.130s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:52:15 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Acquiring lock "cinder-quobyte-b9fd9c1b-c5fa-4cc6-b9b7-d519d11e1952" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:52:15 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Lock "cinder-quobyte-b9fd9c1b-c5fa-4cc6-b9b7-d519d11e1952" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:52:15 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Deleting offline snapshot b9fd9c1b-c5fa-4cc6-b9b7-d519d11e1952 of volume dd722b4c-79b2-4117-a863-d7f8b8d9cb7f {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 12:52:15 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] snapshot_file for this snap is: volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f.b9fd9c1b-c5fa-4cc6-b9b7-d519d11e1952 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 12:52:15 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[23883c2a-a442-4b80-bfeb-377941b7c52b]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:52:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f.b9fd9c1b-c5fa-4cc6-b9b7-d519d11e1952 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:15 devstack sudo[96351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f.b9fd9c1b-c5fa-4cc6-b9b7-d519d11e1952 Aug 10 12:52:15 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:15 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f.b9fd9c1b-c5fa-4cc6-b9b7-d519d11e1952" returned: 0 in 0.445s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:15 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 12:52:15 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[146fc7a4-01b0-4f9e-a9ec-c32c656c029e]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:52:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:15 devstack sudo[96356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f Aug 10 12:52:15 devstack sudo[96356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:16 devstack sudo[96356]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f" returned: 0 in 0.562s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f.b9fd9c1b-c5fa-4cc6-b9b7-d519d11e1952 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:16 devstack sudo[96361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f.b9fd9c1b-c5fa-4cc6-b9b7-d519d11e1952 Aug 10 12:52:16 devstack sudo[96361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:16 devstack sudo[96361]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f.b9fd9c1b-c5fa-4cc6-b9b7-d519d11e1952" returned: 0 in 0.391s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f.b9fd9c1b-c5fa-4cc6-b9b7-d519d11e1952 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:16 devstack sudo[96367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f.b9fd9c1b-c5fa-4cc6-b9b7-d519d11e1952 Aug 10 12:52:16 devstack sudo[96367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:17 devstack sudo[96367]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f.b9fd9c1b-c5fa-4cc6-b9b7-d519d11e1952" returned: 0 in 0.258s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:17 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Lock "cinder-quobyte-b9fd9c1b-c5fa-4cc6-b9b7-d519d11e1952" released by "_delete_snapshot" :: held 1.768s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:52:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.051s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:52:17 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fbb83e3-81a9-4169-a893-13765f1cc80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74fbd8b0-b1f4-46b1-ac97-051414893f27', 'volume_size': 2, 'source_volid': 'dd722b4c-79b2-4117-a863-d7f8b8d9cb7f', 'source_volstatus': 'available'}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:17 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffc4fabc-ecae-4f78-b03c-4cad552862bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:17 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Volume volume-74fbd8b0-b1f4-46b1-ac97-051414893f27 (74fbd8b0-b1f4-46b1-ac97-051414893f27): created successfully Aug 10 12:52:17 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffc4fabc-ecae-4f78-b03c-4cad552862bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:17 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Flow 'volume_create_manager' (52564671-9eab-489d-95a7-af4d41d66acc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:52:17 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-14cdfeea-1f15-4108-a9c1-d186d22b2114 tempest-VolumesCloneTest-1733365271 None] Created volume successfully. Aug 10 12:52:18 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5a48a249-ff75-48ec-aa9d-a6168ec26cac tempest-VolumesCloneTest-1733365271 None] Acquiring lock "cinder-74fbd8b0-b1f4-46b1-ac97-051414893f27-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:52:18 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5a48a249-ff75-48ec-aa9d-a6168ec26cac tempest-VolumesCloneTest-1733365271 None] Lock "cinder-74fbd8b0-b1f4-46b1-ac97-051414893f27-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:52:18 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5a48a249-ff75-48ec-aa9d-a6168ec26cac tempest-VolumesCloneTest-1733365271 None] Acquiring lock "cinder-quobyte-74fbd8b0-b1f4-46b1-ac97-051414893f27" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:52:18 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5a48a249-ff75-48ec-aa9d-a6168ec26cac tempest-VolumesCloneTest-1733365271 None] Lock "cinder-quobyte-74fbd8b0-b1f4-46b1-ac97-051414893f27" acquired by "delete_volume" :: waited 0.019s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:52:18 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62c3c48-b337-4813-a9ab-f13029d3567f]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:52:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5a48a249-ff75-48ec-aa9d-a6168ec26cac tempest-VolumesCloneTest-1733365271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-74fbd8b0-b1f4-46b1-ac97-051414893f27 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:18 devstack sudo[96373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-74fbd8b0-b1f4-46b1-ac97-051414893f27 Aug 10 12:52:18 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:18 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5a48a249-ff75-48ec-aa9d-a6168ec26cac tempest-VolumesCloneTest-1733365271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-74fbd8b0-b1f4-46b1-ac97-051414893f27" returned: 0 in 0.423s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5a48a249-ff75-48ec-aa9d-a6168ec26cac tempest-VolumesCloneTest-1733365271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-74fbd8b0-b1f4-46b1-ac97-051414893f27 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:18 devstack sudo[96379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-74fbd8b0-b1f4-46b1-ac97-051414893f27 Aug 10 12:52:18 devstack sudo[96379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:18 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-af614eee-aa38-4e6d-a0e4-5085ee0feca4 tempest-AttachVolumeNegativeTest-1896074937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:52:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-af614eee-aa38-4e6d-a0e4-5085ee0feca4 tempest-AttachVolumeNegativeTest-1896074937 None] Flow 'volume_create_manager' (808354f6-9265-4d0f-9072-a917e64b362e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:52:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-af614eee-aa38-4e6d-a0e4-5085ee0feca4 tempest-AttachVolumeNegativeTest-1896074937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f6a6ca-07fb-4ce7-9945-6f2fa8d990f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-af614eee-aa38-4e6d-a0e4-5085ee0feca4 tempest-AttachVolumeNegativeTest-1896074937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f6a6ca-07fb-4ce7-9945-6f2fa8d990f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1362226424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30b6ecbb-5988-4e8c-ab09-e7f716a386c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5b7c20bff74031ba08276f3ede2b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:52:19Z,use_quota=True,user_id='d1f4d36b032f47449d58b9d791297bf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-af614eee-aa38-4e6d-a0e4-5085ee0feca4 tempest-AttachVolumeNegativeTest-1896074937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a12eaae8-91ee-4d3d-b929-d134d5879e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-af614eee-aa38-4e6d-a0e4-5085ee0feca4 tempest-AttachVolumeNegativeTest-1896074937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a12eaae8-91ee-4d3d-b929-d134d5879e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-af614eee-aa38-4e6d-a0e4-5085ee0feca4 tempest-AttachVolumeNegativeTest-1896074937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd9cfb8f-581b-4f47-9820-d8afc0602e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-af614eee-aa38-4e6d-a0e4-5085ee0feca4 tempest-AttachVolumeNegativeTest-1896074937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd9cfb8f-581b-4f47-9820-d8afc0602e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30b6ecbb-5988-4e8c-ab09-e7f716a386c2', 'volume_name': 'volume-30b6ecbb-5988-4e8c-ab09-e7f716a386c2', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-af614eee-aa38-4e6d-a0e4-5085ee0feca4 tempest-AttachVolumeNegativeTest-1896074937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (032c1ce0-b275-4db0-8290-97fdf897bc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-af614eee-aa38-4e6d-a0e4-5085ee0feca4 tempest-AttachVolumeNegativeTest-1896074937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (032c1ce0-b275-4db0-8290-97fdf897bc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-af614eee-aa38-4e6d-a0e4-5085ee0feca4 tempest-AttachVolumeNegativeTest-1896074937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f76936cf-57ce-4e33-a15b-0f2d89fa6ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:18 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-af614eee-aa38-4e6d-a0e4-5085ee0feca4 tempest-AttachVolumeNegativeTest-1896074937 None] Volume 30b6ecbb-5988-4e8c-ab09-e7f716a386c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30b6ecbb-5988-4e8c-ab09-e7f716a386c2', 'volume_size': 1} Aug 10 12:52:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-af614eee-aa38-4e6d-a0e4-5085ee0feca4 tempest-AttachVolumeNegativeTest-1896074937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:52:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-af614eee-aa38-4e6d-a0e4-5085ee0feca4 tempest-AttachVolumeNegativeTest-1896074937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:52:18 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-af614eee-aa38-4e6d-a0e4-5085ee0feca4 tempest-AttachVolumeNegativeTest-1896074937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1362226424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30b6ecbb-5988-4e8c-ab09-e7f716a386c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5b7c20bff74031ba08276f3ede2b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:52:19Z,use_quota=True,user_id='d1f4d36b032f47449d58b9d791297bf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:52:18 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-af614eee-aa38-4e6d-a0e4-5085ee0feca4 tempest-AttachVolumeNegativeTest-1896074937 None] Creating volume 30b6ecbb-5988-4e8c-ab09-e7f716a386c2 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:52:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-af614eee-aa38-4e6d-a0e4-5085ee0feca4 tempest-AttachVolumeNegativeTest-1896074937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:52:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-af614eee-aa38-4e6d-a0e4-5085ee0feca4 tempest-AttachVolumeNegativeTest-1896074937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:52:18 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-af614eee-aa38-4e6d-a0e4-5085ee0feca4 tempest-AttachVolumeNegativeTest-1896074937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:52:18 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-af614eee-aa38-4e6d-a0e4-5085ee0feca4 tempest-AttachVolumeNegativeTest-1896074937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:52:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-af614eee-aa38-4e6d-a0e4-5085ee0feca4 tempest-AttachVolumeNegativeTest-1896074937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:52:18 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-af614eee-aa38-4e6d-a0e4-5085ee0feca4 tempest-AttachVolumeNegativeTest-1896074937 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:52:18 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-af614eee-aa38-4e6d-a0e4-5085ee0feca4 tempest-AttachVolumeNegativeTest-1896074937 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:52:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af614eee-aa38-4e6d-a0e4-5085ee0feca4 tempest-AttachVolumeNegativeTest-1896074937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-30b6ecbb-5988-4e8c-ab09-e7f716a386c2 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:18 devstack sudo[96381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-30b6ecbb-5988-4e8c-ab09-e7f716a386c2 1073741824 Aug 10 12:52:18 devstack sudo[96381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:18 devstack sudo[96379]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5a48a249-ff75-48ec-aa9d-a6168ec26cac tempest-VolumesCloneTest-1733365271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-74fbd8b0-b1f4-46b1-ac97-051414893f27" returned: 0 in 0.269s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:18 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5a48a249-ff75-48ec-aa9d-a6168ec26cac tempest-VolumesCloneTest-1733365271 None] Lock "cinder-quobyte-74fbd8b0-b1f4-46b1-ac97-051414893f27" released by "delete_volume" :: held 0.757s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:52:18 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-5a48a249-ff75-48ec-aa9d-a6168ec26cac tempest-VolumesCloneTest-1733365271 None] Created reservations ['6ab7478e-f878-400f-9fbf-83bf34ce693d', '11764df5-6176-4162-9d7b-a4d3c6c9fffd', '1b224981-3ca8-44f3-8dda-74818d932146', '50e35069-0a91-481c-b68a-c90e6fdf9517'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:52:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5a48a249-ff75-48ec-aa9d-a6168ec26cac tempest-VolumesCloneTest-1733365271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:52:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5a48a249-ff75-48ec-aa9d-a6168ec26cac tempest-VolumesCloneTest-1733365271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:52:19 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-5a48a249-ff75-48ec-aa9d-a6168ec26cac tempest-VolumesCloneTest-1733365271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:52:19 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-5a48a249-ff75-48ec-aa9d-a6168ec26cac tempest-VolumesCloneTest-1733365271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:52:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5a48a249-ff75-48ec-aa9d-a6168ec26cac tempest-VolumesCloneTest-1733365271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:52:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5a48a249-ff75-48ec-aa9d-a6168ec26cac tempest-VolumesCloneTest-1733365271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:19 devstack sudo[96386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:52:19 devstack sudo[96386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:19 devstack sudo[96381]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af614eee-aa38-4e6d-a0e4-5085ee0feca4 tempest-AttachVolumeNegativeTest-1896074937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-30b6ecbb-5988-4e8c-ab09-e7f716a386c2 1073741824" returned: 0 in 0.543s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:19 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5aed0dda-75ab-45c9-8989-bee50c0d52ed tempest-VolumesCloneTest-1733365271 None] Acquiring lock "cinder-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:52:19 devstack sudo[96386]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:19 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5aed0dda-75ab-45c9-8989-bee50c0d52ed tempest-VolumesCloneTest-1733365271 None] Lock "cinder-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:52:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5a48a249-ff75-48ec-aa9d-a6168ec26cac tempest-VolumesCloneTest-1733365271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.354s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:19 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-5a48a249-ff75-48ec-aa9d-a6168ec26cac tempest-VolumesCloneTest-1733365271 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:52:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af614eee-aa38-4e6d-a0e4-5085ee0feca4 tempest-AttachVolumeNegativeTest-1896074937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-30b6ecbb-5988-4e8c-ab09-e7f716a386c2 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:19 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-5a48a249-ff75-48ec-aa9d-a6168ec26cac tempest-VolumesCloneTest-1733365271 None] Deleted volume successfully. Aug 10 12:52:19 devstack sudo[96391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-30b6ecbb-5988-4e8c-ab09-e7f716a386c2 Aug 10 12:52:19 devstack sudo[96391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:19 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5aed0dda-75ab-45c9-8989-bee50c0d52ed tempest-VolumesCloneTest-1733365271 None] Acquiring lock "cinder-quobyte-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:52:19 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5a48a249-ff75-48ec-aa9d-a6168ec26cac tempest-VolumesCloneTest-1733365271 None] Lock "cinder-74fbd8b0-b1f4-46b1-ac97-051414893f27-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:52:19 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5aed0dda-75ab-45c9-8989-bee50c0d52ed tempest-VolumesCloneTest-1733365271 None] Lock "cinder-quobyte-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f" acquired by "delete_volume" :: waited 0.021s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:52:19 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[9295680b-e109-4be6-b57e-e29be5c220ae]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:52:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5aed0dda-75ab-45c9-8989-bee50c0d52ed tempest-VolumesCloneTest-1733365271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:19 devstack sudo[96393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f Aug 10 12:52:19 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:19 devstack sudo[96391]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af614eee-aa38-4e6d-a0e4-5085ee0feca4 tempest-AttachVolumeNegativeTest-1896074937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-30b6ecbb-5988-4e8c-ab09-e7f716a386c2" returned: 0 in 0.279s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:19 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-af614eee-aa38-4e6d-a0e4-5085ee0feca4 tempest-AttachVolumeNegativeTest-1896074937 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:52:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-af614eee-aa38-4e6d-a0e4-5085ee0feca4 tempest-AttachVolumeNegativeTest-1896074937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:52:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-af614eee-aa38-4e6d-a0e4-5085ee0feca4 tempest-AttachVolumeNegativeTest-1896074937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f76936cf-57ce-4e33-a15b-0f2d89fa6ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30b6ecbb-5988-4e8c-ab09-e7f716a386c2', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-af614eee-aa38-4e6d-a0e4-5085ee0feca4 tempest-AttachVolumeNegativeTest-1896074937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b151a4-5438-4d4d-8359-a61d478953b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:19 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-af614eee-aa38-4e6d-a0e4-5085ee0feca4 tempest-AttachVolumeNegativeTest-1896074937 None] Volume volume-30b6ecbb-5988-4e8c-ab09-e7f716a386c2 (30b6ecbb-5988-4e8c-ab09-e7f716a386c2): created successfully Aug 10 12:52:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-af614eee-aa38-4e6d-a0e4-5085ee0feca4 tempest-AttachVolumeNegativeTest-1896074937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b151a4-5438-4d4d-8359-a61d478953b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-af614eee-aa38-4e6d-a0e4-5085ee0feca4 tempest-AttachVolumeNegativeTest-1896074937 None] Flow 'volume_create_manager' (808354f6-9265-4d0f-9072-a917e64b362e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:52:19 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-af614eee-aa38-4e6d-a0e4-5085ee0feca4 tempest-AttachVolumeNegativeTest-1896074937 None] Created volume successfully. Aug 10 12:52:19 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5aed0dda-75ab-45c9-8989-bee50c0d52ed tempest-VolumesCloneTest-1733365271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f" returned: 0 in 0.403s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5aed0dda-75ab-45c9-8989-bee50c0d52ed tempest-VolumesCloneTest-1733365271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:20 devstack sudo[96399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f Aug 10 12:52:20 devstack sudo[96399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:20 devstack sudo[96399]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5aed0dda-75ab-45c9-8989-bee50c0d52ed tempest-VolumesCloneTest-1733365271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f" returned: 0 in 0.264s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:20 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5aed0dda-75ab-45c9-8989-bee50c0d52ed tempest-VolumesCloneTest-1733365271 None] Lock "cinder-quobyte-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f" released by "delete_volume" :: held 0.739s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:52:20 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-5aed0dda-75ab-45c9-8989-bee50c0d52ed tempest-VolumesCloneTest-1733365271 None] Created reservations ['8b9d0f7e-40ab-4641-8bb9-a6c84f610553', '8f40f641-6825-4987-a10d-e2fefdef6191', '2146e7e8-7220-4fa4-994b-f0e63df4cc25', 'c50ee230-2b0e-423c-a493-2bf627dc3fe0'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:52:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5aed0dda-75ab-45c9-8989-bee50c0d52ed tempest-VolumesCloneTest-1733365271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:52:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5aed0dda-75ab-45c9-8989-bee50c0d52ed tempest-VolumesCloneTest-1733365271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:52:20 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-5aed0dda-75ab-45c9-8989-bee50c0d52ed tempest-VolumesCloneTest-1733365271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:52:20 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-5aed0dda-75ab-45c9-8989-bee50c0d52ed tempest-VolumesCloneTest-1733365271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:52:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5aed0dda-75ab-45c9-8989-bee50c0d52ed tempest-VolumesCloneTest-1733365271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:52:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5aed0dda-75ab-45c9-8989-bee50c0d52ed tempest-VolumesCloneTest-1733365271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:20 devstack sudo[96402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:52:20 devstack sudo[96402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:20 devstack sudo[96402]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5aed0dda-75ab-45c9-8989-bee50c0d52ed tempest-VolumesCloneTest-1733365271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.259s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:20 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-5aed0dda-75ab-45c9-8989-bee50c0d52ed tempest-VolumesCloneTest-1733365271 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:52:20 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-5aed0dda-75ab-45c9-8989-bee50c0d52ed tempest-VolumesCloneTest-1733365271 None] Deleted volume successfully. Aug 10 12:52:20 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5aed0dda-75ab-45c9-8989-bee50c0d52ed tempest-VolumesCloneTest-1733365271 None] Lock "cinder-dd722b4c-79b2-4117-a863-d7f8b8d9cb7f-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:52:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-64a02844-e810-4c23-820a-2a4bcc802ff6 req-bde87668-a5e7-4597-bd3d-d63ebd9885c8 tempest-AttachVolumeNegativeTest-1896074937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:52:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-64a02844-e810-4c23-820a-2a4bcc802ff6 req-bde87668-a5e7-4597-bd3d-d63ebd9885c8 tempest-AttachVolumeNegativeTest-1896074937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:52:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-64a02844-e810-4c23-820a-2a4bcc802ff6 req-bde87668-a5e7-4597-bd3d-d63ebd9885c8 tempest-AttachVolumeNegativeTest-1896074937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:52:22 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-64a02844-e810-4c23-820a-2a4bcc802ff6 req-bde87668-a5e7-4597-bd3d-d63ebd9885c8 tempest-AttachVolumeNegativeTest-1896074937 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d', 'name': 'volume-30b6ecbb-5988-4e8c-ab09-e7f716a386c2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '20738909-027d-4cbd-9222-a0ad86ef20a8', 'enforce_multipath': True} {{(pid=89096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Aug 10 12:52:22 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-64a02844-e810-4c23-820a-2a4bcc802ff6 req-bde87668-a5e7-4597-bd3d-d63ebd9885c8 tempest-AttachVolumeNegativeTest-1896074937 None] attachment_update completed successfully. Aug 10 12:52:24 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-da923260-f4dc-4e5c-9bb5-ab3ca18b279f tempest-VolumesNegativeTest-665849697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:52:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-da923260-f4dc-4e5c-9bb5-ab3ca18b279f tempest-VolumesNegativeTest-665849697 None] Flow 'volume_create_manager' (096b26e3-c2a8-4284-b679-9be06a21e924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:52:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-da923260-f4dc-4e5c-9bb5-ab3ca18b279f tempest-VolumesNegativeTest-665849697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d46d1c33-6d61-4b06-b0c9-1702e31aeac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-da923260-f4dc-4e5c-9bb5-ab3ca18b279f tempest-VolumesNegativeTest-665849697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d46d1c33-6d61-4b06-b0c9-1702e31aeac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1761234435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=964f899f-f08d-423a-943b-7b2b7163eb05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='372a5cd0721b47489dda2ce2773c9348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:52:24Z,use_quota=True,user_id='f9f4883b4acb4509ac6e72cb5182e9ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-da923260-f4dc-4e5c-9bb5-ab3ca18b279f tempest-VolumesNegativeTest-665849697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6a6997-1527-401b-a0f8-3a5de63956b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-da923260-f4dc-4e5c-9bb5-ab3ca18b279f tempest-VolumesNegativeTest-665849697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6a6997-1527-401b-a0f8-3a5de63956b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-da923260-f4dc-4e5c-9bb5-ab3ca18b279f tempest-VolumesNegativeTest-665849697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4ddb050-a20a-428d-ac90-0737a283ad28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-da923260-f4dc-4e5c-9bb5-ab3ca18b279f tempest-VolumesNegativeTest-665849697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4ddb050-a20a-428d-ac90-0737a283ad28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '964f899f-f08d-423a-943b-7b2b7163eb05', 'volume_name': 'volume-964f899f-f08d-423a-943b-7b2b7163eb05', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-da923260-f4dc-4e5c-9bb5-ab3ca18b279f tempest-VolumesNegativeTest-665849697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4017325-a840-46c0-a03b-124c1bcb9584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-da923260-f4dc-4e5c-9bb5-ab3ca18b279f tempest-VolumesNegativeTest-665849697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4017325-a840-46c0-a03b-124c1bcb9584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-da923260-f4dc-4e5c-9bb5-ab3ca18b279f tempest-VolumesNegativeTest-665849697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12004ce7-44f4-46c5-9ace-3edae33964a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:24 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-da923260-f4dc-4e5c-9bb5-ab3ca18b279f tempest-VolumesNegativeTest-665849697 None] Volume 964f899f-f08d-423a-943b-7b2b7163eb05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-964f899f-f08d-423a-943b-7b2b7163eb05', 'volume_size': 1} Aug 10 12:52:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-da923260-f4dc-4e5c-9bb5-ab3ca18b279f tempest-VolumesNegativeTest-665849697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:52:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-da923260-f4dc-4e5c-9bb5-ab3ca18b279f tempest-VolumesNegativeTest-665849697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:52:24 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-da923260-f4dc-4e5c-9bb5-ab3ca18b279f tempest-VolumesNegativeTest-665849697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1761234435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=964f899f-f08d-423a-943b-7b2b7163eb05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='372a5cd0721b47489dda2ce2773c9348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:52:24Z,use_quota=True,user_id='f9f4883b4acb4509ac6e72cb5182e9ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:52:24 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-da923260-f4dc-4e5c-9bb5-ab3ca18b279f tempest-VolumesNegativeTest-665849697 None] Creating volume 964f899f-f08d-423a-943b-7b2b7163eb05 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:52:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-da923260-f4dc-4e5c-9bb5-ab3ca18b279f tempest-VolumesNegativeTest-665849697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:52:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-da923260-f4dc-4e5c-9bb5-ab3ca18b279f tempest-VolumesNegativeTest-665849697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:52:24 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-da923260-f4dc-4e5c-9bb5-ab3ca18b279f tempest-VolumesNegativeTest-665849697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:52:24 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-da923260-f4dc-4e5c-9bb5-ab3ca18b279f tempest-VolumesNegativeTest-665849697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:52:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-da923260-f4dc-4e5c-9bb5-ab3ca18b279f tempest-VolumesNegativeTest-665849697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:52:24 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-da923260-f4dc-4e5c-9bb5-ab3ca18b279f tempest-VolumesNegativeTest-665849697 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:52:24 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-da923260-f4dc-4e5c-9bb5-ab3ca18b279f tempest-VolumesNegativeTest-665849697 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:52:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-da923260-f4dc-4e5c-9bb5-ab3ca18b279f tempest-VolumesNegativeTest-665849697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-964f899f-f08d-423a-943b-7b2b7163eb05 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:24 devstack sudo[96839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-964f899f-f08d-423a-943b-7b2b7163eb05 1073741824 Aug 10 12:52:24 devstack sudo[96839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:24 devstack sudo[96839]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-da923260-f4dc-4e5c-9bb5-ab3ca18b279f tempest-VolumesNegativeTest-665849697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-964f899f-f08d-423a-943b-7b2b7163eb05 1073741824" returned: 0 in 0.658s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-da923260-f4dc-4e5c-9bb5-ab3ca18b279f tempest-VolumesNegativeTest-665849697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-964f899f-f08d-423a-943b-7b2b7163eb05 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:25 devstack sudo[96851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-964f899f-f08d-423a-943b-7b2b7163eb05 Aug 10 12:52:25 devstack sudo[96851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:25 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-56e177cb-ba1d-4087-842a-92e642d84ba1 req-8cc17211-2db2-4ced-a924-5c31ed42746c tempest-AttachVolumeNegativeTest-1896074937 None] Terminate volume connection completed successfully. Aug 10 12:52:25 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-56e177cb-ba1d-4087-842a-92e642d84ba1 req-8cc17211-2db2-4ced-a924-5c31ed42746c tempest-AttachVolumeNegativeTest-1896074937 None] Deleting attachment 20738909-027d-4cbd-9222-a0ad86ef20a8. {{(pid=89096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Aug 10 12:52:25 devstack sudo[96851]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-da923260-f4dc-4e5c-9bb5-ab3ca18b279f tempest-VolumesNegativeTest-665849697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-964f899f-f08d-423a-943b-7b2b7163eb05" returned: 0 in 0.408s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:25 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-da923260-f4dc-4e5c-9bb5-ab3ca18b279f tempest-VolumesNegativeTest-665849697 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:52:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-da923260-f4dc-4e5c-9bb5-ab3ca18b279f tempest-VolumesNegativeTest-665849697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:52:25 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-da923260-f4dc-4e5c-9bb5-ab3ca18b279f tempest-VolumesNegativeTest-665849697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12004ce7-44f4-46c5-9ace-3edae33964a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-964f899f-f08d-423a-943b-7b2b7163eb05', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:25 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-da923260-f4dc-4e5c-9bb5-ab3ca18b279f tempest-VolumesNegativeTest-665849697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa34afde-dda9-405e-a4d8-d7a15cc627c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:25 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-da923260-f4dc-4e5c-9bb5-ab3ca18b279f tempest-VolumesNegativeTest-665849697 None] Volume volume-964f899f-f08d-423a-943b-7b2b7163eb05 (964f899f-f08d-423a-943b-7b2b7163eb05): created successfully Aug 10 12:52:25 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-da923260-f4dc-4e5c-9bb5-ab3ca18b279f tempest-VolumesNegativeTest-665849697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa34afde-dda9-405e-a4d8-d7a15cc627c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:25 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-da923260-f4dc-4e5c-9bb5-ab3ca18b279f tempest-VolumesNegativeTest-665849697 None] Flow 'volume_create_manager' (096b26e3-c2a8-4284-b679-9be06a21e924) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:52:25 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-da923260-f4dc-4e5c-9bb5-ab3ca18b279f tempest-VolumesNegativeTest-665849697 None] Created volume successfully. Aug 10 12:52:30 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-10c2ba09-ee76-493d-b297-afd3eaaab0be tempest-VolumesActionsTest-1354018069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:52:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10c2ba09-ee76-493d-b297-afd3eaaab0be tempest-VolumesActionsTest-1354018069 None] Flow 'volume_create_manager' (37e64739-2d6a-4cf9-a432-7340981e455f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:52:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10c2ba09-ee76-493d-b297-afd3eaaab0be tempest-VolumesActionsTest-1354018069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7afa87e2-48a1-47d7-9f75-b3885e779dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10c2ba09-ee76-493d-b297-afd3eaaab0be tempest-VolumesActionsTest-1354018069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7afa87e2-48a1-47d7-9f75-b3885e779dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1496099679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56bd5dfe-0cd3-480d-b582-ff9f18544f83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eab0fe9501c428996da59cbed864a41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:52:30Z,use_quota=True,user_id='143ad722df084033bf127e811d385650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10c2ba09-ee76-493d-b297-afd3eaaab0be tempest-VolumesActionsTest-1354018069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8a2ca78-bdab-4aa6-8360-257e4991caef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10c2ba09-ee76-493d-b297-afd3eaaab0be tempest-VolumesActionsTest-1354018069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8a2ca78-bdab-4aa6-8360-257e4991caef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10c2ba09-ee76-493d-b297-afd3eaaab0be tempest-VolumesActionsTest-1354018069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bf716c0-fcaf-4b1a-ac58-3d5629791823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10c2ba09-ee76-493d-b297-afd3eaaab0be tempest-VolumesActionsTest-1354018069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bf716c0-fcaf-4b1a-ac58-3d5629791823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56bd5dfe-0cd3-480d-b582-ff9f18544f83', 'volume_name': 'volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10c2ba09-ee76-493d-b297-afd3eaaab0be tempest-VolumesActionsTest-1354018069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37c36ac4-a466-4c2e-a281-7a1b5f9662fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10c2ba09-ee76-493d-b297-afd3eaaab0be tempest-VolumesActionsTest-1354018069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37c36ac4-a466-4c2e-a281-7a1b5f9662fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10c2ba09-ee76-493d-b297-afd3eaaab0be tempest-VolumesActionsTest-1354018069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6da198c5-ea7e-4d79-8170-f4a9b4c411c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:30 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-10c2ba09-ee76-493d-b297-afd3eaaab0be tempest-VolumesActionsTest-1354018069 None] Volume 56bd5dfe-0cd3-480d-b582-ff9f18544f83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83', 'volume_size': 1} Aug 10 12:52:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-10c2ba09-ee76-493d-b297-afd3eaaab0be tempest-VolumesActionsTest-1354018069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:52:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-10c2ba09-ee76-493d-b297-afd3eaaab0be tempest-VolumesActionsTest-1354018069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:52:30 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-10c2ba09-ee76-493d-b297-afd3eaaab0be tempest-VolumesActionsTest-1354018069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1496099679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56bd5dfe-0cd3-480d-b582-ff9f18544f83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eab0fe9501c428996da59cbed864a41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:52:30Z,use_quota=True,user_id='143ad722df084033bf127e811d385650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:52:30 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-10c2ba09-ee76-493d-b297-afd3eaaab0be tempest-VolumesActionsTest-1354018069 None] Creating volume 56bd5dfe-0cd3-480d-b582-ff9f18544f83 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:52:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-10c2ba09-ee76-493d-b297-afd3eaaab0be tempest-VolumesActionsTest-1354018069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:52:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-10c2ba09-ee76-493d-b297-afd3eaaab0be tempest-VolumesActionsTest-1354018069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:52:30 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-10c2ba09-ee76-493d-b297-afd3eaaab0be tempest-VolumesActionsTest-1354018069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:52:30 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-10c2ba09-ee76-493d-b297-afd3eaaab0be tempest-VolumesActionsTest-1354018069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:52:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-10c2ba09-ee76-493d-b297-afd3eaaab0be tempest-VolumesActionsTest-1354018069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:52:30 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-10c2ba09-ee76-493d-b297-afd3eaaab0be tempest-VolumesActionsTest-1354018069 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:52:30 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-10c2ba09-ee76-493d-b297-afd3eaaab0be tempest-VolumesActionsTest-1354018069 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:52:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-10c2ba09-ee76-493d-b297-afd3eaaab0be tempest-VolumesActionsTest-1354018069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:30 devstack sudo[96912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83 1073741824 Aug 10 12:52:30 devstack sudo[96912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:30 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-00f2f9d3-e1e8-4295-9849-4094b70edacd tempest-AttachVolumeNegativeTest-1896074937 None] Acquiring lock "cinder-30b6ecbb-5988-4e8c-ab09-e7f716a386c2-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:52:30 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-00f2f9d3-e1e8-4295-9849-4094b70edacd tempest-AttachVolumeNegativeTest-1896074937 None] Lock "cinder-30b6ecbb-5988-4e8c-ab09-e7f716a386c2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:52:31 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-00f2f9d3-e1e8-4295-9849-4094b70edacd tempest-AttachVolumeNegativeTest-1896074937 None] Acquiring lock "cinder-quobyte-30b6ecbb-5988-4e8c-ab09-e7f716a386c2" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:52:31 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-00f2f9d3-e1e8-4295-9849-4094b70edacd tempest-AttachVolumeNegativeTest-1896074937 None] Lock "cinder-quobyte-30b6ecbb-5988-4e8c-ab09-e7f716a386c2" acquired by "delete_volume" :: waited 0.022s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:52:31 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee73dd2-7b7c-4e38-9f28-fd2b62f1f667]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:52:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-00f2f9d3-e1e8-4295-9849-4094b70edacd tempest-AttachVolumeNegativeTest-1896074937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-30b6ecbb-5988-4e8c-ab09-e7f716a386c2 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:31 devstack sudo[96912]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-10c2ba09-ee76-493d-b297-afd3eaaab0be tempest-VolumesActionsTest-1354018069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83 1073741824" returned: 0 in 0.728s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-10c2ba09-ee76-493d-b297-afd3eaaab0be tempest-VolumesActionsTest-1354018069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:31 devstack sudo[96927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83 Aug 10 12:52:31 devstack sudo[96927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:31 devstack sudo[96923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-30b6ecbb-5988-4e8c-ab09-e7f716a386c2 Aug 10 12:52:31 devstack sudo[96923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:31 devstack sudo[96927]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-10c2ba09-ee76-493d-b297-afd3eaaab0be tempest-VolumesActionsTest-1354018069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83" returned: 0 in 0.350s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:31 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-10c2ba09-ee76-493d-b297-afd3eaaab0be tempest-VolumesActionsTest-1354018069 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:52:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-10c2ba09-ee76-493d-b297-afd3eaaab0be tempest-VolumesActionsTest-1354018069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:52:31 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10c2ba09-ee76-493d-b297-afd3eaaab0be tempest-VolumesActionsTest-1354018069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6da198c5-ea7e-4d79-8170-f4a9b4c411c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:31 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10c2ba09-ee76-493d-b297-afd3eaaab0be tempest-VolumesActionsTest-1354018069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f866587-a6e8-41ae-9be2-30031bf38d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:31 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-10c2ba09-ee76-493d-b297-afd3eaaab0be tempest-VolumesActionsTest-1354018069 None] Volume volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83 (56bd5dfe-0cd3-480d-b582-ff9f18544f83): created successfully Aug 10 12:52:31 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10c2ba09-ee76-493d-b297-afd3eaaab0be tempest-VolumesActionsTest-1354018069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f866587-a6e8-41ae-9be2-30031bf38d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:31 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10c2ba09-ee76-493d-b297-afd3eaaab0be tempest-VolumesActionsTest-1354018069 None] Flow 'volume_create_manager' (37e64739-2d6a-4cf9-a432-7340981e455f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:52:31 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-10c2ba09-ee76-493d-b297-afd3eaaab0be tempest-VolumesActionsTest-1354018069 None] Created volume successfully. Aug 10 12:52:31 devstack sudo[96923]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-00f2f9d3-e1e8-4295-9849-4094b70edacd tempest-AttachVolumeNegativeTest-1896074937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-30b6ecbb-5988-4e8c-ab09-e7f716a386c2" returned: 0 in 0.554s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-00f2f9d3-e1e8-4295-9849-4094b70edacd tempest-AttachVolumeNegativeTest-1896074937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-30b6ecbb-5988-4e8c-ab09-e7f716a386c2 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:31 devstack sudo[96942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-30b6ecbb-5988-4e8c-ab09-e7f716a386c2 Aug 10 12:52:31 devstack sudo[96942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:31 devstack sudo[96942]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-00f2f9d3-e1e8-4295-9849-4094b70edacd tempest-AttachVolumeNegativeTest-1896074937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-30b6ecbb-5988-4e8c-ab09-e7f716a386c2" returned: 0 in 0.286s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:31 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-00f2f9d3-e1e8-4295-9849-4094b70edacd tempest-AttachVolumeNegativeTest-1896074937 None] Lock "cinder-quobyte-30b6ecbb-5988-4e8c-ab09-e7f716a386c2" released by "delete_volume" :: held 0.895s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:52:31 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-00f2f9d3-e1e8-4295-9849-4094b70edacd tempest-AttachVolumeNegativeTest-1896074937 None] Created reservations ['3fde8e42-40b7-4122-83e7-db2ddd8c10eb', '4826a14d-6e70-43d6-8ff5-1f93ab9ae6f1', '6ad5eda0-69c4-4ef2-9bca-92c1be1d41da', '98de48f7-7257-40bb-b0df-3ba8061a35cd'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:52:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-00f2f9d3-e1e8-4295-9849-4094b70edacd tempest-AttachVolumeNegativeTest-1896074937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:52:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-00f2f9d3-e1e8-4295-9849-4094b70edacd tempest-AttachVolumeNegativeTest-1896074937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:52:32 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-00f2f9d3-e1e8-4295-9849-4094b70edacd tempest-AttachVolumeNegativeTest-1896074937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:52:32 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-00f2f9d3-e1e8-4295-9849-4094b70edacd tempest-AttachVolumeNegativeTest-1896074937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:52:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-00f2f9d3-e1e8-4295-9849-4094b70edacd tempest-AttachVolumeNegativeTest-1896074937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:52:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-00f2f9d3-e1e8-4295-9849-4094b70edacd tempest-AttachVolumeNegativeTest-1896074937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:32 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:52:32 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:32 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-00f2f9d3-e1e8-4295-9849-4094b70edacd tempest-AttachVolumeNegativeTest-1896074937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.268s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:32 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-00f2f9d3-e1e8-4295-9849-4094b70edacd tempest-AttachVolumeNegativeTest-1896074937 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:52:32 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-00f2f9d3-e1e8-4295-9849-4094b70edacd tempest-AttachVolumeNegativeTest-1896074937 None] Deleted volume successfully. Aug 10 12:52:32 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-00f2f9d3-e1e8-4295-9849-4094b70edacd tempest-AttachVolumeNegativeTest-1896074937 None] Lock "cinder-30b6ecbb-5988-4e8c-ab09-e7f716a386c2-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:52:33 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b4bdd872-24bb-4fbc-94be-82b79fb9853b tempest-AttachVolumeNegativeTest-1896074937 None] Acquiring lock "cinder-db622a62-1813-4ff6-baae-fd3a8fdbd58d-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:52:33 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b4bdd872-24bb-4fbc-94be-82b79fb9853b tempest-AttachVolumeNegativeTest-1896074937 None] Lock "cinder-db622a62-1813-4ff6-baae-fd3a8fdbd58d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:52:33 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b4bdd872-24bb-4fbc-94be-82b79fb9853b tempest-AttachVolumeNegativeTest-1896074937 None] Acquiring lock "cinder-quobyte-db622a62-1813-4ff6-baae-fd3a8fdbd58d" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:52:33 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b4bdd872-24bb-4fbc-94be-82b79fb9853b tempest-AttachVolumeNegativeTest-1896074937 None] Lock "cinder-quobyte-db622a62-1813-4ff6-baae-fd3a8fdbd58d" acquired by "delete_volume" :: waited 0.024s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:52:33 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c713d187-3fc6-496c-8f65-44b53a1f4fb5]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:52:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b4bdd872-24bb-4fbc-94be-82b79fb9853b tempest-AttachVolumeNegativeTest-1896074937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-db622a62-1813-4ff6-baae-fd3a8fdbd58d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:33 devstack sudo[96952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-db622a62-1813-4ff6-baae-fd3a8fdbd58d Aug 10 12:52:33 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:34 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b4bdd872-24bb-4fbc-94be-82b79fb9853b tempest-AttachVolumeNegativeTest-1896074937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-db622a62-1813-4ff6-baae-fd3a8fdbd58d" returned: 0 in 0.769s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b4bdd872-24bb-4fbc-94be-82b79fb9853b tempest-AttachVolumeNegativeTest-1896074937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-db622a62-1813-4ff6-baae-fd3a8fdbd58d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:34 devstack sudo[96990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-db622a62-1813-4ff6-baae-fd3a8fdbd58d Aug 10 12:52:34 devstack sudo[96990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:34 devstack sudo[96990]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b4bdd872-24bb-4fbc-94be-82b79fb9853b tempest-AttachVolumeNegativeTest-1896074937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-db622a62-1813-4ff6-baae-fd3a8fdbd58d" returned: 0 in 0.429s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:34 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b4bdd872-24bb-4fbc-94be-82b79fb9853b tempest-AttachVolumeNegativeTest-1896074937 None] Lock "cinder-quobyte-db622a62-1813-4ff6-baae-fd3a8fdbd58d" released by "delete_volume" :: held 1.264s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:52:34 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-b4bdd872-24bb-4fbc-94be-82b79fb9853b tempest-AttachVolumeNegativeTest-1896074937 None] Created reservations ['b4019d1d-5ce3-4190-83be-74834c7b904f', '035f0b5e-02bf-4f14-96a7-0f1cccad0c79', 'daa5cb8f-8efe-4451-ae8d-4b7887b6a16d', 'd7145477-06ce-4e94-9c4d-45dd25e9f378'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:52:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b4bdd872-24bb-4fbc-94be-82b79fb9853b tempest-AttachVolumeNegativeTest-1896074937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:52:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b4bdd872-24bb-4fbc-94be-82b79fb9853b tempest-AttachVolumeNegativeTest-1896074937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:52:34 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b4bdd872-24bb-4fbc-94be-82b79fb9853b tempest-AttachVolumeNegativeTest-1896074937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:52:34 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b4bdd872-24bb-4fbc-94be-82b79fb9853b tempest-AttachVolumeNegativeTest-1896074937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:52:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b4bdd872-24bb-4fbc-94be-82b79fb9853b tempest-AttachVolumeNegativeTest-1896074937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:52:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b4bdd872-24bb-4fbc-94be-82b79fb9853b tempest-AttachVolumeNegativeTest-1896074937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:34 devstack sudo[97017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:52:34 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:35 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b4bdd872-24bb-4fbc-94be-82b79fb9853b tempest-AttachVolumeNegativeTest-1896074937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.462s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:35 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-b4bdd872-24bb-4fbc-94be-82b79fb9853b tempest-AttachVolumeNegativeTest-1896074937 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:52:35 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-b4bdd872-24bb-4fbc-94be-82b79fb9853b tempest-AttachVolumeNegativeTest-1896074937 None] Deleted volume successfully. Aug 10 12:52:35 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b4bdd872-24bb-4fbc-94be-82b79fb9853b tempest-AttachVolumeNegativeTest-1896074937 None] Lock "cinder-db622a62-1813-4ff6-baae-fd3a8fdbd58d-delete_volume" released by "delete_volume" :: held 2.169s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:52:35 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7b18a68e-d2cd-4775-8d65-ad68d6ab2839 tempest-AttachVolumeNegativeTest-1896074937 None] Acquiring lock "cinder-cd9e0b6f-45dd-4010-a166-945f272f8bc6-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:52:35 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7b18a68e-d2cd-4775-8d65-ad68d6ab2839 tempest-AttachVolumeNegativeTest-1896074937 None] Lock "cinder-cd9e0b6f-45dd-4010-a166-945f272f8bc6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:52:36 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7b18a68e-d2cd-4775-8d65-ad68d6ab2839 tempest-AttachVolumeNegativeTest-1896074937 None] Acquiring lock "cinder-quobyte-cd9e0b6f-45dd-4010-a166-945f272f8bc6" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:52:36 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7b18a68e-d2cd-4775-8d65-ad68d6ab2839 tempest-AttachVolumeNegativeTest-1896074937 None] Lock "cinder-quobyte-cd9e0b6f-45dd-4010-a166-945f272f8bc6" acquired by "delete_volume" :: waited 0.022s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:52:36 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0a2d7d-9c9a-4781-9cfe-cc7d8bab61af]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:52:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7b18a68e-d2cd-4775-8d65-ad68d6ab2839 tempest-AttachVolumeNegativeTest-1896074937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cd9e0b6f-45dd-4010-a166-945f272f8bc6 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:36 devstack sudo[97051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cd9e0b6f-45dd-4010-a166-945f272f8bc6 Aug 10 12:52:36 devstack sudo[97051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:36 devstack sudo[97051]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7b18a68e-d2cd-4775-8d65-ad68d6ab2839 tempest-AttachVolumeNegativeTest-1896074937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cd9e0b6f-45dd-4010-a166-945f272f8bc6" returned: 0 in 0.606s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7b18a68e-d2cd-4775-8d65-ad68d6ab2839 tempest-AttachVolumeNegativeTest-1896074937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cd9e0b6f-45dd-4010-a166-945f272f8bc6 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:36 devstack sudo[97069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cd9e0b6f-45dd-4010-a166-945f272f8bc6 Aug 10 12:52:36 devstack sudo[97069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:37 devstack sudo[97069]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7b18a68e-d2cd-4775-8d65-ad68d6ab2839 tempest-AttachVolumeNegativeTest-1896074937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cd9e0b6f-45dd-4010-a166-945f272f8bc6" returned: 0 in 0.617s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:37 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7b18a68e-d2cd-4775-8d65-ad68d6ab2839 tempest-AttachVolumeNegativeTest-1896074937 None] Lock "cinder-quobyte-cd9e0b6f-45dd-4010-a166-945f272f8bc6" released by "delete_volume" :: held 1.284s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:52:37 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-7b18a68e-d2cd-4775-8d65-ad68d6ab2839 tempest-AttachVolumeNegativeTest-1896074937 None] Created reservations ['7d4ff5f2-a756-49a0-914e-e1875709a067', '48f0ba06-a656-45ae-92e9-a054efaa4aad', 'f1615361-dc2a-468e-b78e-fe909cd78bbb', 'd62aaa4d-c2fa-4cb7-aa02-d78469c78870'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:52:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7b18a68e-d2cd-4775-8d65-ad68d6ab2839 tempest-AttachVolumeNegativeTest-1896074937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:52:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7b18a68e-d2cd-4775-8d65-ad68d6ab2839 tempest-AttachVolumeNegativeTest-1896074937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:52:37 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-7b18a68e-d2cd-4775-8d65-ad68d6ab2839 tempest-AttachVolumeNegativeTest-1896074937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:52:37 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-7b18a68e-d2cd-4775-8d65-ad68d6ab2839 tempest-AttachVolumeNegativeTest-1896074937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:52:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7b18a68e-d2cd-4775-8d65-ad68d6ab2839 tempest-AttachVolumeNegativeTest-1896074937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:52:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7b18a68e-d2cd-4775-8d65-ad68d6ab2839 tempest-AttachVolumeNegativeTest-1896074937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:37 devstack sudo[97074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:52:37 devstack sudo[97074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:37 devstack sudo[97074]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7b18a68e-d2cd-4775-8d65-ad68d6ab2839 tempest-AttachVolumeNegativeTest-1896074937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.266s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:37 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-7b18a68e-d2cd-4775-8d65-ad68d6ab2839 tempest-AttachVolumeNegativeTest-1896074937 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:52:37 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-7b18a68e-d2cd-4775-8d65-ad68d6ab2839 tempest-AttachVolumeNegativeTest-1896074937 None] Deleted volume successfully. Aug 10 12:52:37 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7b18a68e-d2cd-4775-8d65-ad68d6ab2839 tempest-AttachVolumeNegativeTest-1896074937 None] Lock "cinder-cd9e0b6f-45dd-4010-a166-945f272f8bc6-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:52:44 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-9186d3af-1211-43d8-bb33-b11019428ba5 tempest-VolumesActionsTest-1354018069 None] Acquiring lock "cinder-56bd5dfe-0cd3-480d-b582-ff9f18544f83" by "attach_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:52:44 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-9186d3af-1211-43d8-bb33-b11019428ba5 tempest-VolumesActionsTest-1354018069 None] Lock "cinder-56bd5dfe-0cd3-480d-b582-ff9f18544f83" acquired by "attach_volume" :: waited 0.020s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:52:44 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-9186d3af-1211-43d8-bb33-b11019428ba5 tempest-VolumesActionsTest-1354018069 None] Attaching volume 56bd5dfe-0cd3-480d-b582-ff9f18544f83 to instance 06694ace-ee64-4017-bb56-6e18bc1e1ff4 at mountpoint /dev/vdb on host None. Aug 10 12:52:44 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-9186d3af-1211-43d8-bb33-b11019428ba5 tempest-VolumesActionsTest-1354018069 None] Attach volume completed successfully. Aug 10 12:52:44 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-9186d3af-1211-43d8-bb33-b11019428ba5 tempest-VolumesActionsTest-1354018069 None] Lock "cinder-56bd5dfe-0cd3-480d-b582-ff9f18544f83" released by "attach_volume" :: held 0.142s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:52:44 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-9bb1ca22-62e6-4926-b4d0-07027f4b44b5 tempest-VolumesActionsTest-1354018069 None] Acquiring lock "cinder-56bd5dfe-0cd3-480d-b582-ff9f18544f83-detach_volume" by "detach_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:52:44 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-9bb1ca22-62e6-4926-b4d0-07027f4b44b5 tempest-VolumesActionsTest-1354018069 None] Lock "cinder-56bd5dfe-0cd3-480d-b582-ff9f18544f83-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:52:44 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-9bb1ca22-62e6-4926-b4d0-07027f4b44b5 tempest-VolumesActionsTest-1354018069 None] Detaching volume 56bd5dfe-0cd3-480d-b582-ff9f18544f83 from instance 06694ace-ee64-4017-bb56-6e18bc1e1ff4. Aug 10 12:52:44 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-9bb1ca22-62e6-4926-b4d0-07027f4b44b5 tempest-VolumesActionsTest-1354018069 None] Detach volume completed successfully. Aug 10 12:52:44 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-9bb1ca22-62e6-4926-b4d0-07027f4b44b5 tempest-VolumesActionsTest-1354018069 None] Lock "cinder-56bd5dfe-0cd3-480d-b582-ff9f18544f83-detach_volume" released by "detach_volume" :: held 0.080s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:52:49 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [req-01bee144-bbf4-4137-90b3-cb212aaf3de3 req-736ff3d4-35f8-404f-8b1b-324768ab68ac tempest-VolumesGetTestJSON-377077670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:52:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-01bee144-bbf4-4137-90b3-cb212aaf3de3 req-736ff3d4-35f8-404f-8b1b-324768ab68ac tempest-VolumesGetTestJSON-377077670 None] Flow 'volume_create_manager' (5a41507a-0c78-4d27-a7fa-e764fc32cbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:52:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-01bee144-bbf4-4137-90b3-cb212aaf3de3 req-736ff3d4-35f8-404f-8b1b-324768ab68ac tempest-VolumesGetTestJSON-377077670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f343e422-ae2c-409e-8e75-5d59a6863f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-01bee144-bbf4-4137-90b3-cb212aaf3de3 req-736ff3d4-35f8-404f-8b1b-324768ab68ac tempest-VolumesGetTestJSON-377077670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f343e422-ae2c-409e-8e75-5d59a6863f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1309889371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50b002e7-a685-4303-94bf-e379e7af309b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e1140474517c4b08a469076dcabfb5e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:52:49Z,use_quota=True,user_id='d02e4a55824f441d94ea2e22b3b1adf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-01bee144-bbf4-4137-90b3-cb212aaf3de3 req-736ff3d4-35f8-404f-8b1b-324768ab68ac tempest-VolumesGetTestJSON-377077670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9507b343-f768-481d-8f06-3b5121b1fad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-01bee144-bbf4-4137-90b3-cb212aaf3de3 req-736ff3d4-35f8-404f-8b1b-324768ab68ac tempest-VolumesGetTestJSON-377077670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9507b343-f768-481d-8f06-3b5121b1fad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-01bee144-bbf4-4137-90b3-cb212aaf3de3 req-736ff3d4-35f8-404f-8b1b-324768ab68ac tempest-VolumesGetTestJSON-377077670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf98325a-798f-4169-8881-a25a7666a73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-01bee144-bbf4-4137-90b3-cb212aaf3de3 req-736ff3d4-35f8-404f-8b1b-324768ab68ac tempest-VolumesGetTestJSON-377077670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf98325a-798f-4169-8881-a25a7666a73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50b002e7-a685-4303-94bf-e379e7af309b', 'volume_name': 'volume-50b002e7-a685-4303-94bf-e379e7af309b', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-01bee144-bbf4-4137-90b3-cb212aaf3de3 req-736ff3d4-35f8-404f-8b1b-324768ab68ac tempest-VolumesGetTestJSON-377077670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90757e7d-7da9-41f0-aabc-df1eceb098a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-01bee144-bbf4-4137-90b3-cb212aaf3de3 req-736ff3d4-35f8-404f-8b1b-324768ab68ac tempest-VolumesGetTestJSON-377077670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90757e7d-7da9-41f0-aabc-df1eceb098a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-01bee144-bbf4-4137-90b3-cb212aaf3de3 req-736ff3d4-35f8-404f-8b1b-324768ab68ac tempest-VolumesGetTestJSON-377077670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e88c4430-ed6c-4c2e-84bf-b5b5e375ca5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:49 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [req-01bee144-bbf4-4137-90b3-cb212aaf3de3 req-736ff3d4-35f8-404f-8b1b-324768ab68ac tempest-VolumesGetTestJSON-377077670 None] Volume 50b002e7-a685-4303-94bf-e379e7af309b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50b002e7-a685-4303-94bf-e379e7af309b', 'volume_size': 1} Aug 10 12:52:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-01bee144-bbf4-4137-90b3-cb212aaf3de3 req-736ff3d4-35f8-404f-8b1b-324768ab68ac tempest-VolumesGetTestJSON-377077670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:52:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-01bee144-bbf4-4137-90b3-cb212aaf3de3 req-736ff3d4-35f8-404f-8b1b-324768ab68ac tempest-VolumesGetTestJSON-377077670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:52:49 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [req-01bee144-bbf4-4137-90b3-cb212aaf3de3 req-736ff3d4-35f8-404f-8b1b-324768ab68ac tempest-VolumesGetTestJSON-377077670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1309889371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50b002e7-a685-4303-94bf-e379e7af309b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e1140474517c4b08a469076dcabfb5e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:52:49Z,use_quota=True,user_id='d02e4a55824f441d94ea2e22b3b1adf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:52:49 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [req-01bee144-bbf4-4137-90b3-cb212aaf3de3 req-736ff3d4-35f8-404f-8b1b-324768ab68ac tempest-VolumesGetTestJSON-377077670 None] Creating volume 50b002e7-a685-4303-94bf-e379e7af309b {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:52:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-01bee144-bbf4-4137-90b3-cb212aaf3de3 req-736ff3d4-35f8-404f-8b1b-324768ab68ac tempest-VolumesGetTestJSON-377077670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:52:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-01bee144-bbf4-4137-90b3-cb212aaf3de3 req-736ff3d4-35f8-404f-8b1b-324768ab68ac tempest-VolumesGetTestJSON-377077670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:52:49 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [req-01bee144-bbf4-4137-90b3-cb212aaf3de3 req-736ff3d4-35f8-404f-8b1b-324768ab68ac tempest-VolumesGetTestJSON-377077670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:52:49 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [req-01bee144-bbf4-4137-90b3-cb212aaf3de3 req-736ff3d4-35f8-404f-8b1b-324768ab68ac tempest-VolumesGetTestJSON-377077670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:52:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-01bee144-bbf4-4137-90b3-cb212aaf3de3 req-736ff3d4-35f8-404f-8b1b-324768ab68ac tempest-VolumesGetTestJSON-377077670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:52:49 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [req-01bee144-bbf4-4137-90b3-cb212aaf3de3 req-736ff3d4-35f8-404f-8b1b-324768ab68ac tempest-VolumesGetTestJSON-377077670 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:52:49 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [req-01bee144-bbf4-4137-90b3-cb212aaf3de3 req-736ff3d4-35f8-404f-8b1b-324768ab68ac tempest-VolumesGetTestJSON-377077670 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:52:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-01bee144-bbf4-4137-90b3-cb212aaf3de3 req-736ff3d4-35f8-404f-8b1b-324768ab68ac tempest-VolumesGetTestJSON-377077670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-50b002e7-a685-4303-94bf-e379e7af309b 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:49 devstack sudo[97222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-50b002e7-a685-4303-94bf-e379e7af309b 1073741824 Aug 10 12:52:49 devstack sudo[97222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:50 devstack sudo[97222]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-01bee144-bbf4-4137-90b3-cb212aaf3de3 req-736ff3d4-35f8-404f-8b1b-324768ab68ac tempest-VolumesGetTestJSON-377077670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-50b002e7-a685-4303-94bf-e379e7af309b 1073741824" returned: 0 in 0.571s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-01bee144-bbf4-4137-90b3-cb212aaf3de3 req-736ff3d4-35f8-404f-8b1b-324768ab68ac tempest-VolumesGetTestJSON-377077670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-50b002e7-a685-4303-94bf-e379e7af309b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:50 devstack sudo[97228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-50b002e7-a685-4303-94bf-e379e7af309b Aug 10 12:52:50 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:50 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-01bee144-bbf4-4137-90b3-cb212aaf3de3 req-736ff3d4-35f8-404f-8b1b-324768ab68ac tempest-VolumesGetTestJSON-377077670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-50b002e7-a685-4303-94bf-e379e7af309b" returned: 0 in 0.278s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:50 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [req-01bee144-bbf4-4137-90b3-cb212aaf3de3 req-736ff3d4-35f8-404f-8b1b-324768ab68ac tempest-VolumesGetTestJSON-377077670 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:52:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-01bee144-bbf4-4137-90b3-cb212aaf3de3 req-736ff3d4-35f8-404f-8b1b-324768ab68ac tempest-VolumesGetTestJSON-377077670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:52:50 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-01bee144-bbf4-4137-90b3-cb212aaf3de3 req-736ff3d4-35f8-404f-8b1b-324768ab68ac tempest-VolumesGetTestJSON-377077670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e88c4430-ed6c-4c2e-84bf-b5b5e375ca5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50b002e7-a685-4303-94bf-e379e7af309b', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:50 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-01bee144-bbf4-4137-90b3-cb212aaf3de3 req-736ff3d4-35f8-404f-8b1b-324768ab68ac tempest-VolumesGetTestJSON-377077670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03228cce-24bb-4e25-91d4-ee5d23ef6588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:52:50 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [req-01bee144-bbf4-4137-90b3-cb212aaf3de3 req-736ff3d4-35f8-404f-8b1b-324768ab68ac tempest-VolumesGetTestJSON-377077670 None] Volume volume-50b002e7-a685-4303-94bf-e379e7af309b (50b002e7-a685-4303-94bf-e379e7af309b): created successfully Aug 10 12:52:50 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-01bee144-bbf4-4137-90b3-cb212aaf3de3 req-736ff3d4-35f8-404f-8b1b-324768ab68ac tempest-VolumesGetTestJSON-377077670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03228cce-24bb-4e25-91d4-ee5d23ef6588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:52:50 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-01bee144-bbf4-4137-90b3-cb212aaf3de3 req-736ff3d4-35f8-404f-8b1b-324768ab68ac tempest-VolumesGetTestJSON-377077670 None] Flow 'volume_create_manager' (5a41507a-0c78-4d27-a7fa-e764fc32cbdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:52:50 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-01bee144-bbf4-4137-90b3-cb212aaf3de3 req-736ff3d4-35f8-404f-8b1b-324768ab68ac tempest-VolumesGetTestJSON-377077670 None] Created volume successfully. Aug 10 12:52:51 devstack cinder-volume[89096]: DEBUG cinder.coordination [req-e2c7e08d-3580-4114-8985-cb723dcdf4e9 req-60ab9720-9e32-492c-a570-c7e56e433aac tempest-VolumesGetTestJSON-377077670 None] Acquiring lock "cinder-50b002e7-a685-4303-94bf-e379e7af309b-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:52:52 devstack cinder-volume[89096]: DEBUG cinder.coordination [req-e2c7e08d-3580-4114-8985-cb723dcdf4e9 req-60ab9720-9e32-492c-a570-c7e56e433aac tempest-VolumesGetTestJSON-377077670 None] Lock "cinder-50b002e7-a685-4303-94bf-e379e7af309b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:52:52 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=83,cinder:INSERT=31,cinder:UPDATE=119,cinder:DELETE=9 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:52:52 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:INSERT=22,cinder:UPDATE=106,cinder:SELECT=84,cinder:DELETE=10 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:52:52 devstack cinder-volume[89096]: DEBUG cinder.coordination [req-e2c7e08d-3580-4114-8985-cb723dcdf4e9 req-60ab9720-9e32-492c-a570-c7e56e433aac tempest-VolumesGetTestJSON-377077670 None] Acquiring lock "cinder-quobyte-50b002e7-a685-4303-94bf-e379e7af309b" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:52:52 devstack cinder-volume[89096]: DEBUG cinder.coordination [req-e2c7e08d-3580-4114-8985-cb723dcdf4e9 req-60ab9720-9e32-492c-a570-c7e56e433aac tempest-VolumesGetTestJSON-377077670 None] Lock "cinder-quobyte-50b002e7-a685-4303-94bf-e379e7af309b" acquired by "delete_volume" :: waited 0.017s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:52:52 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[f972083d-5253-429c-9ee3-df65064ee3ed]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:52:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-e2c7e08d-3580-4114-8985-cb723dcdf4e9 req-60ab9720-9e32-492c-a570-c7e56e433aac tempest-VolumesGetTestJSON-377077670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-50b002e7-a685-4303-94bf-e379e7af309b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:52 devstack sudo[97246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-50b002e7-a685-4303-94bf-e379e7af309b Aug 10 12:52:52 devstack sudo[97246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:52 devstack sudo[97246]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-e2c7e08d-3580-4114-8985-cb723dcdf4e9 req-60ab9720-9e32-492c-a570-c7e56e433aac tempest-VolumesGetTestJSON-377077670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-50b002e7-a685-4303-94bf-e379e7af309b" returned: 0 in 0.483s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-e2c7e08d-3580-4114-8985-cb723dcdf4e9 req-60ab9720-9e32-492c-a570-c7e56e433aac tempest-VolumesGetTestJSON-377077670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-50b002e7-a685-4303-94bf-e379e7af309b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:52 devstack sudo[97252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-50b002e7-a685-4303-94bf-e379e7af309b Aug 10 12:52:52 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:52 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-884e9906-5c04-42fe-8dda-2f487fed0f1f tempest-VolumesNegativeTest-665849697 None] Acquiring lock "cinder-964f899f-f08d-423a-943b-7b2b7163eb05-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:52:52 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-884e9906-5c04-42fe-8dda-2f487fed0f1f tempest-VolumesNegativeTest-665849697 None] Lock "cinder-964f899f-f08d-423a-943b-7b2b7163eb05-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:52:52 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-884e9906-5c04-42fe-8dda-2f487fed0f1f tempest-VolumesNegativeTest-665849697 None] Acquiring lock "cinder-quobyte-964f899f-f08d-423a-943b-7b2b7163eb05" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:52:52 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-884e9906-5c04-42fe-8dda-2f487fed0f1f tempest-VolumesNegativeTest-665849697 None] Lock "cinder-quobyte-964f899f-f08d-423a-943b-7b2b7163eb05" acquired by "delete_volume" :: waited 0.018s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:52:52 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-e2c7e08d-3580-4114-8985-cb723dcdf4e9 req-60ab9720-9e32-492c-a570-c7e56e433aac tempest-VolumesGetTestJSON-377077670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-50b002e7-a685-4303-94bf-e379e7af309b" returned: 0 in 0.285s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:52 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6a0fc3-a64f-4bef-a9e8-dd8be123aae5]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:52:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-884e9906-5c04-42fe-8dda-2f487fed0f1f tempest-VolumesNegativeTest-665849697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-964f899f-f08d-423a-943b-7b2b7163eb05 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:52 devstack cinder-volume[89096]: DEBUG cinder.coordination [req-e2c7e08d-3580-4114-8985-cb723dcdf4e9 req-60ab9720-9e32-492c-a570-c7e56e433aac tempest-VolumesGetTestJSON-377077670 None] Lock "cinder-quobyte-50b002e7-a685-4303-94bf-e379e7af309b" released by "delete_volume" :: held 0.858s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:52:52 devstack cinder-volume[89096]: DEBUG cinder.quota [req-e2c7e08d-3580-4114-8985-cb723dcdf4e9 req-60ab9720-9e32-492c-a570-c7e56e433aac tempest-VolumesGetTestJSON-377077670 None] Created reservations ['c18e10a5-90ff-4df4-9458-7394e52edb02', '4f4af75c-272e-42a9-b1c2-c7c50a0ac9fe', 'f4e799f8-631c-4e84-96e7-26b50de58afe', '943d25c0-b002-4dfd-ae98-45a078ba6147'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:52:53 devstack sudo[97255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-964f899f-f08d-423a-943b-7b2b7163eb05 Aug 10 12:52:53 devstack sudo[97255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-e2c7e08d-3580-4114-8985-cb723dcdf4e9 req-60ab9720-9e32-492c-a570-c7e56e433aac tempest-VolumesGetTestJSON-377077670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:52:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-e2c7e08d-3580-4114-8985-cb723dcdf4e9 req-60ab9720-9e32-492c-a570-c7e56e433aac tempest-VolumesGetTestJSON-377077670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:52:53 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [req-e2c7e08d-3580-4114-8985-cb723dcdf4e9 req-60ab9720-9e32-492c-a570-c7e56e433aac tempest-VolumesGetTestJSON-377077670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:52:53 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [req-e2c7e08d-3580-4114-8985-cb723dcdf4e9 req-60ab9720-9e32-492c-a570-c7e56e433aac tempest-VolumesGetTestJSON-377077670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:52:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-e2c7e08d-3580-4114-8985-cb723dcdf4e9 req-60ab9720-9e32-492c-a570-c7e56e433aac tempest-VolumesGetTestJSON-377077670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:52:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-e2c7e08d-3580-4114-8985-cb723dcdf4e9 req-60ab9720-9e32-492c-a570-c7e56e433aac tempest-VolumesGetTestJSON-377077670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:53 devstack sudo[97257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:52:53 devstack sudo[97257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:53 devstack sudo[97255]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-884e9906-5c04-42fe-8dda-2f487fed0f1f tempest-VolumesNegativeTest-665849697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-964f899f-f08d-423a-943b-7b2b7163eb05" returned: 0 in 0.676s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-884e9906-5c04-42fe-8dda-2f487fed0f1f tempest-VolumesNegativeTest-665849697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-964f899f-f08d-423a-943b-7b2b7163eb05 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:53 devstack sudo[97281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-964f899f-f08d-423a-943b-7b2b7163eb05 Aug 10 12:52:53 devstack sudo[97281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:53 devstack sudo[97257]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-e2c7e08d-3580-4114-8985-cb723dcdf4e9 req-60ab9720-9e32-492c-a570-c7e56e433aac tempest-VolumesGetTestJSON-377077670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.608s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:53 devstack cinder-volume[89096]: DEBUG cinder.manager [req-e2c7e08d-3580-4114-8985-cb723dcdf4e9 req-60ab9720-9e32-492c-a570-c7e56e433aac tempest-VolumesGetTestJSON-377077670 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:52:53 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-e2c7e08d-3580-4114-8985-cb723dcdf4e9 req-60ab9720-9e32-492c-a570-c7e56e433aac tempest-VolumesGetTestJSON-377077670 None] Deleted volume successfully. Aug 10 12:52:53 devstack cinder-volume[89096]: DEBUG cinder.coordination [req-e2c7e08d-3580-4114-8985-cb723dcdf4e9 req-60ab9720-9e32-492c-a570-c7e56e433aac tempest-VolumesGetTestJSON-377077670 None] Lock "cinder-50b002e7-a685-4303-94bf-e379e7af309b-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:52:54 devstack sudo[97281]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-884e9906-5c04-42fe-8dda-2f487fed0f1f tempest-VolumesNegativeTest-665849697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-964f899f-f08d-423a-943b-7b2b7163eb05" returned: 0 in 0.492s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:54 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-884e9906-5c04-42fe-8dda-2f487fed0f1f tempest-VolumesNegativeTest-665849697 None] Lock "cinder-quobyte-964f899f-f08d-423a-943b-7b2b7163eb05" released by "delete_volume" :: held 1.234s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:52:54 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-884e9906-5c04-42fe-8dda-2f487fed0f1f tempest-VolumesNegativeTest-665849697 None] Created reservations ['7a56c438-66c2-4d74-9fa6-676d904b58d1', '5c531eee-0076-4452-b6e2-5c5f530b4bb4', 'e6ba8edd-3d3c-4864-aeb3-f4b5b010b83c', 'fc2f4af7-e792-4909-a797-65c06a5cceff'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:52:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-884e9906-5c04-42fe-8dda-2f487fed0f1f tempest-VolumesNegativeTest-665849697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:52:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-884e9906-5c04-42fe-8dda-2f487fed0f1f tempest-VolumesNegativeTest-665849697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:52:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-884e9906-5c04-42fe-8dda-2f487fed0f1f tempest-VolumesNegativeTest-665849697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:52:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-884e9906-5c04-42fe-8dda-2f487fed0f1f tempest-VolumesNegativeTest-665849697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:52:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-884e9906-5c04-42fe-8dda-2f487fed0f1f tempest-VolumesNegativeTest-665849697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:52:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-884e9906-5c04-42fe-8dda-2f487fed0f1f tempest-VolumesNegativeTest-665849697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:52:54 devstack sudo[97324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:52:54 devstack sudo[97324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:52:54 devstack sudo[97324]: pam_unix(sudo:session): session closed for user root Aug 10 12:52:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-884e9906-5c04-42fe-8dda-2f487fed0f1f tempest-VolumesNegativeTest-665849697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.332s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:52:54 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-884e9906-5c04-42fe-8dda-2f487fed0f1f tempest-VolumesNegativeTest-665849697 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:52:54 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-884e9906-5c04-42fe-8dda-2f487fed0f1f tempest-VolumesNegativeTest-665849697 None] Deleted volume successfully. Aug 10 12:52:54 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-884e9906-5c04-42fe-8dda-2f487fed0f1f tempest-VolumesNegativeTest-665849697 None] Lock "cinder-964f899f-f08d-423a-943b-7b2b7163eb05-delete_volume" released by "delete_volume" :: held 1.942s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:52:57 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-963297c7-c3d5-46ed-91e5-6039dd20bc77 tempest-VolumesActionsTest-1354018069 None] Acquiring lock "cinder-56bd5dfe-0cd3-480d-b582-ff9f18544f83" by "attach_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:52:57 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-963297c7-c3d5-46ed-91e5-6039dd20bc77 tempest-VolumesActionsTest-1354018069 None] Lock "cinder-56bd5dfe-0cd3-480d-b582-ff9f18544f83" acquired by "attach_volume" :: waited 0.031s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:52:57 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-963297c7-c3d5-46ed-91e5-6039dd20bc77 tempest-VolumesActionsTest-1354018069 None] Attaching volume 56bd5dfe-0cd3-480d-b582-ff9f18544f83 to instance 0f1fe89c-40e9-4d47-9759-b53dc0d91325 at mountpoint /dev/vdb on host None. Aug 10 12:52:58 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-963297c7-c3d5-46ed-91e5-6039dd20bc77 tempest-VolumesActionsTest-1354018069 None] Attach volume completed successfully. Aug 10 12:52:58 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-963297c7-c3d5-46ed-91e5-6039dd20bc77 tempest-VolumesActionsTest-1354018069 None] Lock "cinder-56bd5dfe-0cd3-480d-b582-ff9f18544f83" released by "attach_volume" :: held 0.160s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:52:58 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-3af80472-b5f5-4f10-b967-eb8f5041b0a9 tempest-VolumesActionsTest-1354018069 None] Acquiring lock "cinder-56bd5dfe-0cd3-480d-b582-ff9f18544f83-detach_volume" by "detach_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:52:58 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-3af80472-b5f5-4f10-b967-eb8f5041b0a9 tempest-VolumesActionsTest-1354018069 None] Lock "cinder-56bd5dfe-0cd3-480d-b582-ff9f18544f83-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:52:58 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-3af80472-b5f5-4f10-b967-eb8f5041b0a9 tempest-VolumesActionsTest-1354018069 None] Detaching volume 56bd5dfe-0cd3-480d-b582-ff9f18544f83 from instance 0f1fe89c-40e9-4d47-9759-b53dc0d91325. Aug 10 12:52:58 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-3af80472-b5f5-4f10-b967-eb8f5041b0a9 tempest-VolumesActionsTest-1354018069 None] Detach volume completed successfully. Aug 10 12:52:58 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-3af80472-b5f5-4f10-b967-eb8f5041b0a9 tempest-VolumesActionsTest-1354018069 None] Lock "cinder-56bd5dfe-0cd3-480d-b582-ff9f18544f83-detach_volume" released by "detach_volume" :: held 0.082s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:52:59 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-c9824fae-c8a3-483d-becd-2844f8b9c16a tempest-GroupsV320Test-407642004 None] Group tempest-GroupsV320Test-Group-489409887: creating Aug 10 12:52:59 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-c9824fae-c8a3-483d-becd-2844f8b9c16a tempest-GroupsV320Test-407642004 None] Group tempest-GroupsV320Test-Group-489409887: created successfully Aug 10 12:52:59 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-c9824fae-c8a3-483d-becd-2844f8b9c16a tempest-GroupsV320Test-407642004 None] Create group completed successfully. Aug 10 12:53:01 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-3a4ecff2-0fb1-4a52-9940-815f08199f2c tempest-GroupsV320Test-407642004 None] Created reservations ['1c4ebefe-1b00-40b8-97db-d818fa47577c'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:53:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3a4ecff2-0fb1-4a52-9940-815f08199f2c tempest-GroupsV320Test-407642004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:53:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3a4ecff2-0fb1-4a52-9940-815f08199f2c tempest-GroupsV320Test-407642004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:53:01 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3a4ecff2-0fb1-4a52-9940-815f08199f2c tempest-GroupsV320Test-407642004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:53:01 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3a4ecff2-0fb1-4a52-9940-815f08199f2c tempest-GroupsV320Test-407642004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:53:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3a4ecff2-0fb1-4a52-9940-815f08199f2c tempest-GroupsV320Test-407642004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:53:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3a4ecff2-0fb1-4a52-9940-815f08199f2c tempest-GroupsV320Test-407642004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:53:01 devstack sudo[97386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:53:01 devstack sudo[97386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:53:01 devstack sudo[97386]: pam_unix(sudo:session): session closed for user root Aug 10 12:53:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3a4ecff2-0fb1-4a52-9940-815f08199f2c tempest-GroupsV320Test-407642004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.284s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:53:01 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-3a4ecff2-0fb1-4a52-9940-815f08199f2c tempest-GroupsV320Test-407642004 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:53:01 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-3a4ecff2-0fb1-4a52-9940-815f08199f2c tempest-GroupsV320Test-407642004 None] Delete group completed successfully. Aug 10 12:53:03 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 12:53:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:53:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:53:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:53:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:53:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:53:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:53:03 devstack sudo[97389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:53:03 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:53:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-fd1aba7f-617e-4df1-a790-79047a49968d tempest-VolumesActionsTest-1354018069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:53:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-fd1aba7f-617e-4df1-a790-79047a49968d tempest-VolumesActionsTest-1354018069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:53:04 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5638c90-952e-4686-970c-d92ba78e489a]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:53:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fd1aba7f-617e-4df1-a790-79047a49968d tempest-VolumesActionsTest-1354018069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:53:04 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root Aug 10 12:53:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.320s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:53:04 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:53:04 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager._thread_info {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 12:53:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread count: 28 {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 12:53:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread info: [<_MainThread(MainThread, started 130607683133568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Aug 10 12:53:04 devstack sudo[97392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83 Aug 10 12:53:04 devstack sudo[97392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:53:04 devstack sudo[97392]: pam_unix(sudo:session): session closed for user root Aug 10 12:53:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fd1aba7f-617e-4df1-a790-79047a49968d tempest-VolumesActionsTest-1354018069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83" returned: 0 in 0.470s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:53:04 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[866adec4-2407-40ea-8a3d-a7b0d9c0b39c]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:53:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fd1aba7f-617e-4df1-a790-79047a49968d tempest-VolumesActionsTest-1354018069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:53:04 devstack sudo[97397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83 Aug 10 12:53:04 devstack sudo[97397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:53:05 devstack sudo[97397]: pam_unix(sudo:session): session closed for user root Aug 10 12:53:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fd1aba7f-617e-4df1-a790-79047a49968d tempest-VolumesActionsTest-1354018069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83" returned: 0 in 0.521s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:53:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fd1aba7f-617e-4df1-a790-79047a49968d tempest-VolumesActionsTest-1354018069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83 /opt/stack/data/cinder/conversion/56bd5dfe-0cd3-480d-b582-ff9f18544f83.temp_image.5f1304ca-569f-4f30-9ea9-68ad63b934d7vhnwxtzl.img {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:53:05 devstack sudo[97407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83 /opt/stack/data/cinder/conversion/56bd5dfe-0cd3-480d-b582-ff9f18544f83.temp_image.5f1304ca-569f-4f30-9ea9-68ad63b934d7vhnwxtzl.img Aug 10 12:53:05 devstack sudo[97407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:53:10 devstack sudo[97407]: pam_unix(sudo:session): session closed for user root Aug 10 12:53:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fd1aba7f-617e-4df1-a790-79047a49968d tempest-VolumesActionsTest-1354018069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83 /opt/stack/data/cinder/conversion/56bd5dfe-0cd3-480d-b582-ff9f18544f83.temp_image.5f1304ca-569f-4f30-9ea9-68ad63b934d7vhnwxtzl.img" returned: 0 in 5.712s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:53:10 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dce3fc8-58e7-4d7a-9fa0-fee9d1774dc8]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:53:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fd1aba7f-617e-4df1-a790-79047a49968d tempest-VolumesActionsTest-1354018069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:53:11 devstack sudo[97424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83 Aug 10 12:53:11 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:53:11 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root Aug 10 12:53:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fd1aba7f-617e-4df1-a790-79047a49968d tempest-VolumesActionsTest-1354018069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83" returned: 0 in 0.737s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:53:11 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-fd1aba7f-617e-4df1-a790-79047a49968d tempest-VolumesActionsTest-1354018069 None] Image conversion details: src /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83, size 1024.00 MB, duration 5.71 sec, destination /opt/stack/data/cinder/conversion/56bd5dfe-0cd3-480d-b582-ff9f18544f83.temp_image.5f1304ca-569f-4f30-9ea9-68ad63b934d7vhnwxtzl.img {{(pid=89096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 12:53:11 devstack cinder-volume[89096]: INFO cinder.image.image_utils [None req-fd1aba7f-617e-4df1-a790-79047a49968d tempest-VolumesActionsTest-1354018069 None] Converted 1024.00 MB image at 179.23 MB/s Aug 10 12:53:11 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-fd1aba7f-617e-4df1-a790-79047a49968d tempest-VolumesActionsTest-1354018069 None] 5f1304ca-569f-4f30-9ea9-68ad63b934d7 was raw, no need to convert to raw {{(pid=89096) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 10 12:53:13 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-79e24016-923e-4a4b-8144-b50b7ec5a712 tempest-VolumeQuotasNegativeTestJSON-41203496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:53:13 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-79e24016-923e-4a4b-8144-b50b7ec5a712 tempest-VolumeQuotasNegativeTestJSON-41203496 None] Flow 'volume_create_manager' (50fa5338-a9c8-4203-9a87-a42449ec8760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:53:14 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-79e24016-923e-4a4b-8144-b50b7ec5a712 tempest-VolumeQuotasNegativeTestJSON-41203496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3642de10-0629-4254-b684-580b29f120d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:53:14 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-79e24016-923e-4a4b-8144-b50b7ec5a712 tempest-VolumeQuotasNegativeTestJSON-41203496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3642de10-0629-4254-b684-580b29f120d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-527713529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fd48138-2e8c-4aab-b4ab-6f12432942ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='569fc799ae684a2caeede1eec49a4514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:53:14Z,use_quota=True,user_id='5cba0b5964e247d8b6ba59d1397fdc4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:53:14 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-79e24016-923e-4a4b-8144-b50b7ec5a712 tempest-VolumeQuotasNegativeTestJSON-41203496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c7b5fe8-f80c-45dc-affa-ab108ae69141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:53:14 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-79e24016-923e-4a4b-8144-b50b7ec5a712 tempest-VolumeQuotasNegativeTestJSON-41203496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c7b5fe8-f80c-45dc-affa-ab108ae69141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:53:14 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-79e24016-923e-4a4b-8144-b50b7ec5a712 tempest-VolumeQuotasNegativeTestJSON-41203496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70527558-d43a-40aa-9dff-23a860d9d062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:53:14 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-79e24016-923e-4a4b-8144-b50b7ec5a712 tempest-VolumeQuotasNegativeTestJSON-41203496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70527558-d43a-40aa-9dff-23a860d9d062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fd48138-2e8c-4aab-b4ab-6f12432942ac', 'volume_name': 'volume-0fd48138-2e8c-4aab-b4ab-6f12432942ac', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:53:14 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-79e24016-923e-4a4b-8144-b50b7ec5a712 tempest-VolumeQuotasNegativeTestJSON-41203496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b30858b-7061-4e6d-bfe0-33d4d9fbe303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:53:14 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-79e24016-923e-4a4b-8144-b50b7ec5a712 tempest-VolumeQuotasNegativeTestJSON-41203496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b30858b-7061-4e6d-bfe0-33d4d9fbe303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:53:14 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-79e24016-923e-4a4b-8144-b50b7ec5a712 tempest-VolumeQuotasNegativeTestJSON-41203496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f404d9ef-cd7a-4268-a50b-0a4870ea3a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:53:14 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-79e24016-923e-4a4b-8144-b50b7ec5a712 tempest-VolumeQuotasNegativeTestJSON-41203496 None] Volume 0fd48138-2e8c-4aab-b4ab-6f12432942ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fd48138-2e8c-4aab-b4ab-6f12432942ac', 'volume_size': 1} Aug 10 12:53:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-79e24016-923e-4a4b-8144-b50b7ec5a712 tempest-VolumeQuotasNegativeTestJSON-41203496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:53:23 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:UPDATE=28,cinder:SELECT=25,cinder:INSERT=4,cinder:DELETE=1 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:53:24 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=26,cinder:INSERT=7,cinder:UPDATE=18,cinder:DELETE=1 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:53:29 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:53:29 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Flow 'volume_create_manager' (7dec78d1-9c7f-4098-886b-d05fa0b777bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:53:29 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd5241f0-9351-47a0-adbc-8820ad31521c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:53:29 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd5241f0-9351-47a0-adbc-8820ad31521c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:53:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2108490016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e44dbc7c-4853-4204-bcab-5395d5e8a4be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0a8d47408c54361834866dac0afb334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:53:29Z,use_quota=True,user_id='32332205a2ed4e3c824e0afa9b8ab8a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:53:29 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb04474e-b32c-4b16-aff9-ca469d72d80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:53:29 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb04474e-b32c-4b16-aff9-ca469d72d80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:53:29 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c598495-3df6-4313-9b3e-70a08bb69990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:53:29 devstack cinder-volume[89096]: DEBUG cinder.image.glance [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Creating Keystone auth plugin from conf {{(pid=89096) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 10 12:53:29 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c598495-3df6-4313-9b3e-70a08bb69990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e44dbc7c-4853-4204-bcab-5395d5e8a4be', 'volume_name': 'volume-e44dbc7c-4853-4204-bcab-5395d5e8a4be', 'volume_size': 1, 'image_id': 'd127b0c1-c6db-4978-8f85-71a25140f15c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d127b0c1-c6db-4978-8f85-71a25140f15c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '84a7884b15744611bf66a9a12c498e2b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd127b0c1-c6db-4978-8f85-71a25140f15c', 'created_at': datetime.datetime(2026, 8, 10, 10, 40, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 10, 40, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d127b0c1-c6db-4978-8f85-71a25140f15c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:53:29 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b986abc-2fc1-4d62-bee2-bba846104b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:53:29 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b986abc-2fc1-4d62-bee2-bba846104b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:53:29 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06b33ff3-c671-4a00-9c65-e747c14e52e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:53:29 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Volume e44dbc7c-4853-4204-bcab-5395d5e8a4be: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e44dbc7c-4853-4204-bcab-5395d5e8a4be', 'volume_size': 1, 'image_id': 'd127b0c1-c6db-4978-8f85-71a25140f15c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d127b0c1-c6db-4978-8f85-71a25140f15c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '84a7884b15744611bf66a9a12c498e2b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd127b0c1-c6db-4978-8f85-71a25140f15c', 'created_at': datetime.datetime(2026, 8, 10, 10, 40, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 10, 40, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d127b0c1-c6db-4978-8f85-71a25140f15c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 10 12:53:29 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Trying to clone e44dbc7c-4853-4204-bcab-5395d5e8a4be from image d127b0c1-c6db-4978-8f85-71a25140f15c at location (None, [{'url': 'file:///opt/stack/data/glance/images/d127b0c1-c6db-4978-8f85-71a25140f15c', 'metadata': {}}]). {{(pid=89096) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 10 12:53:30 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c__ubsd0qmdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89096) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 10 12:53:30 devstack cinder-volume[89096]: INFO cinder.image.image_utils [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Image download 20.69 MB at 20.69 MB/s Aug 10 12:53:30 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abb9159-ae5a-4e82-8a8e-c13cb9bbe470]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:53:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c__ubsd0qmdevstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:53:30 devstack sudo[97468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c__ubsd0qmdevstack@QuobyteHD Aug 10 12:53:30 devstack sudo[97468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:53:30 devstack sudo[97468]: pam_unix(sudo:session): session closed for user root Aug 10 12:53:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c__ubsd0qmdevstack@QuobyteHD" returned: 0 in 0.381s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:53:30 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Temporary image d127b0c1-c6db-4978-8f85-71a25140f15c is fetched for user 32332205a2ed4e3c824e0afa9b8ab8a9. {{(pid=89096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 10 12:53:30 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[3844e9f8-39bb-47b0-b811-af99ee296e48]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:53:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c__ubsd0qmdevstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:53:30 devstack sudo[97473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c__ubsd0qmdevstack@QuobyteHD Aug 10 12:53:30 devstack sudo[97473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:53:30 devstack sudo[97473]: pam_unix(sudo:session): session closed for user root Aug 10 12:53:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c__ubsd0qmdevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:53:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:53:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-fd1aba7f-617e-4df1-a790-79047a49968d tempest-VolumesActionsTest-1354018069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.983s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:53:33 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-fd1aba7f-617e-4df1-a790-79047a49968d tempest-VolumesActionsTest-1354018069 None] Uploaded volume to glance image-id: 5f1304ca-569f-4f30-9ea9-68ad63b934d7. {{(pid=89096) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 10 12:53:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-79e24016-923e-4a4b-8144-b50b7ec5a712 tempest-VolumeQuotasNegativeTestJSON-41203496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.016s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:53:33 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-79e24016-923e-4a4b-8144-b50b7ec5a712 tempest-VolumeQuotasNegativeTestJSON-41203496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-527713529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fd48138-2e8c-4aab-b4ab-6f12432942ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='569fc799ae684a2caeede1eec49a4514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:53:14Z,use_quota=True,user_id='5cba0b5964e247d8b6ba59d1397fdc4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:53:33 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-79e24016-923e-4a4b-8144-b50b7ec5a712 tempest-VolumeQuotasNegativeTestJSON-41203496 None] Creating volume 0fd48138-2e8c-4aab-b4ab-6f12432942ac {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:53:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-79e24016-923e-4a4b-8144-b50b7ec5a712 tempest-VolumeQuotasNegativeTestJSON-41203496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:53:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-79e24016-923e-4a4b-8144-b50b7ec5a712 tempest-VolumeQuotasNegativeTestJSON-41203496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:53:33 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-79e24016-923e-4a4b-8144-b50b7ec5a712 tempest-VolumeQuotasNegativeTestJSON-41203496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:53:33 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-79e24016-923e-4a4b-8144-b50b7ec5a712 tempest-VolumeQuotasNegativeTestJSON-41203496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:53:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-79e24016-923e-4a4b-8144-b50b7ec5a712 tempest-VolumeQuotasNegativeTestJSON-41203496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:53:33 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-79e24016-923e-4a4b-8144-b50b7ec5a712 tempest-VolumeQuotasNegativeTestJSON-41203496 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:53:33 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-79e24016-923e-4a4b-8144-b50b7ec5a712 tempest-VolumeQuotasNegativeTestJSON-41203496 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:53:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-79e24016-923e-4a4b-8144-b50b7ec5a712 tempest-VolumeQuotasNegativeTestJSON-41203496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0fd48138-2e8c-4aab-b4ab-6f12432942ac 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:53:33 devstack sudo[97479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0fd48138-2e8c-4aab-b4ab-6f12432942ac 1073741824 Aug 10 12:53:33 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:53:33 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-fd1aba7f-617e-4df1-a790-79047a49968d tempest-VolumesActionsTest-1354018069 None] Copy volume to image completed successfully. Aug 10 12:53:33 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root Aug 10 12:53:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-79e24016-923e-4a4b-8144-b50b7ec5a712 tempest-VolumeQuotasNegativeTestJSON-41203496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0fd48138-2e8c-4aab-b4ab-6f12432942ac 1073741824" returned: 0 in 0.432s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:53:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-79e24016-923e-4a4b-8144-b50b7ec5a712 tempest-VolumeQuotasNegativeTestJSON-41203496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0fd48138-2e8c-4aab-b4ab-6f12432942ac {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:53:33 devstack sudo[97484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0fd48138-2e8c-4aab-b4ab-6f12432942ac Aug 10 12:53:33 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:53:33 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root Aug 10 12:53:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-79e24016-923e-4a4b-8144-b50b7ec5a712 tempest-VolumeQuotasNegativeTestJSON-41203496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0fd48138-2e8c-4aab-b4ab-6f12432942ac" returned: 0 in 0.251s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:53:33 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-79e24016-923e-4a4b-8144-b50b7ec5a712 tempest-VolumeQuotasNegativeTestJSON-41203496 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:53:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-79e24016-923e-4a4b-8144-b50b7ec5a712 tempest-VolumeQuotasNegativeTestJSON-41203496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:53:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.871s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:53:33 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:53:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2108490016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e44dbc7c-4853-4204-bcab-5395d5e8a4be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0a8d47408c54361834866dac0afb334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:53:29Z,use_quota=True,user_id='32332205a2ed4e3c824e0afa9b8ab8a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:53:33 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Creating volume e44dbc7c-4853-4204-bcab-5395d5e8a4be {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:53:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:53:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:53:33 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:53:33 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:53:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:53:33 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:53:33 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:53:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e44dbc7c-4853-4204-bcab-5395d5e8a4be 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:53:33 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-79e24016-923e-4a4b-8144-b50b7ec5a712 tempest-VolumeQuotasNegativeTestJSON-41203496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f404d9ef-cd7a-4268-a50b-0a4870ea3a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fd48138-2e8c-4aab-b4ab-6f12432942ac', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:53:33 devstack sudo[97487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e44dbc7c-4853-4204-bcab-5395d5e8a4be 1073741824 Aug 10 12:53:33 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-79e24016-923e-4a4b-8144-b50b7ec5a712 tempest-VolumeQuotasNegativeTestJSON-41203496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc014375-c046-4688-913c-6487a99ac086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:53:33 devstack sudo[97487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:53:33 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-79e24016-923e-4a4b-8144-b50b7ec5a712 tempest-VolumeQuotasNegativeTestJSON-41203496 None] Volume volume-0fd48138-2e8c-4aab-b4ab-6f12432942ac (0fd48138-2e8c-4aab-b4ab-6f12432942ac): created successfully Aug 10 12:53:33 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-79e24016-923e-4a4b-8144-b50b7ec5a712 tempest-VolumeQuotasNegativeTestJSON-41203496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc014375-c046-4688-913c-6487a99ac086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:53:33 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-79e24016-923e-4a4b-8144-b50b7ec5a712 tempest-VolumeQuotasNegativeTestJSON-41203496 None] Flow 'volume_create_manager' (50fa5338-a9c8-4203-9a87-a42449ec8760) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:53:33 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-79e24016-923e-4a4b-8144-b50b7ec5a712 tempest-VolumeQuotasNegativeTestJSON-41203496 None] Created volume successfully. Aug 10 12:53:34 devstack sudo[97487]: pam_unix(sudo:session): session closed for user root Aug 10 12:53:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e44dbc7c-4853-4204-bcab-5395d5e8a4be 1073741824" returned: 0 in 0.447s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:53:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e44dbc7c-4853-4204-bcab-5395d5e8a4be {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:53:34 devstack sudo[97493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e44dbc7c-4853-4204-bcab-5395d5e8a4be Aug 10 12:53:34 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:53:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-621f5885-c5f5-484d-a117-a94aa6f8a88c tempest-VolumesActionsTest-1354018069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:53:34 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root Aug 10 12:53:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e44dbc7c-4853-4204-bcab-5395d5e8a4be" returned: 0 in 0.281s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:53:34 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:53:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:53:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-621f5885-c5f5-484d-a117-a94aa6f8a88c tempest-VolumesActionsTest-1354018069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.120s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:53:34 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[736048ed-ff82-4931-a786-826a1b394c9f]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:53:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-621f5885-c5f5-484d-a117-a94aa6f8a88c tempest-VolumesActionsTest-1354018069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:53:34 devstack cinder-volume[89096]: DEBUG cinder.volume.volume_utils [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Attempting download of d127b0c1-c6db-4978-8f85-71a25140f15c ((None, [{'url': 'file:///opt/stack/data/glance/images/d127b0c1-c6db-4978-8f85-71a25140f15c', 'metadata': {}}])) to volume e44dbc7c-4853-4204-bcab-5395d5e8a4be. {{(pid=89096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 10 12:53:34 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca67686-8bc7-4ae0-8859-4cdf3324c568]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:53:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d127b0c1-c6db-4978-8f85-71a25140f15c_p5svyuh9 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:53:34 devstack sudo[97496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83 Aug 10 12:53:34 devstack sudo[97496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:53:34 devstack sudo[97497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d127b0c1-c6db-4978-8f85-71a25140f15c_p5svyuh9 Aug 10 12:53:34 devstack sudo[97497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:53:35 devstack sudo[97496]: pam_unix(sudo:session): session closed for user root Aug 10 12:53:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-621f5885-c5f5-484d-a117-a94aa6f8a88c tempest-VolumesActionsTest-1354018069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83" returned: 0 in 0.428s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:53:35 devstack sudo[97497]: pam_unix(sudo:session): session closed for user root Aug 10 12:53:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d127b0c1-c6db-4978-8f85-71a25140f15c_p5svyuh9" returned: 0 in 0.347s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:53:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d127b0c1-c6db-4978-8f85-71a25140f15c_p5svyuh9 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:53:35 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d070db-5d92-48a5-9373-26ac3d3b82e4]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:53:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-621f5885-c5f5-484d-a117-a94aa6f8a88c tempest-VolumesActionsTest-1354018069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:53:35 devstack sudo[97505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d127b0c1-c6db-4978-8f85-71a25140f15c_p5svyuh9 Aug 10 12:53:35 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:53:35 devstack sudo[97506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83 Aug 10 12:53:35 devstack sudo[97506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:53:35 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root Aug 10 12:53:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d127b0c1-c6db-4978-8f85-71a25140f15c_p5svyuh9" returned: 1 in 0.348s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:53:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d127b0c1-c6db-4978-8f85-71a25140f15c_p5svyuh9' failed. Not Retrying. {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 12:53:35 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96d3330-d831-4450-bf67-03cb040b327d]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:53:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c__ubsd0qmdevstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:53:35 devstack sudo[97506]: pam_unix(sudo:session): session closed for user root Aug 10 12:53:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-621f5885-c5f5-484d-a117-a94aa6f8a88c tempest-VolumesActionsTest-1354018069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83" returned: 0 in 0.456s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:53:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-621f5885-c5f5-484d-a117-a94aa6f8a88c tempest-VolumesActionsTest-1354018069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83 /opt/stack/data/cinder/conversion/56bd5dfe-0cd3-480d-b582-ff9f18544f83.temp_image.8f7357f8-6312-4c12-8a6b-5d82b6b71a682vyf_bc5.img {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:53:35 devstack sudo[97513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c__ubsd0qmdevstack@QuobyteHD Aug 10 12:53:35 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:53:35 devstack sudo[97516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83 /opt/stack/data/cinder/conversion/56bd5dfe-0cd3-480d-b582-ff9f18544f83.temp_image.8f7357f8-6312-4c12-8a6b-5d82b6b71a682vyf_bc5.img Aug 10 12:53:35 devstack sudo[97516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:53:35 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e7027484-017c-4364-ac3e-7d31a2fbaa6f tempest-VolumeQuotasNegativeTestJSON-41203496 None] Acquiring lock "cinder-0fd48138-2e8c-4aab-b4ab-6f12432942ac-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:53:35 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e7027484-017c-4364-ac3e-7d31a2fbaa6f tempest-VolumeQuotasNegativeTestJSON-41203496 None] Lock "cinder-0fd48138-2e8c-4aab-b4ab-6f12432942ac-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:53:35 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e7027484-017c-4364-ac3e-7d31a2fbaa6f tempest-VolumeQuotasNegativeTestJSON-41203496 None] Acquiring lock "cinder-quobyte-0fd48138-2e8c-4aab-b4ab-6f12432942ac" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:53:35 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e7027484-017c-4364-ac3e-7d31a2fbaa6f tempest-VolumeQuotasNegativeTestJSON-41203496 None] Lock "cinder-quobyte-0fd48138-2e8c-4aab-b4ab-6f12432942ac" acquired by "delete_volume" :: waited 0.016s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:53:35 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b5fbc3-4efb-4bcc-bbb5-647c47b7f772]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:53:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e7027484-017c-4364-ac3e-7d31a2fbaa6f tempest-VolumeQuotasNegativeTestJSON-41203496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0fd48138-2e8c-4aab-b4ab-6f12432942ac {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:53:35 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root Aug 10 12:53:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c__ubsd0qmdevstack@QuobyteHD" returned: 0 in 0.399s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:53:35 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] d127b0c1-c6db-4978-8f85-71a25140f15c was qcow2, converting to qcow2 {{(pid=89096) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 10 12:53:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c__ubsd0qmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e44dbc7c-4853-4204-bcab-5395d5e8a4be {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:53:35 devstack sudo[97519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0fd48138-2e8c-4aab-b4ab-6f12432942ac Aug 10 12:53:35 devstack sudo[97519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:53:35 devstack sudo[97526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c__ubsd0qmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e44dbc7c-4853-4204-bcab-5395d5e8a4be Aug 10 12:53:35 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:53:36 devstack sudo[97519]: pam_unix(sudo:session): session closed for user root Aug 10 12:53:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e7027484-017c-4364-ac3e-7d31a2fbaa6f tempest-VolumeQuotasNegativeTestJSON-41203496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0fd48138-2e8c-4aab-b4ab-6f12432942ac" returned: 0 in 0.684s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:53:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e7027484-017c-4364-ac3e-7d31a2fbaa6f tempest-VolumeQuotasNegativeTestJSON-41203496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0fd48138-2e8c-4aab-b4ab-6f12432942ac {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:53:36 devstack sudo[97542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0fd48138-2e8c-4aab-b4ab-6f12432942ac Aug 10 12:53:36 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:53:37 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root Aug 10 12:53:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e7027484-017c-4364-ac3e-7d31a2fbaa6f tempest-VolumeQuotasNegativeTestJSON-41203496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0fd48138-2e8c-4aab-b4ab-6f12432942ac" returned: 0 in 0.714s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:53:37 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e7027484-017c-4364-ac3e-7d31a2fbaa6f tempest-VolumeQuotasNegativeTestJSON-41203496 None] Lock "cinder-quobyte-0fd48138-2e8c-4aab-b4ab-6f12432942ac" released by "delete_volume" :: held 1.471s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:53:37 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-e7027484-017c-4364-ac3e-7d31a2fbaa6f tempest-VolumeQuotasNegativeTestJSON-41203496 None] Created reservations ['349521ab-7c20-49b8-97b3-c99515b17d4d', '94ab4f66-fea0-4b35-8764-359d005a1025', '7c0e68a0-5dfc-4380-bad7-7efe2693dd90', 'da51ca3a-fa75-4604-abaf-48b75a6f94e0'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:53:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e7027484-017c-4364-ac3e-7d31a2fbaa6f tempest-VolumeQuotasNegativeTestJSON-41203496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:53:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e7027484-017c-4364-ac3e-7d31a2fbaa6f tempest-VolumeQuotasNegativeTestJSON-41203496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:53:37 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e7027484-017c-4364-ac3e-7d31a2fbaa6f tempest-VolumeQuotasNegativeTestJSON-41203496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:53:37 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e7027484-017c-4364-ac3e-7d31a2fbaa6f tempest-VolumeQuotasNegativeTestJSON-41203496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:53:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e7027484-017c-4364-ac3e-7d31a2fbaa6f tempest-VolumeQuotasNegativeTestJSON-41203496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:53:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e7027484-017c-4364-ac3e-7d31a2fbaa6f tempest-VolumeQuotasNegativeTestJSON-41203496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:53:37 devstack sudo[97548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:53:37 devstack sudo[97548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:53:38 devstack sudo[97548]: pam_unix(sudo:session): session closed for user root Aug 10 12:53:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e7027484-017c-4364-ac3e-7d31a2fbaa6f tempest-VolumeQuotasNegativeTestJSON-41203496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 1.028s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:53:38 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-e7027484-017c-4364-ac3e-7d31a2fbaa6f tempest-VolumeQuotasNegativeTestJSON-41203496 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:53:38 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-e7027484-017c-4364-ac3e-7d31a2fbaa6f tempest-VolumeQuotasNegativeTestJSON-41203496 None] Deleted volume successfully. Aug 10 12:53:38 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e7027484-017c-4364-ac3e-7d31a2fbaa6f tempest-VolumeQuotasNegativeTestJSON-41203496 None] Lock "cinder-0fd48138-2e8c-4aab-b4ab-6f12432942ac-delete_volume" released by "delete_volume" :: held 2.908s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:53:40 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root Aug 10 12:53:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c__ubsd0qmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e44dbc7c-4853-4204-bcab-5395d5e8a4be" returned: 0 in 4.584s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:53:40 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c__ubsd0qmdevstack@QuobyteHD, size 112.00 MB, duration 4.59 sec, destination /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e44dbc7c-4853-4204-bcab-5395d5e8a4be {{(pid=89096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 12:53:40 devstack cinder-volume[89096]: INFO cinder.image.image_utils [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Converted 112.00 MB image at 24.43 MB/s Aug 10 12:53:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e44dbc7c-4853-4204-bcab-5395d5e8a4be 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:53:40 devstack sudo[97553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e44dbc7c-4853-4204-bcab-5395d5e8a4be 1G Aug 10 12:53:40 devstack sudo[97553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:53:41 devstack sudo[97516]: pam_unix(sudo:session): session closed for user root Aug 10 12:53:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-621f5885-c5f5-484d-a117-a94aa6f8a88c tempest-VolumesActionsTest-1354018069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83 /opt/stack/data/cinder/conversion/56bd5dfe-0cd3-480d-b582-ff9f18544f83.temp_image.8f7357f8-6312-4c12-8a6b-5d82b6b71a682vyf_bc5.img" returned: 0 in 5.509s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:53:41 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c6af60-8032-4004-81f8-226bc50a64e5]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:53:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-621f5885-c5f5-484d-a117-a94aa6f8a88c tempest-VolumesActionsTest-1354018069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:53:41 devstack sudo[97553]: pam_unix(sudo:session): session closed for user root Aug 10 12:53:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e44dbc7c-4853-4204-bcab-5395d5e8a4be 1G" returned: 0 in 0.672s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:53:41 devstack cinder-volume[89096]: DEBUG cinder.volume.volume_utils [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Downloaded image d127b0c1-c6db-4978-8f85-71a25140f15c ((None, [{'url': 'file:///opt/stack/data/glance/images/d127b0c1-c6db-4978-8f85-71a25140f15c', 'metadata': {}}])) to volume e44dbc7c-4853-4204-bcab-5395d5e8a4be successfully. {{(pid=89096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 10 12:53:41 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Temporary image d127b0c1-c6db-4978-8f85-71a25140f15c for user 32332205a2ed4e3c824e0afa9b8ab8a9 is deleted. {{(pid=89096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 10 12:53:41 devstack cinder-volume[89096]: DEBUG cinder.volume.volume_utils [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Marking volume e44dbc7c-4853-4204-bcab-5395d5e8a4be as bootable. {{(pid=89096) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 10 12:53:41 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Copying metadata from image d127b0c1-c6db-4978-8f85-71a25140f15c to e44dbc7c-4853-4204-bcab-5395d5e8a4be. {{(pid=89096) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 10 12:53:41 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Creating volume glance metadata for volume e44dbc7c-4853-4204-bcab-5395d5e8a4be backed by image d127b0c1-c6db-4978-8f85-71a25140f15c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd127b0c1-c6db-4978-8f85-71a25140f15c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89096) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 10 12:53:41 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83 Aug 10 12:53:41 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:53:41 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06b33ff3-c671-4a00-9c65-e747c14e52e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e44dbc7c-4853-4204-bcab-5395d5e8a4be', 'volume_size': 1, 'image_id': 'd127b0c1-c6db-4978-8f85-71a25140f15c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d127b0c1-c6db-4978-8f85-71a25140f15c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '84a7884b15744611bf66a9a12c498e2b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd127b0c1-c6db-4978-8f85-71a25140f15c', 'created_at': datetime.datetime(2026, 8, 10, 10, 40, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 10, 40, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d127b0c1-c6db-4978-8f85-71a25140f15c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:53:41 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c101cd9d-8e24-4e0b-8e49-05d102ef1db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:53:41 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Volume volume-e44dbc7c-4853-4204-bcab-5395d5e8a4be (e44dbc7c-4853-4204-bcab-5395d5e8a4be): created successfully Aug 10 12:53:41 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c101cd9d-8e24-4e0b-8e49-05d102ef1db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:53:41 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Flow 'volume_create_manager' (7dec78d1-9c7f-4098-886b-d05fa0b777bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:53:41 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-219da631-f536-4a8e-b2ff-902522a1905a tempest-TestShelveInstance-772347230 None] Created volume successfully. Aug 10 12:53:41 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Aug 10 12:53:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-621f5885-c5f5-484d-a117-a94aa6f8a88c tempest-VolumesActionsTest-1354018069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83" returned: 0 in 0.659s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:53:41 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-621f5885-c5f5-484d-a117-a94aa6f8a88c tempest-VolumesActionsTest-1354018069 None] Image conversion details: src /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83, size 1024.00 MB, duration 5.51 sec, destination /opt/stack/data/cinder/conversion/56bd5dfe-0cd3-480d-b582-ff9f18544f83.temp_image.8f7357f8-6312-4c12-8a6b-5d82b6b71a682vyf_bc5.img {{(pid=89096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 12:53:41 devstack cinder-volume[89096]: INFO cinder.image.image_utils [None req-621f5885-c5f5-484d-a117-a94aa6f8a88c tempest-VolumesActionsTest-1354018069 None] Converted 1024.00 MB image at 185.84 MB/s Aug 10 12:53:41 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-621f5885-c5f5-484d-a117-a94aa6f8a88c tempest-VolumesActionsTest-1354018069 None] 8f7357f8-6312-4c12-8a6b-5d82b6b71a68 was raw, converting to qcow2 {{(pid=89096) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Aug 10 12:53:41 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2edea64-996a-4d92-a139-1d54a49be8cc]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:53:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-621f5885-c5f5-484d-a117-a94aa6f8a88c tempest-VolumesActionsTest-1354018069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/56bd5dfe-0cd3-480d-b582-ff9f18544f83.temp_image.8f7357f8-6312-4c12-8a6b-5d82b6b71a682vyf_bc5.img {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:53:41 devstack sudo[97566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/56bd5dfe-0cd3-480d-b582-ff9f18544f83.temp_image.8f7357f8-6312-4c12-8a6b-5d82b6b71a682vyf_bc5.img Aug 10 12:53:41 devstack sudo[97566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:53:42 devstack sudo[97566]: pam_unix(sudo:session): session closed for user root Aug 10 12:53:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-621f5885-c5f5-484d-a117-a94aa6f8a88c tempest-VolumesActionsTest-1354018069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/56bd5dfe-0cd3-480d-b582-ff9f18544f83.temp_image.8f7357f8-6312-4c12-8a6b-5d82b6b71a682vyf_bc5.img" returned: 0 in 0.323s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:53:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-621f5885-c5f5-484d-a117-a94aa6f8a88c tempest-VolumesActionsTest-1354018069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/56bd5dfe-0cd3-480d-b582-ff9f18544f83.temp_image.8f7357f8-6312-4c12-8a6b-5d82b6b71a682vyf_bc5.img {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:53:42 devstack sudo[97570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/56bd5dfe-0cd3-480d-b582-ff9f18544f83.temp_image.8f7357f8-6312-4c12-8a6b-5d82b6b71a682vyf_bc5.img Aug 10 12:53:42 devstack sudo[97570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:53:42 devstack sudo[97570]: pam_unix(sudo:session): session closed for user root Aug 10 12:53:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-621f5885-c5f5-484d-a117-a94aa6f8a88c tempest-VolumesActionsTest-1354018069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/56bd5dfe-0cd3-480d-b582-ff9f18544f83.temp_image.8f7357f8-6312-4c12-8a6b-5d82b6b71a682vyf_bc5.img" returned: 1 in 0.369s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:53:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-621f5885-c5f5-484d-a117-a94aa6f8a88c tempest-VolumesActionsTest-1354018069 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/56bd5dfe-0cd3-480d-b582-ff9f18544f83.temp_image.8f7357f8-6312-4c12-8a6b-5d82b6b71a682vyf_bc5.img' failed. Not Retrying. {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 12:53:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-621f5885-c5f5-484d-a117-a94aa6f8a88c tempest-VolumesActionsTest-1354018069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/56bd5dfe-0cd3-480d-b582-ff9f18544f83.temp_image.8f7357f8-6312-4c12-8a6b-5d82b6b71a682vyf_bc5.img /opt/stack/data/cinder/conversion/vol_upload_3saitflt {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:53:42 devstack sudo[97575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/56bd5dfe-0cd3-480d-b582-ff9f18544f83.temp_image.8f7357f8-6312-4c12-8a6b-5d82b6b71a682vyf_bc5.img /opt/stack/data/cinder/conversion/vol_upload_3saitflt Aug 10 12:53:42 devstack sudo[97575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:53:42 devstack sudo[97575]: pam_unix(sudo:session): session closed for user root Aug 10 12:53:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-621f5885-c5f5-484d-a117-a94aa6f8a88c tempest-VolumesActionsTest-1354018069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/56bd5dfe-0cd3-480d-b582-ff9f18544f83.temp_image.8f7357f8-6312-4c12-8a6b-5d82b6b71a682vyf_bc5.img /opt/stack/data/cinder/conversion/vol_upload_3saitflt" returned: 0 in 0.310s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:53:42 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-621f5885-c5f5-484d-a117-a94aa6f8a88c tempest-VolumesActionsTest-1354018069 None] Image conversion details: src /opt/stack/data/cinder/conversion/56bd5dfe-0cd3-480d-b582-ff9f18544f83.temp_image.8f7357f8-6312-4c12-8a6b-5d82b6b71a682vyf_bc5.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_3saitflt {{(pid=89096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 12:53:42 devstack cinder-volume[89096]: INFO cinder.image.image_utils [None req-621f5885-c5f5-484d-a117-a94aa6f8a88c tempest-VolumesActionsTest-1354018069 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 10 12:53:42 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71ce7d2-b6ab-4db4-aaf7-b0d71641802d]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:53:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-621f5885-c5f5-484d-a117-a94aa6f8a88c tempest-VolumesActionsTest-1354018069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_3saitflt {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:53:42 devstack sudo[97587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_3saitflt Aug 10 12:53:42 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:53:43 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root Aug 10 12:53:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-621f5885-c5f5-484d-a117-a94aa6f8a88c tempest-VolumesActionsTest-1354018069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_3saitflt" returned: 0 in 0.356s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:53:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-621f5885-c5f5-484d-a117-a94aa6f8a88c tempest-VolumesActionsTest-1354018069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.311s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:53:44 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-621f5885-c5f5-484d-a117-a94aa6f8a88c tempest-VolumesActionsTest-1354018069 None] Uploaded volume to glance image-id: 8f7357f8-6312-4c12-8a6b-5d82b6b71a68. {{(pid=89096) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 10 12:53:44 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-621f5885-c5f5-484d-a117-a94aa6f8a88c tempest-VolumesActionsTest-1354018069 None] Copy volume to image completed successfully. Aug 10 12:53:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-ddac3c6b-90df-4fde-8d0c-9edd6490fffa req-4a53d7bb-c7f7-45a8-a974-5db69cc18028 tempest-TestShelveInstance-772347230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:53:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-ddac3c6b-90df-4fde-8d0c-9edd6490fffa req-4a53d7bb-c7f7-45a8-a974-5db69cc18028 tempest-TestShelveInstance-772347230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:53:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-ddac3c6b-90df-4fde-8d0c-9edd6490fffa req-4a53d7bb-c7f7-45a8-a974-5db69cc18028 tempest-TestShelveInstance-772347230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:53:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-ddac3c6b-90df-4fde-8d0c-9edd6490fffa req-4a53d7bb-c7f7-45a8-a974-5db69cc18028 tempest-TestShelveInstance-772347230 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d', 'name': 'volume-e44dbc7c-4853-4204-bcab-5395d5e8a4be', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '00d3f30f-e3d5-4743-9639-0b19b3af7e84', 'enforce_multipath': True} {{(pid=89096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Aug 10 12:53:45 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-ddac3c6b-90df-4fde-8d0c-9edd6490fffa req-4a53d7bb-c7f7-45a8-a974-5db69cc18028 tempest-TestShelveInstance-772347230 None] attachment_update completed successfully. Aug 10 12:53:45 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-85bd5e30-8bc6-45c8-9ebf-c58075525fc1 tempest-VolumesActionsTest-1354018069 None] Acquiring lock "cinder-56bd5dfe-0cd3-480d-b582-ff9f18544f83-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:53:45 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-85bd5e30-8bc6-45c8-9ebf-c58075525fc1 tempest-VolumesActionsTest-1354018069 None] Lock "cinder-56bd5dfe-0cd3-480d-b582-ff9f18544f83-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:53:46 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-85bd5e30-8bc6-45c8-9ebf-c58075525fc1 tempest-VolumesActionsTest-1354018069 None] Acquiring lock "cinder-quobyte-56bd5dfe-0cd3-480d-b582-ff9f18544f83" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:53:46 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-85bd5e30-8bc6-45c8-9ebf-c58075525fc1 tempest-VolumesActionsTest-1354018069 None] Lock "cinder-quobyte-56bd5dfe-0cd3-480d-b582-ff9f18544f83" acquired by "delete_volume" :: waited 0.028s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:53:46 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb6eae0-a4c6-4501-9d08-bf818c0c189f]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:53:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-85bd5e30-8bc6-45c8-9ebf-c58075525fc1 tempest-VolumesActionsTest-1354018069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:53:46 devstack sudo[97604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83 Aug 10 12:53:46 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:53:46 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root Aug 10 12:53:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-85bd5e30-8bc6-45c8-9ebf-c58075525fc1 tempest-VolumesActionsTest-1354018069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83" returned: 0 in 0.450s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:53:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-85bd5e30-8bc6-45c8-9ebf-c58075525fc1 tempest-VolumesActionsTest-1354018069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:53:46 devstack sudo[97609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83 Aug 10 12:53:46 devstack sudo[97609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:53:46 devstack sudo[97609]: pam_unix(sudo:session): session closed for user root Aug 10 12:53:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-85bd5e30-8bc6-45c8-9ebf-c58075525fc1 tempest-VolumesActionsTest-1354018069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-56bd5dfe-0cd3-480d-b582-ff9f18544f83" returned: 0 in 0.282s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:53:46 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-85bd5e30-8bc6-45c8-9ebf-c58075525fc1 tempest-VolumesActionsTest-1354018069 None] Lock "cinder-quobyte-56bd5dfe-0cd3-480d-b582-ff9f18544f83" released by "delete_volume" :: held 0.807s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:53:46 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-85bd5e30-8bc6-45c8-9ebf-c58075525fc1 tempest-VolumesActionsTest-1354018069 None] Created reservations ['0fb11605-90cf-4611-80cd-87e954f8feb0', '657fefe9-23c0-4329-90c4-ede350d3592f', '754ba1de-8a76-4e95-ab3d-ff0119c33fbf', '37dc5e9d-6d37-4d0e-8835-a12df9a4590f'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:53:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-85bd5e30-8bc6-45c8-9ebf-c58075525fc1 tempest-VolumesActionsTest-1354018069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:53:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-85bd5e30-8bc6-45c8-9ebf-c58075525fc1 tempest-VolumesActionsTest-1354018069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:53:47 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-85bd5e30-8bc6-45c8-9ebf-c58075525fc1 tempest-VolumesActionsTest-1354018069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:53:47 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-85bd5e30-8bc6-45c8-9ebf-c58075525fc1 tempest-VolumesActionsTest-1354018069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:53:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-85bd5e30-8bc6-45c8-9ebf-c58075525fc1 tempest-VolumesActionsTest-1354018069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:53:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-85bd5e30-8bc6-45c8-9ebf-c58075525fc1 tempest-VolumesActionsTest-1354018069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:53:47 devstack sudo[97612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:53:47 devstack sudo[97612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:53:47 devstack sudo[97612]: pam_unix(sudo:session): session closed for user root Aug 10 12:53:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-85bd5e30-8bc6-45c8-9ebf-c58075525fc1 tempest-VolumesActionsTest-1354018069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.282s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:53:47 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-85bd5e30-8bc6-45c8-9ebf-c58075525fc1 tempest-VolumesActionsTest-1354018069 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:53:47 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-85bd5e30-8bc6-45c8-9ebf-c58075525fc1 tempest-VolumesActionsTest-1354018069 None] Deleted volume successfully. Aug 10 12:53:47 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-85bd5e30-8bc6-45c8-9ebf-c58075525fc1 tempest-VolumesActionsTest-1354018069 None] Lock "cinder-56bd5dfe-0cd3-480d-b582-ff9f18544f83-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:53:54 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9e9ea4c-bbd3-4822-8539-de659d015a9b tempest-VolumesTransfersTest-798943971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:53:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c9e9ea4c-bbd3-4822-8539-de659d015a9b tempest-VolumesTransfersTest-798943971 None] Flow 'volume_create_manager' (420f626b-ed19-4207-a4ca-6a50ed1eb66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:53:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c9e9ea4c-bbd3-4822-8539-de659d015a9b tempest-VolumesTransfersTest-798943971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccb429ea-bdda-479d-8980-24627510c4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:53:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c9e9ea4c-bbd3-4822-8539-de659d015a9b tempest-VolumesTransfersTest-798943971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccb429ea-bdda-479d-8980-24627510c4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-873105613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e3ddb9-9802-4e72-8601-a4b42a168d1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5adddd98f5054c289453cc26f104c895',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:53:54Z,use_quota=True,user_id='238e0bbf91d7422bb6130a3e8c22bfa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:53:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c9e9ea4c-bbd3-4822-8539-de659d015a9b tempest-VolumesTransfersTest-798943971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6e69fcd-c5ef-4d73-9c39-181a53554927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:53:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c9e9ea4c-bbd3-4822-8539-de659d015a9b tempest-VolumesTransfersTest-798943971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6e69fcd-c5ef-4d73-9c39-181a53554927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:53:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c9e9ea4c-bbd3-4822-8539-de659d015a9b tempest-VolumesTransfersTest-798943971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33164788-5ec0-4520-b9f1-325139a62796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:53:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c9e9ea4c-bbd3-4822-8539-de659d015a9b tempest-VolumesTransfersTest-798943971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33164788-5ec0-4520-b9f1-325139a62796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9e3ddb9-9802-4e72-8601-a4b42a168d1e', 'volume_name': 'volume-b9e3ddb9-9802-4e72-8601-a4b42a168d1e', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:53:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c9e9ea4c-bbd3-4822-8539-de659d015a9b tempest-VolumesTransfersTest-798943971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (816d3514-5de5-4ac5-8e06-a4e83f578fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:53:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c9e9ea4c-bbd3-4822-8539-de659d015a9b tempest-VolumesTransfersTest-798943971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (816d3514-5de5-4ac5-8e06-a4e83f578fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:53:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c9e9ea4c-bbd3-4822-8539-de659d015a9b tempest-VolumesTransfersTest-798943971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e18f3c4-1357-4a37-95ab-c7f61a52166c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:53:54 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-c9e9ea4c-bbd3-4822-8539-de659d015a9b tempest-VolumesTransfersTest-798943971 None] Volume b9e3ddb9-9802-4e72-8601-a4b42a168d1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9e3ddb9-9802-4e72-8601-a4b42a168d1e', 'volume_size': 1} Aug 10 12:53:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c9e9ea4c-bbd3-4822-8539-de659d015a9b tempest-VolumesTransfersTest-798943971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:53:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c9e9ea4c-bbd3-4822-8539-de659d015a9b tempest-VolumesTransfersTest-798943971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:53:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c9e9ea4c-bbd3-4822-8539-de659d015a9b tempest-VolumesTransfersTest-798943971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-873105613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e3ddb9-9802-4e72-8601-a4b42a168d1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5adddd98f5054c289453cc26f104c895',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:53:54Z,use_quota=True,user_id='238e0bbf91d7422bb6130a3e8c22bfa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:53:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-c9e9ea4c-bbd3-4822-8539-de659d015a9b tempest-VolumesTransfersTest-798943971 None] Creating volume b9e3ddb9-9802-4e72-8601-a4b42a168d1e {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:53:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c9e9ea4c-bbd3-4822-8539-de659d015a9b tempest-VolumesTransfersTest-798943971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:53:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c9e9ea4c-bbd3-4822-8539-de659d015a9b tempest-VolumesTransfersTest-798943971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:53:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c9e9ea4c-bbd3-4822-8539-de659d015a9b tempest-VolumesTransfersTest-798943971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:53:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c9e9ea4c-bbd3-4822-8539-de659d015a9b tempest-VolumesTransfersTest-798943971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:53:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c9e9ea4c-bbd3-4822-8539-de659d015a9b tempest-VolumesTransfersTest-798943971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:53:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c9e9ea4c-bbd3-4822-8539-de659d015a9b tempest-VolumesTransfersTest-798943971 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:53:54 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-c9e9ea4c-bbd3-4822-8539-de659d015a9b tempest-VolumesTransfersTest-798943971 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:53:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c9e9ea4c-bbd3-4822-8539-de659d015a9b tempest-VolumesTransfersTest-798943971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b9e3ddb9-9802-4e72-8601-a4b42a168d1e 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:53:54 devstack sudo[98080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b9e3ddb9-9802-4e72-8601-a4b42a168d1e 1073741824 Aug 10 12:53:54 devstack sudo[98080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:53:55 devstack sudo[98080]: pam_unix(sudo:session): session closed for user root Aug 10 12:53:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c9e9ea4c-bbd3-4822-8539-de659d015a9b tempest-VolumesTransfersTest-798943971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b9e3ddb9-9802-4e72-8601-a4b42a168d1e 1073741824" returned: 0 in 0.661s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:53:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c9e9ea4c-bbd3-4822-8539-de659d015a9b tempest-VolumesTransfersTest-798943971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b9e3ddb9-9802-4e72-8601-a4b42a168d1e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:53:55 devstack sudo[98086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b9e3ddb9-9802-4e72-8601-a4b42a168d1e Aug 10 12:53:55 devstack sudo[98086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:53:55 devstack sudo[98086]: pam_unix(sudo:session): session closed for user root Aug 10 12:53:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c9e9ea4c-bbd3-4822-8539-de659d015a9b tempest-VolumesTransfersTest-798943971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b9e3ddb9-9802-4e72-8601-a4b42a168d1e" returned: 0 in 0.384s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:53:55 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c9e9ea4c-bbd3-4822-8539-de659d015a9b tempest-VolumesTransfersTest-798943971 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:53:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c9e9ea4c-bbd3-4822-8539-de659d015a9b tempest-VolumesTransfersTest-798943971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:53:55 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c9e9ea4c-bbd3-4822-8539-de659d015a9b tempest-VolumesTransfersTest-798943971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e18f3c4-1357-4a37-95ab-c7f61a52166c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9e3ddb9-9802-4e72-8601-a4b42a168d1e', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:53:55 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c9e9ea4c-bbd3-4822-8539-de659d015a9b tempest-VolumesTransfersTest-798943971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67c9128c-8848-424d-827c-51e2fb9d79b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:53:55 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-c9e9ea4c-bbd3-4822-8539-de659d015a9b tempest-VolumesTransfersTest-798943971 None] Volume volume-b9e3ddb9-9802-4e72-8601-a4b42a168d1e (b9e3ddb9-9802-4e72-8601-a4b42a168d1e): created successfully Aug 10 12:53:55 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c9e9ea4c-bbd3-4822-8539-de659d015a9b tempest-VolumesTransfersTest-798943971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67c9128c-8848-424d-827c-51e2fb9d79b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:53:55 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c9e9ea4c-bbd3-4822-8539-de659d015a9b tempest-VolumesTransfersTest-798943971 None] Flow 'volume_create_manager' (420f626b-ed19-4207-a4ca-6a50ed1eb66d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:53:55 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-c9e9ea4c-bbd3-4822-8539-de659d015a9b tempest-VolumesTransfersTest-798943971 None] Created volume successfully. Aug 10 12:53:57 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-08d2d714-0057-40bd-97ee-05c2d72fe41d tempest-VolumesTransfersTest-472554028 None] Transfer volume completed successfully. Aug 10 12:53:58 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-9336feb6-0c4e-4fec-b9c2-9c3c837765fb tempest-VolumesTransfersTest-1790384186 None] Acquiring lock "cinder-b9e3ddb9-9802-4e72-8601-a4b42a168d1e-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:53:58 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-9336feb6-0c4e-4fec-b9c2-9c3c837765fb tempest-VolumesTransfersTest-1790384186 None] Lock "cinder-b9e3ddb9-9802-4e72-8601-a4b42a168d1e-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:53:58 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-9336feb6-0c4e-4fec-b9c2-9c3c837765fb tempest-VolumesTransfersTest-1790384186 None] Acquiring lock "cinder-quobyte-b9e3ddb9-9802-4e72-8601-a4b42a168d1e" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:53:58 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-9336feb6-0c4e-4fec-b9c2-9c3c837765fb tempest-VolumesTransfersTest-1790384186 None] Lock "cinder-quobyte-b9e3ddb9-9802-4e72-8601-a4b42a168d1e" acquired by "delete_volume" :: waited 0.022s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:53:58 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[f243b40f-cab7-4944-999f-eab4fb94ad48]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:53:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9336feb6-0c4e-4fec-b9c2-9c3c837765fb tempest-VolumesTransfersTest-1790384186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b9e3ddb9-9802-4e72-8601-a4b42a168d1e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:53:58 devstack sudo[98092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b9e3ddb9-9802-4e72-8601-a4b42a168d1e Aug 10 12:53:58 devstack sudo[98092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:53:58 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c5323f6-2de9-475f-8f8f-65c41b9d02c5 tempest-VolumesCloneNegativeTest-753595495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:53:58 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5c5323f6-2de9-475f-8f8f-65c41b9d02c5 tempest-VolumesCloneNegativeTest-753595495 None] Flow 'volume_create_manager' (927d863c-de72-481f-a7ed-cb2efc6d5af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:53:58 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5c5323f6-2de9-475f-8f8f-65c41b9d02c5 tempest-VolumesCloneNegativeTest-753595495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7102dc42-d545-4803-bf44-d63a414c85bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:53:58 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5c5323f6-2de9-475f-8f8f-65c41b9d02c5 tempest-VolumesCloneNegativeTest-753595495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7102dc42-d545-4803-bf44-d63a414c85bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1252825954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35fe7477-da64-4cc2-92d5-72a6321b8e3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0607f4ef78445c2b7e61fa26f1ecdbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:53:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:53:58Z,use_quota=True,user_id='7a1d1c2e8b234e8eb27b137367b75ed9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:53:58 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5c5323f6-2de9-475f-8f8f-65c41b9d02c5 tempest-VolumesCloneNegativeTest-753595495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28e8735a-1113-49f3-bcb8-3c281f58946c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:53:58 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5c5323f6-2de9-475f-8f8f-65c41b9d02c5 tempest-VolumesCloneNegativeTest-753595495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28e8735a-1113-49f3-bcb8-3c281f58946c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:53:58 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5c5323f6-2de9-475f-8f8f-65c41b9d02c5 tempest-VolumesCloneNegativeTest-753595495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e14537-6705-47c4-a09d-bbf3c7f01077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:53:58 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5c5323f6-2de9-475f-8f8f-65c41b9d02c5 tempest-VolumesCloneNegativeTest-753595495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e14537-6705-47c4-a09d-bbf3c7f01077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35fe7477-da64-4cc2-92d5-72a6321b8e3a', 'volume_name': 'volume-35fe7477-da64-4cc2-92d5-72a6321b8e3a', 'volume_size': 2}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:53:58 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5c5323f6-2de9-475f-8f8f-65c41b9d02c5 tempest-VolumesCloneNegativeTest-753595495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0835e964-ed0e-4379-96e2-774bc840fbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:53:58 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5c5323f6-2de9-475f-8f8f-65c41b9d02c5 tempest-VolumesCloneNegativeTest-753595495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0835e964-ed0e-4379-96e2-774bc840fbe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:53:58 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5c5323f6-2de9-475f-8f8f-65c41b9d02c5 tempest-VolumesCloneNegativeTest-753595495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b7f7069-1ef1-48bb-882a-3e2aef73288d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:53:58 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-5c5323f6-2de9-475f-8f8f-65c41b9d02c5 tempest-VolumesCloneNegativeTest-753595495 None] Volume 35fe7477-da64-4cc2-92d5-72a6321b8e3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35fe7477-da64-4cc2-92d5-72a6321b8e3a', 'volume_size': 2} Aug 10 12:53:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5c5323f6-2de9-475f-8f8f-65c41b9d02c5 tempest-VolumesCloneNegativeTest-753595495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:53:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5c5323f6-2de9-475f-8f8f-65c41b9d02c5 tempest-VolumesCloneNegativeTest-753595495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:53:58 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-5c5323f6-2de9-475f-8f8f-65c41b9d02c5 tempest-VolumesCloneNegativeTest-753595495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1252825954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35fe7477-da64-4cc2-92d5-72a6321b8e3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0607f4ef78445c2b7e61fa26f1ecdbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:53:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:53:58Z,use_quota=True,user_id='7a1d1c2e8b234e8eb27b137367b75ed9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:53:58 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-5c5323f6-2de9-475f-8f8f-65c41b9d02c5 tempest-VolumesCloneNegativeTest-753595495 None] Creating volume 35fe7477-da64-4cc2-92d5-72a6321b8e3a {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:53:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5c5323f6-2de9-475f-8f8f-65c41b9d02c5 tempest-VolumesCloneNegativeTest-753595495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:53:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5c5323f6-2de9-475f-8f8f-65c41b9d02c5 tempest-VolumesCloneNegativeTest-753595495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:53:58 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-5c5323f6-2de9-475f-8f8f-65c41b9d02c5 tempest-VolumesCloneNegativeTest-753595495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:53:58 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-5c5323f6-2de9-475f-8f8f-65c41b9d02c5 tempest-VolumesCloneNegativeTest-753595495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:53:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5c5323f6-2de9-475f-8f8f-65c41b9d02c5 tempest-VolumesCloneNegativeTest-753595495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:53:58 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-5c5323f6-2de9-475f-8f8f-65c41b9d02c5 tempest-VolumesCloneNegativeTest-753595495 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:53:58 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-5c5323f6-2de9-475f-8f8f-65c41b9d02c5 tempest-VolumesCloneNegativeTest-753595495 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:53:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5c5323f6-2de9-475f-8f8f-65c41b9d02c5 tempest-VolumesCloneNegativeTest-753595495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-35fe7477-da64-4cc2-92d5-72a6321b8e3a 2147483648 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:53:58 devstack sudo[98096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-35fe7477-da64-4cc2-92d5-72a6321b8e3a 2147483648 Aug 10 12:53:58 devstack sudo[98096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:53:58 devstack sudo[98092]: pam_unix(sudo:session): session closed for user root Aug 10 12:53:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9336feb6-0c4e-4fec-b9c2-9c3c837765fb tempest-VolumesTransfersTest-1790384186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b9e3ddb9-9802-4e72-8601-a4b42a168d1e" returned: 0 in 0.472s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:53:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9336feb6-0c4e-4fec-b9c2-9c3c837765fb tempest-VolumesTransfersTest-1790384186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b9e3ddb9-9802-4e72-8601-a4b42a168d1e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:53:58 devstack sudo[98100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b9e3ddb9-9802-4e72-8601-a4b42a168d1e Aug 10 12:53:58 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:53:59 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root Aug 10 12:53:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9336feb6-0c4e-4fec-b9c2-9c3c837765fb tempest-VolumesTransfersTest-1790384186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b9e3ddb9-9802-4e72-8601-a4b42a168d1e" returned: 0 in 0.276s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:53:59 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-9336feb6-0c4e-4fec-b9c2-9c3c837765fb tempest-VolumesTransfersTest-1790384186 None] Lock "cinder-quobyte-b9e3ddb9-9802-4e72-8601-a4b42a168d1e" released by "delete_volume" :: held 0.814s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:53:59 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-9336feb6-0c4e-4fec-b9c2-9c3c837765fb tempest-VolumesTransfersTest-1790384186 None] Created reservations ['9540daf9-178c-4417-8bef-99cdc8762d12', '1f90f061-0e8c-4303-8efb-58b5ec11bd54', 'a574fd8d-f96f-456e-acff-72ca1e4e3fc9', '98a1e81a-b92a-4d6e-b3cf-28d497a6b4fe'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:53:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9336feb6-0c4e-4fec-b9c2-9c3c837765fb tempest-VolumesTransfersTest-1790384186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:53:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9336feb6-0c4e-4fec-b9c2-9c3c837765fb tempest-VolumesTransfersTest-1790384186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:53:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9336feb6-0c4e-4fec-b9c2-9c3c837765fb tempest-VolumesTransfersTest-1790384186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:53:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9336feb6-0c4e-4fec-b9c2-9c3c837765fb tempest-VolumesTransfersTest-1790384186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:53:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9336feb6-0c4e-4fec-b9c2-9c3c837765fb tempest-VolumesTransfersTest-1790384186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:53:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9336feb6-0c4e-4fec-b9c2-9c3c837765fb tempest-VolumesTransfersTest-1790384186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:53:59 devstack sudo[98096]: pam_unix(sudo:session): session closed for user root Aug 10 12:53:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5c5323f6-2de9-475f-8f8f-65c41b9d02c5 tempest-VolumesCloneNegativeTest-753595495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-35fe7477-da64-4cc2-92d5-72a6321b8e3a 2147483648" returned: 0 in 0.561s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:53:59 devstack sudo[98107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:53:59 devstack sudo[98107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:53:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5c5323f6-2de9-475f-8f8f-65c41b9d02c5 tempest-VolumesCloneNegativeTest-753595495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-35fe7477-da64-4cc2-92d5-72a6321b8e3a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:53:59 devstack sudo[98109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-35fe7477-da64-4cc2-92d5-72a6321b8e3a Aug 10 12:53:59 devstack sudo[98109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:53:59 devstack sudo[98107]: pam_unix(sudo:session): session closed for user root Aug 10 12:53:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9336feb6-0c4e-4fec-b9c2-9c3c837765fb tempest-VolumesTransfersTest-1790384186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.330s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:53:59 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-9336feb6-0c4e-4fec-b9c2-9c3c837765fb tempest-VolumesTransfersTest-1790384186 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:53:59 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-9336feb6-0c4e-4fec-b9c2-9c3c837765fb tempest-VolumesTransfersTest-1790384186 None] Deleted volume successfully. Aug 10 12:53:59 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-9336feb6-0c4e-4fec-b9c2-9c3c837765fb tempest-VolumesTransfersTest-1790384186 None] Lock "cinder-b9e3ddb9-9802-4e72-8601-a4b42a168d1e-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:53:59 devstack sudo[98109]: pam_unix(sudo:session): session closed for user root Aug 10 12:53:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5c5323f6-2de9-475f-8f8f-65c41b9d02c5 tempest-VolumesCloneNegativeTest-753595495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-35fe7477-da64-4cc2-92d5-72a6321b8e3a" returned: 0 in 0.333s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:53:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-5c5323f6-2de9-475f-8f8f-65c41b9d02c5 tempest-VolumesCloneNegativeTest-753595495 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:53:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5c5323f6-2de9-475f-8f8f-65c41b9d02c5 tempest-VolumesCloneNegativeTest-753595495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:53:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5c5323f6-2de9-475f-8f8f-65c41b9d02c5 tempest-VolumesCloneNegativeTest-753595495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b7f7069-1ef1-48bb-882a-3e2aef73288d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35fe7477-da64-4cc2-92d5-72a6321b8e3a', 'volume_size': 2}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:53:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5c5323f6-2de9-475f-8f8f-65c41b9d02c5 tempest-VolumesCloneNegativeTest-753595495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56fb274d-cc03-45cd-b078-14d301abf60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:53:59 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-5c5323f6-2de9-475f-8f8f-65c41b9d02c5 tempest-VolumesCloneNegativeTest-753595495 None] Volume volume-35fe7477-da64-4cc2-92d5-72a6321b8e3a (35fe7477-da64-4cc2-92d5-72a6321b8e3a): created successfully Aug 10 12:53:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5c5323f6-2de9-475f-8f8f-65c41b9d02c5 tempest-VolumesCloneNegativeTest-753595495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56fb274d-cc03-45cd-b078-14d301abf60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:53:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5c5323f6-2de9-475f-8f8f-65c41b9d02c5 tempest-VolumesCloneNegativeTest-753595495 None] Flow 'volume_create_manager' (927d863c-de72-481f-a7ed-cb2efc6d5af9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:53:59 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-5c5323f6-2de9-475f-8f8f-65c41b9d02c5 tempest-VolumesCloneNegativeTest-753595495 None] Created volume successfully. Aug 10 12:54:00 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-702670a8-8c17-488c-b5b5-ea5929d189be tempest-VolumesTransfersTest-798943971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:54:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-702670a8-8c17-488c-b5b5-ea5929d189be tempest-VolumesTransfersTest-798943971 None] Flow 'volume_create_manager' (2b47ae03-cf7e-420e-94ce-17068635f492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:54:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-702670a8-8c17-488c-b5b5-ea5929d189be tempest-VolumesTransfersTest-798943971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (350458d1-00ff-489f-8f44-20c02b4925ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-702670a8-8c17-488c-b5b5-ea5929d189be tempest-VolumesTransfersTest-798943971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (350458d1-00ff-489f-8f44-20c02b4925ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1860554034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=890a55d0-3065-4493-89ca-b566b2ca3d2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5adddd98f5054c289453cc26f104c895',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:54:00Z,use_quota=True,user_id='238e0bbf91d7422bb6130a3e8c22bfa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-702670a8-8c17-488c-b5b5-ea5929d189be tempest-VolumesTransfersTest-798943971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dcefc95-26d0-4134-9eb5-5d75f220f9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-702670a8-8c17-488c-b5b5-ea5929d189be tempest-VolumesTransfersTest-798943971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dcefc95-26d0-4134-9eb5-5d75f220f9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-702670a8-8c17-488c-b5b5-ea5929d189be tempest-VolumesTransfersTest-798943971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28c85f88-02c3-43c9-aab5-55affb470d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-702670a8-8c17-488c-b5b5-ea5929d189be tempest-VolumesTransfersTest-798943971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28c85f88-02c3-43c9-aab5-55affb470d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '890a55d0-3065-4493-89ca-b566b2ca3d2a', 'volume_name': 'volume-890a55d0-3065-4493-89ca-b566b2ca3d2a', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-702670a8-8c17-488c-b5b5-ea5929d189be tempest-VolumesTransfersTest-798943971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e373533-9364-4e03-a8d2-97c021cb0416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-702670a8-8c17-488c-b5b5-ea5929d189be tempest-VolumesTransfersTest-798943971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e373533-9364-4e03-a8d2-97c021cb0416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-702670a8-8c17-488c-b5b5-ea5929d189be tempest-VolumesTransfersTest-798943971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aba9b24a-95df-450e-a832-96c64afd8557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:00 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-702670a8-8c17-488c-b5b5-ea5929d189be tempest-VolumesTransfersTest-798943971 None] Volume 890a55d0-3065-4493-89ca-b566b2ca3d2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-890a55d0-3065-4493-89ca-b566b2ca3d2a', 'volume_size': 1} Aug 10 12:54:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-702670a8-8c17-488c-b5b5-ea5929d189be tempest-VolumesTransfersTest-798943971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:54:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-702670a8-8c17-488c-b5b5-ea5929d189be tempest-VolumesTransfersTest-798943971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:54:00 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-702670a8-8c17-488c-b5b5-ea5929d189be tempest-VolumesTransfersTest-798943971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1860554034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=890a55d0-3065-4493-89ca-b566b2ca3d2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5adddd98f5054c289453cc26f104c895',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:54:00Z,use_quota=True,user_id='238e0bbf91d7422bb6130a3e8c22bfa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:54:00 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-702670a8-8c17-488c-b5b5-ea5929d189be tempest-VolumesTransfersTest-798943971 None] Creating volume 890a55d0-3065-4493-89ca-b566b2ca3d2a {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:54:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-702670a8-8c17-488c-b5b5-ea5929d189be tempest-VolumesTransfersTest-798943971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:54:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-702670a8-8c17-488c-b5b5-ea5929d189be tempest-VolumesTransfersTest-798943971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:54:00 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-702670a8-8c17-488c-b5b5-ea5929d189be tempest-VolumesTransfersTest-798943971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:54:00 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-702670a8-8c17-488c-b5b5-ea5929d189be tempest-VolumesTransfersTest-798943971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:54:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-702670a8-8c17-488c-b5b5-ea5929d189be tempest-VolumesTransfersTest-798943971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:54:00 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-702670a8-8c17-488c-b5b5-ea5929d189be tempest-VolumesTransfersTest-798943971 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:54:00 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-702670a8-8c17-488c-b5b5-ea5929d189be tempest-VolumesTransfersTest-798943971 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:54:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-702670a8-8c17-488c-b5b5-ea5929d189be tempest-VolumesTransfersTest-798943971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-890a55d0-3065-4493-89ca-b566b2ca3d2a 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:00 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-890a55d0-3065-4493-89ca-b566b2ca3d2a 1073741824 Aug 10 12:54:00 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:00 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-702670a8-8c17-488c-b5b5-ea5929d189be tempest-VolumesTransfersTest-798943971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-890a55d0-3065-4493-89ca-b566b2ca3d2a 1073741824" returned: 0 in 0.478s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-702670a8-8c17-488c-b5b5-ea5929d189be tempest-VolumesTransfersTest-798943971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-890a55d0-3065-4493-89ca-b566b2ca3d2a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:00 devstack sudo[98119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-890a55d0-3065-4493-89ca-b566b2ca3d2a Aug 10 12:54:00 devstack sudo[98119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:00 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-573c66fc-fc5c-4047-9d75-c03a8cdb6c71 tempest-VolumesCloneNegativeTest-753595495 None] Acquiring lock "cinder-35fe7477-da64-4cc2-92d5-72a6321b8e3a-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:54:00 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-573c66fc-fc5c-4047-9d75-c03a8cdb6c71 tempest-VolumesCloneNegativeTest-753595495 None] Lock "cinder-35fe7477-da64-4cc2-92d5-72a6321b8e3a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:54:00 devstack sudo[98119]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-702670a8-8c17-488c-b5b5-ea5929d189be tempest-VolumesTransfersTest-798943971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-890a55d0-3065-4493-89ca-b566b2ca3d2a" returned: 0 in 0.304s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:00 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-702670a8-8c17-488c-b5b5-ea5929d189be tempest-VolumesTransfersTest-798943971 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:54:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-702670a8-8c17-488c-b5b5-ea5929d189be tempest-VolumesTransfersTest-798943971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:54:00 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-573c66fc-fc5c-4047-9d75-c03a8cdb6c71 tempest-VolumesCloneNegativeTest-753595495 None] Acquiring lock "cinder-quobyte-35fe7477-da64-4cc2-92d5-72a6321b8e3a" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:54:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-702670a8-8c17-488c-b5b5-ea5929d189be tempest-VolumesTransfersTest-798943971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aba9b24a-95df-450e-a832-96c64afd8557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-890a55d0-3065-4493-89ca-b566b2ca3d2a', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-702670a8-8c17-488c-b5b5-ea5929d189be tempest-VolumesTransfersTest-798943971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86d1564f-0e25-4fd6-a535-e58b4ded9494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:00 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-573c66fc-fc5c-4047-9d75-c03a8cdb6c71 tempest-VolumesCloneNegativeTest-753595495 None] Lock "cinder-quobyte-35fe7477-da64-4cc2-92d5-72a6321b8e3a" acquired by "delete_volume" :: waited 0.054s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:54:01 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-702670a8-8c17-488c-b5b5-ea5929d189be tempest-VolumesTransfersTest-798943971 None] Volume volume-890a55d0-3065-4493-89ca-b566b2ca3d2a (890a55d0-3065-4493-89ca-b566b2ca3d2a): created successfully Aug 10 12:54:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-702670a8-8c17-488c-b5b5-ea5929d189be tempest-VolumesTransfersTest-798943971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86d1564f-0e25-4fd6-a535-e58b4ded9494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-702670a8-8c17-488c-b5b5-ea5929d189be tempest-VolumesTransfersTest-798943971 None] Flow 'volume_create_manager' (2b47ae03-cf7e-420e-94ce-17068635f492) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:54:01 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f5581e-acfb-4f7a-8d19-3e2090070691]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:54:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-573c66fc-fc5c-4047-9d75-c03a8cdb6c71 tempest-VolumesCloneNegativeTest-753595495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-35fe7477-da64-4cc2-92d5-72a6321b8e3a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:01 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-702670a8-8c17-488c-b5b5-ea5929d189be tempest-VolumesTransfersTest-798943971 None] Created volume successfully. Aug 10 12:54:01 devstack sudo[98124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-35fe7477-da64-4cc2-92d5-72a6321b8e3a Aug 10 12:54:01 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:01 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-573c66fc-fc5c-4047-9d75-c03a8cdb6c71 tempest-VolumesCloneNegativeTest-753595495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-35fe7477-da64-4cc2-92d5-72a6321b8e3a" returned: 0 in 0.393s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-573c66fc-fc5c-4047-9d75-c03a8cdb6c71 tempest-VolumesCloneNegativeTest-753595495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-35fe7477-da64-4cc2-92d5-72a6321b8e3a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:01 devstack sudo[98129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-35fe7477-da64-4cc2-92d5-72a6321b8e3a Aug 10 12:54:01 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:01 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-573c66fc-fc5c-4047-9d75-c03a8cdb6c71 tempest-VolumesCloneNegativeTest-753595495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-35fe7477-da64-4cc2-92d5-72a6321b8e3a" returned: 0 in 0.248s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:01 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-573c66fc-fc5c-4047-9d75-c03a8cdb6c71 tempest-VolumesCloneNegativeTest-753595495 None] Lock "cinder-quobyte-35fe7477-da64-4cc2-92d5-72a6321b8e3a" released by "delete_volume" :: held 0.689s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:54:01 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-573c66fc-fc5c-4047-9d75-c03a8cdb6c71 tempest-VolumesCloneNegativeTest-753595495 None] Created reservations ['6aaa9013-3fdd-4b2b-95ee-84e4568e0a8e', 'dddaaca9-3125-4471-a1af-82689f639153', 'bc89f1ab-d56f-443f-80f0-2c409ed486f2', '5fb643cf-bb75-4e8e-b055-664723269a04'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:54:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-573c66fc-fc5c-4047-9d75-c03a8cdb6c71 tempest-VolumesCloneNegativeTest-753595495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:54:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-573c66fc-fc5c-4047-9d75-c03a8cdb6c71 tempest-VolumesCloneNegativeTest-753595495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:54:01 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-573c66fc-fc5c-4047-9d75-c03a8cdb6c71 tempest-VolumesCloneNegativeTest-753595495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:54:01 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-573c66fc-fc5c-4047-9d75-c03a8cdb6c71 tempest-VolumesCloneNegativeTest-753595495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:54:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-573c66fc-fc5c-4047-9d75-c03a8cdb6c71 tempest-VolumesCloneNegativeTest-753595495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:54:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-573c66fc-fc5c-4047-9d75-c03a8cdb6c71 tempest-VolumesCloneNegativeTest-753595495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:01 devstack sudo[98132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:54:01 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:02 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-573c66fc-fc5c-4047-9d75-c03a8cdb6c71 tempest-VolumesCloneNegativeTest-753595495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.324s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:02 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-573c66fc-fc5c-4047-9d75-c03a8cdb6c71 tempest-VolumesCloneNegativeTest-753595495 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:54:02 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-573c66fc-fc5c-4047-9d75-c03a8cdb6c71 tempest-VolumesCloneNegativeTest-753595495 None] Deleted volume successfully. Aug 10 12:54:02 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-573c66fc-fc5c-4047-9d75-c03a8cdb6c71 tempest-VolumesCloneNegativeTest-753595495 None] Lock "cinder-35fe7477-da64-4cc2-92d5-72a6321b8e3a-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:54:02 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-46dc9c1a-7621-4526-8cf6-7d41bd8abe35 tempest-VolumesTransfersTest-1790384186 None] Acquiring lock "cinder-890a55d0-3065-4493-89ca-b566b2ca3d2a-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:54:02 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-46dc9c1a-7621-4526-8cf6-7d41bd8abe35 tempest-VolumesTransfersTest-1790384186 None] Lock "cinder-890a55d0-3065-4493-89ca-b566b2ca3d2a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:54:02 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-46dc9c1a-7621-4526-8cf6-7d41bd8abe35 tempest-VolumesTransfersTest-1790384186 None] Acquiring lock "cinder-quobyte-890a55d0-3065-4493-89ca-b566b2ca3d2a" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:54:02 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-46dc9c1a-7621-4526-8cf6-7d41bd8abe35 tempest-VolumesTransfersTest-1790384186 None] Lock "cinder-quobyte-890a55d0-3065-4493-89ca-b566b2ca3d2a" acquired by "delete_volume" :: waited 0.019s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:54:02 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fa8dcc-ca19-4dae-848f-87c2c0799da2]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:54:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-46dc9c1a-7621-4526-8cf6-7d41bd8abe35 tempest-VolumesTransfersTest-1790384186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-890a55d0-3065-4493-89ca-b566b2ca3d2a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:02 devstack sudo[98135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-890a55d0-3065-4493-89ca-b566b2ca3d2a Aug 10 12:54:02 devstack sudo[98135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:03 devstack sudo[98135]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-46dc9c1a-7621-4526-8cf6-7d41bd8abe35 tempest-VolumesTransfersTest-1790384186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-890a55d0-3065-4493-89ca-b566b2ca3d2a" returned: 0 in 0.413s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-46dc9c1a-7621-4526-8cf6-7d41bd8abe35 tempest-VolumesTransfersTest-1790384186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-890a55d0-3065-4493-89ca-b566b2ca3d2a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:03 devstack sudo[98140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-890a55d0-3065-4493-89ca-b566b2ca3d2a Aug 10 12:54:03 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:03 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-46dc9c1a-7621-4526-8cf6-7d41bd8abe35 tempest-VolumesTransfersTest-1790384186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-890a55d0-3065-4493-89ca-b566b2ca3d2a" returned: 0 in 0.327s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:03 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-46dc9c1a-7621-4526-8cf6-7d41bd8abe35 tempest-VolumesTransfersTest-1790384186 None] Lock "cinder-quobyte-890a55d0-3065-4493-89ca-b566b2ca3d2a" released by "delete_volume" :: held 0.800s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:54:03 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-46dc9c1a-7621-4526-8cf6-7d41bd8abe35 tempest-VolumesTransfersTest-1790384186 None] Created reservations ['b08b0deb-6d1c-4731-8c36-ae1e3c926f1d', 'd4e9ac0c-29b3-4948-afc6-0bd571d4e353', '0d203ac4-3726-4034-9942-05fb21a40ef2', '99551a0e-fa8f-43c7-9641-e70f99228ec2'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:54:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-46dc9c1a-7621-4526-8cf6-7d41bd8abe35 tempest-VolumesTransfersTest-1790384186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:54:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-46dc9c1a-7621-4526-8cf6-7d41bd8abe35 tempest-VolumesTransfersTest-1790384186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:54:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-46dc9c1a-7621-4526-8cf6-7d41bd8abe35 tempest-VolumesTransfersTest-1790384186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:54:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-46dc9c1a-7621-4526-8cf6-7d41bd8abe35 tempest-VolumesTransfersTest-1790384186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:54:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-46dc9c1a-7621-4526-8cf6-7d41bd8abe35 tempest-VolumesTransfersTest-1790384186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:54:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-46dc9c1a-7621-4526-8cf6-7d41bd8abe35 tempest-VolumesTransfersTest-1790384186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:03 devstack sudo[98143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:54:03 devstack sudo[98143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:03 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 12:54:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:54:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:54:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:54:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:54:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:54:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:03 devstack sudo[98143]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-46dc9c1a-7621-4526-8cf6-7d41bd8abe35 tempest-VolumesTransfersTest-1790384186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.360s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:03 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-46dc9c1a-7621-4526-8cf6-7d41bd8abe35 tempest-VolumesTransfersTest-1790384186 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:54:03 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:54:03 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:03 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-46dc9c1a-7621-4526-8cf6-7d41bd8abe35 tempest-VolumesTransfersTest-1790384186 None] Deleted volume successfully. Aug 10 12:54:04 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-46dc9c1a-7621-4526-8cf6-7d41bd8abe35 tempest-VolumesTransfersTest-1790384186 None] Lock "cinder-890a55d0-3065-4493-89ca-b566b2ca3d2a-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:54:04 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.456s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:04 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:54:04 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager._thread_info {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 12:54:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread count: 28 {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 12:54:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread info: [<_MainThread(MainThread, started 130607683133568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Aug 10 12:54:06 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:54:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Flow 'volume_create_manager' (c11495c2-987d-4de4-8f0e-df65709605da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:54:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bdc3c19-12a3-4429-9ae5-4f39f77d0176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bdc3c19-12a3-4429-9ae5-4f39f77d0176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1414277030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=270ff541-c942-42fa-8c81-e6697ba1e420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41a2832c7dc14e70a8a8f704bc28ec29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:54:06Z,use_quota=True,user_id='8199780ff95746cf9e435964eccb5019',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04339ff7-86a8-4ab5-820d-8c2dbd0c9970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04339ff7-86a8-4ab5-820d-8c2dbd0c9970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f8f57cb-b57d-4fd7-8b49-5374f45ed868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:06 devstack cinder-volume[89096]: DEBUG cinder.image.glance [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Creating Keystone auth plugin from conf {{(pid=89096) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 10 12:54:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f8f57cb-b57d-4fd7-8b49-5374f45ed868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '270ff541-c942-42fa-8c81-e6697ba1e420', 'volume_name': 'volume-270ff541-c942-42fa-8c81-e6697ba1e420', 'volume_size': 1, 'image_id': 'd127b0c1-c6db-4978-8f85-71a25140f15c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d127b0c1-c6db-4978-8f85-71a25140f15c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '84a7884b15744611bf66a9a12c498e2b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd127b0c1-c6db-4978-8f85-71a25140f15c', 'created_at': datetime.datetime(2026, 8, 10, 10, 40, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 10, 40, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d127b0c1-c6db-4978-8f85-71a25140f15c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78789686-3748-4577-bc8b-5817b31a28bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78789686-3748-4577-bc8b-5817b31a28bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9ca6c2b-b11a-4a1a-9495-36ec2303a245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:06 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Volume 270ff541-c942-42fa-8c81-e6697ba1e420: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-270ff541-c942-42fa-8c81-e6697ba1e420', 'volume_size': 1, 'image_id': 'd127b0c1-c6db-4978-8f85-71a25140f15c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d127b0c1-c6db-4978-8f85-71a25140f15c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '84a7884b15744611bf66a9a12c498e2b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd127b0c1-c6db-4978-8f85-71a25140f15c', 'created_at': datetime.datetime(2026, 8, 10, 10, 40, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 10, 40, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d127b0c1-c6db-4978-8f85-71a25140f15c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 10 12:54:06 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Trying to clone 270ff541-c942-42fa-8c81-e6697ba1e420 from image d127b0c1-c6db-4978-8f85-71a25140f15c at location (None, [{'url': 'file:///opt/stack/data/glance/images/d127b0c1-c6db-4978-8f85-71a25140f15c', 'metadata': {}}]). {{(pid=89096) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 10 12:54:07 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_lte70_5fdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89096) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 10 12:54:07 devstack cinder-volume[89096]: INFO cinder.image.image_utils [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Image download 20.69 MB at 20.69 MB/s Aug 10 12:54:07 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2541a52-2ba7-49cc-9ea6-5df3d930bc8c]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:54:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_lte70_5fdevstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:07 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_lte70_5fdevstack@QuobyteHD Aug 10 12:54:07 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:07 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_lte70_5fdevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:07 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Temporary image d127b0c1-c6db-4978-8f85-71a25140f15c is fetched for user 8199780ff95746cf9e435964eccb5019. {{(pid=89096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 10 12:54:07 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c30a8f4-cb81-479e-b29c-19730a6fa92f]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:54:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_lte70_5fdevstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:08 devstack sudo[98164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_lte70_5fdevstack@QuobyteHD Aug 10 12:54:08 devstack sudo[98164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:08 devstack sudo[98164]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_lte70_5fdevstack@QuobyteHD" returned: 0 in 0.460s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:54:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:54:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1414277030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=270ff541-c942-42fa-8c81-e6697ba1e420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41a2832c7dc14e70a8a8f704bc28ec29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:54:06Z,use_quota=True,user_id='8199780ff95746cf9e435964eccb5019',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:54:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Creating volume 270ff541-c942-42fa-8c81-e6697ba1e420 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:54:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:54:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:54:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:54:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:54:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:54:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:54:08 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:54:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-270ff541-c942-42fa-8c81-e6697ba1e420 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:08 devstack sudo[98170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-270ff541-c942-42fa-8c81-e6697ba1e420 1073741824 Aug 10 12:54:08 devstack sudo[98170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:08 devstack sudo[98170]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-270ff541-c942-42fa-8c81-e6697ba1e420 1073741824" returned: 0 in 0.579s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-270ff541-c942-42fa-8c81-e6697ba1e420 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:08 devstack sudo[98180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-270ff541-c942-42fa-8c81-e6697ba1e420 Aug 10 12:54:08 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:09 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-270ff541-c942-42fa-8c81-e6697ba1e420" returned: 0 in 0.309s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:54:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:54:09 devstack cinder-volume[89096]: DEBUG cinder.volume.volume_utils [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Attempting download of d127b0c1-c6db-4978-8f85-71a25140f15c ((None, [{'url': 'file:///opt/stack/data/glance/images/d127b0c1-c6db-4978-8f85-71a25140f15c', 'metadata': {}}])) to volume 270ff541-c942-42fa-8c81-e6697ba1e420. {{(pid=89096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 10 12:54:09 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f92defa-cc46-4097-9620-fd910df33aae]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:54:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d127b0c1-c6db-4978-8f85-71a25140f15c_3dhyi945 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:09 devstack sudo[98184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d127b0c1-c6db-4978-8f85-71a25140f15c_3dhyi945 Aug 10 12:54:09 devstack sudo[98184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:09 devstack sudo[98184]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d127b0c1-c6db-4978-8f85-71a25140f15c_3dhyi945" returned: 0 in 0.378s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d127b0c1-c6db-4978-8f85-71a25140f15c_3dhyi945 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:09 devstack sudo[98188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d127b0c1-c6db-4978-8f85-71a25140f15c_3dhyi945 Aug 10 12:54:09 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:10 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d127b0c1-c6db-4978-8f85-71a25140f15c_3dhyi945" returned: 1 in 0.372s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d127b0c1-c6db-4978-8f85-71a25140f15c_3dhyi945' failed. Not Retrying. {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 12:54:10 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[551ae000-3e54-48a4-a1e1-7ea93e779f67]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:54:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_lte70_5fdevstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:10 devstack sudo[98224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_lte70_5fdevstack@QuobyteHD Aug 10 12:54:10 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:10 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_lte70_5fdevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:10 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] d127b0c1-c6db-4978-8f85-71a25140f15c was qcow2, converting to qcow2 {{(pid=89096) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 10 12:54:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_lte70_5fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-270ff541-c942-42fa-8c81-e6697ba1e420 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:10 devstack sudo[98230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_lte70_5fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-270ff541-c942-42fa-8c81-e6697ba1e420 Aug 10 12:54:10 devstack sudo[98230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:10 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-12a2b6a3-3d87-4237-a701-5ca5f3633ce9 tempest-VolumesListTestJSON-944879641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:54:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-12a2b6a3-3d87-4237-a701-5ca5f3633ce9 tempest-VolumesListTestJSON-944879641 None] Flow 'volume_create_manager' (4b21db12-5378-49de-8e0b-5191cdb384ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:54:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-12a2b6a3-3d87-4237-a701-5ca5f3633ce9 tempest-VolumesListTestJSON-944879641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3866434-1a31-47fe-aef3-02516b8a6e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-12a2b6a3-3d87-4237-a701-5ca5f3633ce9 tempest-VolumesListTestJSON-944879641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3866434-1a31-47fe-aef3-02516b8a6e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1827494386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b598b7d0-6fc5-420e-93a1-773c6492c5b3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='32d6f6a70cdf41a09762e28f090b9dcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:54:11Z,use_quota=True,user_id='f5ca38578253415f8b2dbd9a8e3d7049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-12a2b6a3-3d87-4237-a701-5ca5f3633ce9 tempest-VolumesListTestJSON-944879641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b64c45e3-81bd-48e1-9ebd-fbe0044bbae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-12a2b6a3-3d87-4237-a701-5ca5f3633ce9 tempest-VolumesListTestJSON-944879641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b64c45e3-81bd-48e1-9ebd-fbe0044bbae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-12a2b6a3-3d87-4237-a701-5ca5f3633ce9 tempest-VolumesListTestJSON-944879641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (462a5efd-8bd2-4f81-bdc1-b8c24cda38ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-12a2b6a3-3d87-4237-a701-5ca5f3633ce9 tempest-VolumesListTestJSON-944879641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (462a5efd-8bd2-4f81-bdc1-b8c24cda38ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b598b7d0-6fc5-420e-93a1-773c6492c5b3', 'volume_name': 'volume-b598b7d0-6fc5-420e-93a1-773c6492c5b3', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-12a2b6a3-3d87-4237-a701-5ca5f3633ce9 tempest-VolumesListTestJSON-944879641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57f43343-2e76-476b-97c7-0a8ba51a1ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-12a2b6a3-3d87-4237-a701-5ca5f3633ce9 tempest-VolumesListTestJSON-944879641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57f43343-2e76-476b-97c7-0a8ba51a1ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-12a2b6a3-3d87-4237-a701-5ca5f3633ce9 tempest-VolumesListTestJSON-944879641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b66215e8-26d1-45df-96d3-cc4837c78ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:10 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-12a2b6a3-3d87-4237-a701-5ca5f3633ce9 tempest-VolumesListTestJSON-944879641 None] Volume b598b7d0-6fc5-420e-93a1-773c6492c5b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b598b7d0-6fc5-420e-93a1-773c6492c5b3', 'volume_size': 1} Aug 10 12:54:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-12a2b6a3-3d87-4237-a701-5ca5f3633ce9 tempest-VolumesListTestJSON-944879641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:54:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-12a2b6a3-3d87-4237-a701-5ca5f3633ce9 tempest-VolumesListTestJSON-944879641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:54:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-12a2b6a3-3d87-4237-a701-5ca5f3633ce9 tempest-VolumesListTestJSON-944879641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1827494386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b598b7d0-6fc5-420e-93a1-773c6492c5b3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='32d6f6a70cdf41a09762e28f090b9dcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:54:11Z,use_quota=True,user_id='f5ca38578253415f8b2dbd9a8e3d7049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:54:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-12a2b6a3-3d87-4237-a701-5ca5f3633ce9 tempest-VolumesListTestJSON-944879641 None] Creating volume b598b7d0-6fc5-420e-93a1-773c6492c5b3 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:54:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-12a2b6a3-3d87-4237-a701-5ca5f3633ce9 tempest-VolumesListTestJSON-944879641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:54:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-12a2b6a3-3d87-4237-a701-5ca5f3633ce9 tempest-VolumesListTestJSON-944879641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:54:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-12a2b6a3-3d87-4237-a701-5ca5f3633ce9 tempest-VolumesListTestJSON-944879641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:54:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-12a2b6a3-3d87-4237-a701-5ca5f3633ce9 tempest-VolumesListTestJSON-944879641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:54:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-12a2b6a3-3d87-4237-a701-5ca5f3633ce9 tempest-VolumesListTestJSON-944879641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:54:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-12a2b6a3-3d87-4237-a701-5ca5f3633ce9 tempest-VolumesListTestJSON-944879641 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:54:10 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-12a2b6a3-3d87-4237-a701-5ca5f3633ce9 tempest-VolumesListTestJSON-944879641 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:54:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-12a2b6a3-3d87-4237-a701-5ca5f3633ce9 tempest-VolumesListTestJSON-944879641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b598b7d0-6fc5-420e-93a1-773c6492c5b3 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:10 devstack sudo[98235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b598b7d0-6fc5-420e-93a1-773c6492c5b3 1073741824 Aug 10 12:54:10 devstack sudo[98235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:11 devstack sudo[98235]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-12a2b6a3-3d87-4237-a701-5ca5f3633ce9 tempest-VolumesListTestJSON-944879641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b598b7d0-6fc5-420e-93a1-773c6492c5b3 1073741824" returned: 0 in 0.472s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-12a2b6a3-3d87-4237-a701-5ca5f3633ce9 tempest-VolumesListTestJSON-944879641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b598b7d0-6fc5-420e-93a1-773c6492c5b3 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:11 devstack sudo[98244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b598b7d0-6fc5-420e-93a1-773c6492c5b3 Aug 10 12:54:11 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:11 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-12a2b6a3-3d87-4237-a701-5ca5f3633ce9 tempest-VolumesListTestJSON-944879641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b598b7d0-6fc5-420e-93a1-773c6492c5b3" returned: 0 in 0.263s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:11 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-12a2b6a3-3d87-4237-a701-5ca5f3633ce9 tempest-VolumesListTestJSON-944879641 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:54:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-12a2b6a3-3d87-4237-a701-5ca5f3633ce9 tempest-VolumesListTestJSON-944879641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:54:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-12a2b6a3-3d87-4237-a701-5ca5f3633ce9 tempest-VolumesListTestJSON-944879641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b66215e8-26d1-45df-96d3-cc4837c78ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b598b7d0-6fc5-420e-93a1-773c6492c5b3', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-12a2b6a3-3d87-4237-a701-5ca5f3633ce9 tempest-VolumesListTestJSON-944879641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f9fa3c2-510a-44f0-b1db-5d6145ca767a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:11 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-12a2b6a3-3d87-4237-a701-5ca5f3633ce9 tempest-VolumesListTestJSON-944879641 None] Volume volume-b598b7d0-6fc5-420e-93a1-773c6492c5b3 (b598b7d0-6fc5-420e-93a1-773c6492c5b3): created successfully Aug 10 12:54:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-12a2b6a3-3d87-4237-a701-5ca5f3633ce9 tempest-VolumesListTestJSON-944879641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f9fa3c2-510a-44f0-b1db-5d6145ca767a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-12a2b6a3-3d87-4237-a701-5ca5f3633ce9 tempest-VolumesListTestJSON-944879641 None] Flow 'volume_create_manager' (4b21db12-5378-49de-8e0b-5191cdb384ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:54:11 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-12a2b6a3-3d87-4237-a701-5ca5f3633ce9 tempest-VolumesListTestJSON-944879641 None] Created volume successfully. Aug 10 12:54:12 devstack sudo[98230]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_lte70_5fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-270ff541-c942-42fa-8c81-e6697ba1e420" returned: 0 in 1.698s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:12 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_lte70_5fdevstack@QuobyteHD, size 112.00 MB, duration 1.70 sec, destination /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-270ff541-c942-42fa-8c81-e6697ba1e420 {{(pid=89096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 12:54:12 devstack cinder-volume[89096]: INFO cinder.image.image_utils [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Converted 112.00 MB image at 65.91 MB/s Aug 10 12:54:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-270ff541-c942-42fa-8c81-e6697ba1e420 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:12 devstack sudo[98247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-270ff541-c942-42fa-8c81-e6697ba1e420 1G Aug 10 12:54:12 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:12 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-270ff541-c942-42fa-8c81-e6697ba1e420 1G" returned: 0 in 0.310s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:12 devstack cinder-volume[89096]: DEBUG cinder.volume.volume_utils [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Downloaded image d127b0c1-c6db-4978-8f85-71a25140f15c ((None, [{'url': 'file:///opt/stack/data/glance/images/d127b0c1-c6db-4978-8f85-71a25140f15c', 'metadata': {}}])) to volume 270ff541-c942-42fa-8c81-e6697ba1e420 successfully. {{(pid=89096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 10 12:54:12 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Temporary image d127b0c1-c6db-4978-8f85-71a25140f15c for user 8199780ff95746cf9e435964eccb5019 is deleted. {{(pid=89096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 10 12:54:12 devstack cinder-volume[89096]: DEBUG cinder.volume.volume_utils [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Marking volume 270ff541-c942-42fa-8c81-e6697ba1e420 as bootable. {{(pid=89096) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 10 12:54:12 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Copying metadata from image d127b0c1-c6db-4978-8f85-71a25140f15c to 270ff541-c942-42fa-8c81-e6697ba1e420. {{(pid=89096) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 10 12:54:12 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Creating volume glance metadata for volume 270ff541-c942-42fa-8c81-e6697ba1e420 backed by image d127b0c1-c6db-4978-8f85-71a25140f15c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd127b0c1-c6db-4978-8f85-71a25140f15c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89096) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 10 12:54:12 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9ca6c2b-b11a-4a1a-9495-36ec2303a245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-270ff541-c942-42fa-8c81-e6697ba1e420', 'volume_size': 1, 'image_id': 'd127b0c1-c6db-4978-8f85-71a25140f15c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d127b0c1-c6db-4978-8f85-71a25140f15c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '84a7884b15744611bf66a9a12c498e2b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd127b0c1-c6db-4978-8f85-71a25140f15c', 'created_at': datetime.datetime(2026, 8, 10, 10, 40, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 10, 40, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d127b0c1-c6db-4978-8f85-71a25140f15c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:12 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bf2b0c8-0e7f-4958-a4b2-f7df9fc1a80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:12 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Volume volume-270ff541-c942-42fa-8c81-e6697ba1e420 (270ff541-c942-42fa-8c81-e6697ba1e420): created successfully Aug 10 12:54:12 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bf2b0c8-0e7f-4958-a4b2-f7df9fc1a80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:12 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Flow 'volume_create_manager' (c11495c2-987d-4de4-8f0e-df65709605da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:54:12 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-601ad64c-1568-43b6-8ac8-bc92abd12736 tempest-VolumesExtendTest-1845360744 None] Created volume successfully. Aug 10 12:54:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e479b54a-fe31-4450-a023-6ffaa36b2c43 tempest-VolumesExtendTest-1845360744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:54:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e479b54a-fe31-4450-a023-6ffaa36b2c43 tempest-VolumesExtendTest-1845360744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:54:12 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de72910-aaa2-449b-bd99-1b804ea715b9]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:54:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e479b54a-fe31-4450-a023-6ffaa36b2c43 tempest-VolumesExtendTest-1845360744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-270ff541-c942-42fa-8c81-e6697ba1e420 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:13 devstack sudo[98252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-270ff541-c942-42fa-8c81-e6697ba1e420 Aug 10 12:54:13 devstack sudo[98252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:13 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-a27c3259-35fd-479e-810e-c0a19fe040a2 tempest-VolumesListTestJSON-944879641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:54:13 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a27c3259-35fd-479e-810e-c0a19fe040a2 tempest-VolumesListTestJSON-944879641 None] Flow 'volume_create_manager' (a766f857-7c05-4b14-b2c5-83b76326737c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:54:13 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a27c3259-35fd-479e-810e-c0a19fe040a2 tempest-VolumesListTestJSON-944879641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d9f9dc-6244-445a-affb-4fad083ba589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:13 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a27c3259-35fd-479e-810e-c0a19fe040a2 tempest-VolumesListTestJSON-944879641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d9f9dc-6244-445a-affb-4fad083ba589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1099475165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7292de7b-8f1b-4dfb-be90-14c78e96bc99,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='32d6f6a70cdf41a09762e28f090b9dcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:54:13Z,use_quota=True,user_id='f5ca38578253415f8b2dbd9a8e3d7049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:13 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a27c3259-35fd-479e-810e-c0a19fe040a2 tempest-VolumesListTestJSON-944879641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7af45dd8-5f06-46bd-beba-2934079a2ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:13 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a27c3259-35fd-479e-810e-c0a19fe040a2 tempest-VolumesListTestJSON-944879641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7af45dd8-5f06-46bd-beba-2934079a2ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:13 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a27c3259-35fd-479e-810e-c0a19fe040a2 tempest-VolumesListTestJSON-944879641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9046b24-4349-40c0-beaf-26a40ad6a980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:13 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a27c3259-35fd-479e-810e-c0a19fe040a2 tempest-VolumesListTestJSON-944879641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9046b24-4349-40c0-beaf-26a40ad6a980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7292de7b-8f1b-4dfb-be90-14c78e96bc99', 'volume_name': 'volume-7292de7b-8f1b-4dfb-be90-14c78e96bc99', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:13 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a27c3259-35fd-479e-810e-c0a19fe040a2 tempest-VolumesListTestJSON-944879641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a8a19da-7105-4086-9b2c-231837426d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:13 devstack sudo[98252]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:13 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a27c3259-35fd-479e-810e-c0a19fe040a2 tempest-VolumesListTestJSON-944879641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a8a19da-7105-4086-9b2c-231837426d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:13 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a27c3259-35fd-479e-810e-c0a19fe040a2 tempest-VolumesListTestJSON-944879641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cc523b2-455c-46c2-a816-d1026339bbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:13 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-a27c3259-35fd-479e-810e-c0a19fe040a2 tempest-VolumesListTestJSON-944879641 None] Volume 7292de7b-8f1b-4dfb-be90-14c78e96bc99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7292de7b-8f1b-4dfb-be90-14c78e96bc99', 'volume_size': 1} Aug 10 12:54:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a27c3259-35fd-479e-810e-c0a19fe040a2 tempest-VolumesListTestJSON-944879641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:54:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e479b54a-fe31-4450-a023-6ffaa36b2c43 tempest-VolumesExtendTest-1845360744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-270ff541-c942-42fa-8c81-e6697ba1e420" returned: 0 in 0.406s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e479b54a-fe31-4450-a023-6ffaa36b2c43 tempest-VolumesExtendTest-1845360744 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-270ff541-c942-42fa-8c81-e6697ba1e420 2G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e479b54a-fe31-4450-a023-6ffaa36b2c43 tempest-VolumesExtendTest-1845360744 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-270ff541-c942-42fa-8c81-e6697ba1e420 2G" returned: 0 in 0.093s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e479b54a-fe31-4450-a023-6ffaa36b2c43 tempest-VolumesExtendTest-1845360744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.534s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:54:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a27c3259-35fd-479e-810e-c0a19fe040a2 tempest-VolumesListTestJSON-944879641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.103s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:54:13 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a27c3259-35fd-479e-810e-c0a19fe040a2 tempest-VolumesListTestJSON-944879641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1099475165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7292de7b-8f1b-4dfb-be90-14c78e96bc99,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='32d6f6a70cdf41a09762e28f090b9dcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:54:13Z,use_quota=True,user_id='f5ca38578253415f8b2dbd9a8e3d7049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:54:13 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-a27c3259-35fd-479e-810e-c0a19fe040a2 tempest-VolumesListTestJSON-944879641 None] Creating volume 7292de7b-8f1b-4dfb-be90-14c78e96bc99 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:54:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a27c3259-35fd-479e-810e-c0a19fe040a2 tempest-VolumesListTestJSON-944879641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:54:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a27c3259-35fd-479e-810e-c0a19fe040a2 tempest-VolumesListTestJSON-944879641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:54:13 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a27c3259-35fd-479e-810e-c0a19fe040a2 tempest-VolumesListTestJSON-944879641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:54:13 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a27c3259-35fd-479e-810e-c0a19fe040a2 tempest-VolumesListTestJSON-944879641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:54:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a27c3259-35fd-479e-810e-c0a19fe040a2 tempest-VolumesListTestJSON-944879641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:54:13 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a27c3259-35fd-479e-810e-c0a19fe040a2 tempest-VolumesListTestJSON-944879641 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:54:13 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-a27c3259-35fd-479e-810e-c0a19fe040a2 tempest-VolumesListTestJSON-944879641 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:54:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a27c3259-35fd-479e-810e-c0a19fe040a2 tempest-VolumesListTestJSON-944879641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-7292de7b-8f1b-4dfb-be90-14c78e96bc99 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:13 devstack sudo[98261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-7292de7b-8f1b-4dfb-be90-14c78e96bc99 1073741824 Aug 10 12:54:13 devstack sudo[98261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:13 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-e479b54a-fe31-4450-a023-6ffaa36b2c43 tempest-VolumesExtendTest-1845360744 None] Extend volume completed successfully. Aug 10 12:54:13 devstack sudo[98261]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a27c3259-35fd-479e-810e-c0a19fe040a2 tempest-VolumesListTestJSON-944879641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-7292de7b-8f1b-4dfb-be90-14c78e96bc99 1073741824" returned: 0 in 0.408s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a27c3259-35fd-479e-810e-c0a19fe040a2 tempest-VolumesListTestJSON-944879641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-7292de7b-8f1b-4dfb-be90-14c78e96bc99 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:13 devstack sudo[98267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-7292de7b-8f1b-4dfb-be90-14c78e96bc99 Aug 10 12:54:13 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:14 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a27c3259-35fd-479e-810e-c0a19fe040a2 tempest-VolumesListTestJSON-944879641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-7292de7b-8f1b-4dfb-be90-14c78e96bc99" returned: 0 in 0.242s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:14 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a27c3259-35fd-479e-810e-c0a19fe040a2 tempest-VolumesListTestJSON-944879641 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:54:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a27c3259-35fd-479e-810e-c0a19fe040a2 tempest-VolumesListTestJSON-944879641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:54:14 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a27c3259-35fd-479e-810e-c0a19fe040a2 tempest-VolumesListTestJSON-944879641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cc523b2-455c-46c2-a816-d1026339bbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7292de7b-8f1b-4dfb-be90-14c78e96bc99', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:14 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a27c3259-35fd-479e-810e-c0a19fe040a2 tempest-VolumesListTestJSON-944879641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e72c95a6-93ae-470c-b3db-71f8a2b45793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:14 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-a27c3259-35fd-479e-810e-c0a19fe040a2 tempest-VolumesListTestJSON-944879641 None] Volume volume-7292de7b-8f1b-4dfb-be90-14c78e96bc99 (7292de7b-8f1b-4dfb-be90-14c78e96bc99): created successfully Aug 10 12:54:14 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a27c3259-35fd-479e-810e-c0a19fe040a2 tempest-VolumesListTestJSON-944879641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e72c95a6-93ae-470c-b3db-71f8a2b45793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:14 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a27c3259-35fd-479e-810e-c0a19fe040a2 tempest-VolumesListTestJSON-944879641 None] Flow 'volume_create_manager' (a766f857-7c05-4b14-b2c5-83b76326737c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:54:14 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-a27c3259-35fd-479e-810e-c0a19fe040a2 tempest-VolumesListTestJSON-944879641 None] Created volume successfully. Aug 10 12:54:14 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-90798058-962a-424f-8ce1-e0cbf9c58cc1 tempest-VolumesExtendTest-1845360744 None] Acquiring lock "cinder-270ff541-c942-42fa-8c81-e6697ba1e420-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:54:14 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-90798058-962a-424f-8ce1-e0cbf9c58cc1 tempest-VolumesExtendTest-1845360744 None] Lock "cinder-270ff541-c942-42fa-8c81-e6697ba1e420-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:54:14 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-90798058-962a-424f-8ce1-e0cbf9c58cc1 tempest-VolumesExtendTest-1845360744 None] Acquiring lock "cinder-quobyte-270ff541-c942-42fa-8c81-e6697ba1e420" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:54:14 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-90798058-962a-424f-8ce1-e0cbf9c58cc1 tempest-VolumesExtendTest-1845360744 None] Lock "cinder-quobyte-270ff541-c942-42fa-8c81-e6697ba1e420" acquired by "delete_volume" :: waited 0.017s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:54:14 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[543481fa-4c93-4898-afd6-28ae3d1ac2e7]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:54:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-90798058-962a-424f-8ce1-e0cbf9c58cc1 tempest-VolumesExtendTest-1845360744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-270ff541-c942-42fa-8c81-e6697ba1e420 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:14 devstack sudo[98270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-270ff541-c942-42fa-8c81-e6697ba1e420 Aug 10 12:54:14 devstack sudo[98270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:14 devstack sudo[98270]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-90798058-962a-424f-8ce1-e0cbf9c58cc1 tempest-VolumesExtendTest-1845360744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-270ff541-c942-42fa-8c81-e6697ba1e420" returned: 0 in 0.403s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-90798058-962a-424f-8ce1-e0cbf9c58cc1 tempest-VolumesExtendTest-1845360744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-270ff541-c942-42fa-8c81-e6697ba1e420 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:14 devstack sudo[98277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-270ff541-c942-42fa-8c81-e6697ba1e420 Aug 10 12:54:14 devstack sudo[98277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:14 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-98350a6b-f488-4024-8d0c-abb5d1e50bb9 tempest-VolumesListTestJSON-944879641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:54:14 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-98350a6b-f488-4024-8d0c-abb5d1e50bb9 tempest-VolumesListTestJSON-944879641 None] Flow 'volume_create_manager' (0fb10be0-1ac3-4890-bb7f-b0351fc0293f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:54:14 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-98350a6b-f488-4024-8d0c-abb5d1e50bb9 tempest-VolumesListTestJSON-944879641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f328b03-9ef4-4ceb-91ed-85cfa0ad84f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:14 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-98350a6b-f488-4024-8d0c-abb5d1e50bb9 tempest-VolumesListTestJSON-944879641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f328b03-9ef4-4ceb-91ed-85cfa0ad84f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-288027685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=100f4924-b694-44aa-86f5-6b4f0a935f96,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='32d6f6a70cdf41a09762e28f090b9dcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:54:15Z,use_quota=True,user_id='f5ca38578253415f8b2dbd9a8e3d7049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:14 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-98350a6b-f488-4024-8d0c-abb5d1e50bb9 tempest-VolumesListTestJSON-944879641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89035209-c206-474f-adf2-56dc14418fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:14 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-98350a6b-f488-4024-8d0c-abb5d1e50bb9 tempest-VolumesListTestJSON-944879641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89035209-c206-474f-adf2-56dc14418fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:14 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-98350a6b-f488-4024-8d0c-abb5d1e50bb9 tempest-VolumesListTestJSON-944879641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (603ec7fd-2dfc-40a4-99f1-21bddee764e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:14 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-98350a6b-f488-4024-8d0c-abb5d1e50bb9 tempest-VolumesListTestJSON-944879641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (603ec7fd-2dfc-40a4-99f1-21bddee764e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '100f4924-b694-44aa-86f5-6b4f0a935f96', 'volume_name': 'volume-100f4924-b694-44aa-86f5-6b4f0a935f96', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:14 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-98350a6b-f488-4024-8d0c-abb5d1e50bb9 tempest-VolumesListTestJSON-944879641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f669330-756a-43f2-91c4-b40669e4af5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:14 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-98350a6b-f488-4024-8d0c-abb5d1e50bb9 tempest-VolumesListTestJSON-944879641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f669330-756a-43f2-91c4-b40669e4af5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:14 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-98350a6b-f488-4024-8d0c-abb5d1e50bb9 tempest-VolumesListTestJSON-944879641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8201fc85-dea5-46e7-85a2-dc97d8a4f03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:14 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-98350a6b-f488-4024-8d0c-abb5d1e50bb9 tempest-VolumesListTestJSON-944879641 None] Volume 100f4924-b694-44aa-86f5-6b4f0a935f96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-100f4924-b694-44aa-86f5-6b4f0a935f96', 'volume_size': 1} Aug 10 12:54:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-98350a6b-f488-4024-8d0c-abb5d1e50bb9 tempest-VolumesListTestJSON-944879641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:54:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-98350a6b-f488-4024-8d0c-abb5d1e50bb9 tempest-VolumesListTestJSON-944879641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:54:14 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-98350a6b-f488-4024-8d0c-abb5d1e50bb9 tempest-VolumesListTestJSON-944879641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-288027685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=100f4924-b694-44aa-86f5-6b4f0a935f96,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='32d6f6a70cdf41a09762e28f090b9dcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:54:15Z,use_quota=True,user_id='f5ca38578253415f8b2dbd9a8e3d7049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:54:14 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-98350a6b-f488-4024-8d0c-abb5d1e50bb9 tempest-VolumesListTestJSON-944879641 None] Creating volume 100f4924-b694-44aa-86f5-6b4f0a935f96 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:54:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-98350a6b-f488-4024-8d0c-abb5d1e50bb9 tempest-VolumesListTestJSON-944879641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:54:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-98350a6b-f488-4024-8d0c-abb5d1e50bb9 tempest-VolumesListTestJSON-944879641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:54:14 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-98350a6b-f488-4024-8d0c-abb5d1e50bb9 tempest-VolumesListTestJSON-944879641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:54:14 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-98350a6b-f488-4024-8d0c-abb5d1e50bb9 tempest-VolumesListTestJSON-944879641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:54:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-98350a6b-f488-4024-8d0c-abb5d1e50bb9 tempest-VolumesListTestJSON-944879641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:54:14 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-98350a6b-f488-4024-8d0c-abb5d1e50bb9 tempest-VolumesListTestJSON-944879641 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:54:14 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-98350a6b-f488-4024-8d0c-abb5d1e50bb9 tempest-VolumesListTestJSON-944879641 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:54:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-98350a6b-f488-4024-8d0c-abb5d1e50bb9 tempest-VolumesListTestJSON-944879641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-100f4924-b694-44aa-86f5-6b4f0a935f96 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:14 devstack sudo[98279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-100f4924-b694-44aa-86f5-6b4f0a935f96 1073741824 Aug 10 12:54:14 devstack sudo[98279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:14 devstack sudo[98277]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-90798058-962a-424f-8ce1-e0cbf9c58cc1 tempest-VolumesExtendTest-1845360744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-270ff541-c942-42fa-8c81-e6697ba1e420" returned: 0 in 0.262s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-90798058-962a-424f-8ce1-e0cbf9c58cc1 tempest-VolumesExtendTest-1845360744 None] Lock "cinder-quobyte-270ff541-c942-42fa-8c81-e6697ba1e420" released by "delete_volume" :: held 0.704s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-90798058-962a-424f-8ce1-e0cbf9c58cc1 tempest-VolumesExtendTest-1845360744 None] Created reservations ['5d424934-3235-4cf6-bfc7-196fbed88641', '2c1305bd-56c9-4eea-b748-ea9319f31440', 'b3ae8f5b-0e87-4042-9d51-ea2e0ccbb144', 'f11c9bdb-66f9-4ce8-aa49-bd3e2d22154f'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-90798058-962a-424f-8ce1-e0cbf9c58cc1 tempest-VolumesExtendTest-1845360744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-90798058-962a-424f-8ce1-e0cbf9c58cc1 tempest-VolumesExtendTest-1845360744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-90798058-962a-424f-8ce1-e0cbf9c58cc1 tempest-VolumesExtendTest-1845360744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-90798058-962a-424f-8ce1-e0cbf9c58cc1 tempest-VolumesExtendTest-1845360744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-90798058-962a-424f-8ce1-e0cbf9c58cc1 tempest-VolumesExtendTest-1845360744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-90798058-962a-424f-8ce1-e0cbf9c58cc1 tempest-VolumesExtendTest-1845360744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:15 devstack sudo[98284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:54:15 devstack sudo[98284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:15 devstack sudo[98279]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-98350a6b-f488-4024-8d0c-abb5d1e50bb9 tempest-VolumesListTestJSON-944879641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-100f4924-b694-44aa-86f5-6b4f0a935f96 1073741824" returned: 0 in 0.502s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:15 devstack sudo[98284]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-90798058-962a-424f-8ce1-e0cbf9c58cc1 tempest-VolumesExtendTest-1845360744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.287s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-90798058-962a-424f-8ce1-e0cbf9c58cc1 tempest-VolumesExtendTest-1845360744 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:54:15 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-90798058-962a-424f-8ce1-e0cbf9c58cc1 tempest-VolumesExtendTest-1845360744 None] Deleted volume successfully. Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-90798058-962a-424f-8ce1-e0cbf9c58cc1 tempest-VolumesExtendTest-1845360744 None] Lock "cinder-270ff541-c942-42fa-8c81-e6697ba1e420-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-98350a6b-f488-4024-8d0c-abb5d1e50bb9 tempest-VolumesListTestJSON-944879641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-100f4924-b694-44aa-86f5-6b4f0a935f96 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:15 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-100f4924-b694-44aa-86f5-6b4f0a935f96 Aug 10 12:54:15 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:15 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-98350a6b-f488-4024-8d0c-abb5d1e50bb9 tempest-VolumesListTestJSON-944879641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-100f4924-b694-44aa-86f5-6b4f0a935f96" returned: 0 in 0.283s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-98350a6b-f488-4024-8d0c-abb5d1e50bb9 tempest-VolumesListTestJSON-944879641 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-98350a6b-f488-4024-8d0c-abb5d1e50bb9 tempest-VolumesListTestJSON-944879641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-98350a6b-f488-4024-8d0c-abb5d1e50bb9 tempest-VolumesListTestJSON-944879641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8201fc85-dea5-46e7-85a2-dc97d8a4f03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-100f4924-b694-44aa-86f5-6b4f0a935f96', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-98350a6b-f488-4024-8d0c-abb5d1e50bb9 tempest-VolumesListTestJSON-944879641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e63f2d24-1149-4340-964f-1dbf82bf8215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:15 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-98350a6b-f488-4024-8d0c-abb5d1e50bb9 tempest-VolumesListTestJSON-944879641 None] Volume volume-100f4924-b694-44aa-86f5-6b4f0a935f96 (100f4924-b694-44aa-86f5-6b4f0a935f96): created successfully Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-98350a6b-f488-4024-8d0c-abb5d1e50bb9 tempest-VolumesListTestJSON-944879641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e63f2d24-1149-4340-964f-1dbf82bf8215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-98350a6b-f488-4024-8d0c-abb5d1e50bb9 tempest-VolumesListTestJSON-944879641 None] Flow 'volume_create_manager' (0fb10be0-1ac3-4890-bb7f-b0351fc0293f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:54:15 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-98350a6b-f488-4024-8d0c-abb5d1e50bb9 tempest-VolumesListTestJSON-944879641 None] Created volume successfully. Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb118345-6397-4753-8df5-df5f0db04c19 tempest-VolumesExtendTest-1845360744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-cb118345-6397-4753-8df5-df5f0db04c19 tempest-VolumesExtendTest-1845360744 None] Flow 'volume_create_manager' (d1f357fd-57af-4cc4-98a5-910fbb8a13be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-cb118345-6397-4753-8df5-df5f0db04c19 tempest-VolumesExtendTest-1845360744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5b58180-77b2-400f-a1b9-d7c23a93ab83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-cb118345-6397-4753-8df5-df5f0db04c19 tempest-VolumesExtendTest-1845360744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5b58180-77b2-400f-a1b9-d7c23a93ab83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-619055458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51d0e586-3d0a-4936-86ef-9175f1fd02fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41a2832c7dc14e70a8a8f704bc28ec29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:54:16Z,use_quota=True,user_id='8199780ff95746cf9e435964eccb5019',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-cb118345-6397-4753-8df5-df5f0db04c19 tempest-VolumesExtendTest-1845360744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de1a651c-2b6c-4e92-84a3-fcbe50796d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-cb118345-6397-4753-8df5-df5f0db04c19 tempest-VolumesExtendTest-1845360744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de1a651c-2b6c-4e92-84a3-fcbe50796d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-cb118345-6397-4753-8df5-df5f0db04c19 tempest-VolumesExtendTest-1845360744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c47a5f11-f9e1-491a-a33c-418d49f9f258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-cb118345-6397-4753-8df5-df5f0db04c19 tempest-VolumesExtendTest-1845360744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c47a5f11-f9e1-491a-a33c-418d49f9f258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51d0e586-3d0a-4936-86ef-9175f1fd02fe', 'volume_name': 'volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-cb118345-6397-4753-8df5-df5f0db04c19 tempest-VolumesExtendTest-1845360744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df5f05d5-57c8-42c8-956d-6cb814b012b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-cb118345-6397-4753-8df5-df5f0db04c19 tempest-VolumesExtendTest-1845360744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df5f05d5-57c8-42c8-956d-6cb814b012b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-cb118345-6397-4753-8df5-df5f0db04c19 tempest-VolumesExtendTest-1845360744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a90d6c47-7423-4474-bf2c-76e2f2636e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:15 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-cb118345-6397-4753-8df5-df5f0db04c19 tempest-VolumesExtendTest-1845360744 None] Volume 51d0e586-3d0a-4936-86ef-9175f1fd02fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe', 'volume_size': 1} Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-cb118345-6397-4753-8df5-df5f0db04c19 tempest-VolumesExtendTest-1845360744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-cb118345-6397-4753-8df5-df5f0db04c19 tempest-VolumesExtendTest-1845360744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-cb118345-6397-4753-8df5-df5f0db04c19 tempest-VolumesExtendTest-1845360744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-619055458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51d0e586-3d0a-4936-86ef-9175f1fd02fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41a2832c7dc14e70a8a8f704bc28ec29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:54:16Z,use_quota=True,user_id='8199780ff95746cf9e435964eccb5019',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-cb118345-6397-4753-8df5-df5f0db04c19 tempest-VolumesExtendTest-1845360744 None] Creating volume 51d0e586-3d0a-4936-86ef-9175f1fd02fe {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-cb118345-6397-4753-8df5-df5f0db04c19 tempest-VolumesExtendTest-1845360744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-cb118345-6397-4753-8df5-df5f0db04c19 tempest-VolumesExtendTest-1845360744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-cb118345-6397-4753-8df5-df5f0db04c19 tempest-VolumesExtendTest-1845360744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-cb118345-6397-4753-8df5-df5f0db04c19 tempest-VolumesExtendTest-1845360744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-cb118345-6397-4753-8df5-df5f0db04c19 tempest-VolumesExtendTest-1845360744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-cb118345-6397-4753-8df5-df5f0db04c19 tempest-VolumesExtendTest-1845360744 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:54:15 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-cb118345-6397-4753-8df5-df5f0db04c19 tempest-VolumesExtendTest-1845360744 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:54:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-cb118345-6397-4753-8df5-df5f0db04c19 tempest-VolumesExtendTest-1845360744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:16 devstack sudo[98291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe 1073741824 Aug 10 12:54:16 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:16 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-cb118345-6397-4753-8df5-df5f0db04c19 tempest-VolumesExtendTest-1845360744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe 1073741824" returned: 0 in 0.429s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-cb118345-6397-4753-8df5-df5f0db04c19 tempest-VolumesExtendTest-1845360744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:16 devstack sudo[98297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe Aug 10 12:54:16 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:16 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-cb118345-6397-4753-8df5-df5f0db04c19 tempest-VolumesExtendTest-1845360744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe" returned: 0 in 0.273s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:16 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-cb118345-6397-4753-8df5-df5f0db04c19 tempest-VolumesExtendTest-1845360744 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:54:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-cb118345-6397-4753-8df5-df5f0db04c19 tempest-VolumesExtendTest-1845360744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:54:16 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-cb118345-6397-4753-8df5-df5f0db04c19 tempest-VolumesExtendTest-1845360744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a90d6c47-7423-4474-bf2c-76e2f2636e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:16 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-cb118345-6397-4753-8df5-df5f0db04c19 tempest-VolumesExtendTest-1845360744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6723f8d-4097-40c2-8b70-5cc98dcf51b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:16 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-cb118345-6397-4753-8df5-df5f0db04c19 tempest-VolumesExtendTest-1845360744 None] Volume volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe (51d0e586-3d0a-4936-86ef-9175f1fd02fe): created successfully Aug 10 12:54:16 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-cb118345-6397-4753-8df5-df5f0db04c19 tempest-VolumesExtendTest-1845360744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6723f8d-4097-40c2-8b70-5cc98dcf51b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:16 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-cb118345-6397-4753-8df5-df5f0db04c19 tempest-VolumesExtendTest-1845360744 None] Flow 'volume_create_manager' (d1f357fd-57af-4cc4-98a5-910fbb8a13be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:54:16 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-cb118345-6397-4753-8df5-df5f0db04c19 tempest-VolumesExtendTest-1845360744 None] Created volume successfully. Aug 10 12:54:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2f5c7643-9c37-4a15-a84a-39ce4e507191 tempest-VolumesExtendTest-1845360744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:54:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2f5c7643-9c37-4a15-a84a-39ce4e507191 tempest-VolumesExtendTest-1845360744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:54:17 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-2f5c7643-9c37-4a15-a84a-39ce4e507191 tempest-VolumesExtendTest-1845360744 None] Creating offline snapshot 19391fe9-7f9f-41d6-b129-483b48b9a38e of volume 51d0e586-3d0a-4936-86ef-9175f1fd02fe {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 12:54:17 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b76bed-e508-4048-9877-bf978f7b6db2]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:54:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2f5c7643-9c37-4a15-a84a-39ce4e507191 tempest-VolumesExtendTest-1845360744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:17 devstack sudo[98300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe Aug 10 12:54:17 devstack sudo[98300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:17 devstack sudo[98300]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2f5c7643-9c37-4a15-a84a-39ce4e507191 tempest-VolumesExtendTest-1845360744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe" returned: 0 in 0.433s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2f5c7643-9c37-4a15-a84a-39ce4e507191 tempest-VolumesExtendTest-1845360744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe.19391fe9-7f9f-41d6-b129-483b48b9a38e 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:17 devstack sudo[98305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe.19391fe9-7f9f-41d6-b129-483b48b9a38e 1G Aug 10 12:54:17 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:18 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2f5c7643-9c37-4a15-a84a-39ce4e507191 tempest-VolumesExtendTest-1845360744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe.19391fe9-7f9f-41d6-b129-483b48b9a38e 1G" returned: 0 in 0.455s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2f5c7643-9c37-4a15-a84a-39ce4e507191 tempest-VolumesExtendTest-1845360744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe.19391fe9-7f9f-41d6-b129-483b48b9a38e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:18 devstack sudo[98312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe.19391fe9-7f9f-41d6-b129-483b48b9a38e Aug 10 12:54:18 devstack sudo[98312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:18 devstack sudo[98312]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2f5c7643-9c37-4a15-a84a-39ce4e507191 tempest-VolumesExtendTest-1845360744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe.19391fe9-7f9f-41d6-b129-483b48b9a38e" returned: 0 in 0.318s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:18 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-2f5c7643-9c37-4a15-a84a-39ce4e507191 tempest-VolumesExtendTest-1845360744 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe.19391fe9-7f9f-41d6-b129-483b48b9a38e is being set with open permissions: ugo+rw Aug 10 12:54:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2f5c7643-9c37-4a15-a84a-39ce4e507191 tempest-VolumesExtendTest-1845360744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe.19391fe9-7f9f-41d6-b129-483b48b9a38e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:18 devstack sudo[98322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe.19391fe9-7f9f-41d6-b129-483b48b9a38e Aug 10 12:54:18 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:18 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2f5c7643-9c37-4a15-a84a-39ce4e507191 tempest-VolumesExtendTest-1845360744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe.19391fe9-7f9f-41d6-b129-483b48b9a38e" returned: 0 in 0.283s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2f5c7643-9c37-4a15-a84a-39ce4e507191 tempest-VolumesExtendTest-1845360744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:18 devstack sudo[98325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe.info Aug 10 12:54:18 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:19 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2f5c7643-9c37-4a15-a84a-39ce4e507191 tempest-VolumesExtendTest-1845360744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe.info" returned: 0 in 0.302s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:19 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-2f5c7643-9c37-4a15-a84a-39ce4e507191 tempest-VolumesExtendTest-1845360744 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe.info is being set with open permissions: ugo+rw Aug 10 12:54:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2f5c7643-9c37-4a15-a84a-39ce4e507191 tempest-VolumesExtendTest-1845360744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:19 devstack sudo[98328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe.info Aug 10 12:54:19 devstack sudo[98328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:19 devstack sudo[98328]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2f5c7643-9c37-4a15-a84a-39ce4e507191 tempest-VolumesExtendTest-1845360744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe.info" returned: 0 in 0.264s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2f5c7643-9c37-4a15-a84a-39ce4e507191 tempest-VolumesExtendTest-1845360744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.173s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:54:19 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-2f5c7643-9c37-4a15-a84a-39ce4e507191 tempest-VolumesExtendTest-1845360744 None] Create snapshot completed successfully Aug 10 12:54:19 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-9c3cbaf3-d1f0-433d-bf7b-ea1f80b71321 tempest-VolumesListTestJSON-944879641 None] Acquiring lock "cinder-100f4924-b694-44aa-86f5-6b4f0a935f96-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:54:19 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-9c3cbaf3-d1f0-433d-bf7b-ea1f80b71321 tempest-VolumesListTestJSON-944879641 None] Lock "cinder-100f4924-b694-44aa-86f5-6b4f0a935f96-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:54:19 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-9c3cbaf3-d1f0-433d-bf7b-ea1f80b71321 tempest-VolumesListTestJSON-944879641 None] Acquiring lock "cinder-quobyte-100f4924-b694-44aa-86f5-6b4f0a935f96" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:54:19 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-9c3cbaf3-d1f0-433d-bf7b-ea1f80b71321 tempest-VolumesListTestJSON-944879641 None] Lock "cinder-quobyte-100f4924-b694-44aa-86f5-6b4f0a935f96" acquired by "delete_volume" :: waited 0.013s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:54:19 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1560a47-c7db-4189-bc0a-bb76d6c72045]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:54:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9c3cbaf3-d1f0-433d-bf7b-ea1f80b71321 tempest-VolumesListTestJSON-944879641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-100f4924-b694-44aa-86f5-6b4f0a935f96 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:19 devstack sudo[98332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-100f4924-b694-44aa-86f5-6b4f0a935f96 Aug 10 12:54:19 devstack sudo[98332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:20 devstack sudo[98332]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9c3cbaf3-d1f0-433d-bf7b-ea1f80b71321 tempest-VolumesListTestJSON-944879641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-100f4924-b694-44aa-86f5-6b4f0a935f96" returned: 0 in 0.376s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9c3cbaf3-d1f0-433d-bf7b-ea1f80b71321 tempest-VolumesListTestJSON-944879641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-100f4924-b694-44aa-86f5-6b4f0a935f96 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:20 devstack sudo[98342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-100f4924-b694-44aa-86f5-6b4f0a935f96 Aug 10 12:54:20 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:20 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9c3cbaf3-d1f0-433d-bf7b-ea1f80b71321 tempest-VolumesListTestJSON-944879641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-100f4924-b694-44aa-86f5-6b4f0a935f96" returned: 0 in 0.293s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:20 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-9c3cbaf3-d1f0-433d-bf7b-ea1f80b71321 tempest-VolumesListTestJSON-944879641 None] Lock "cinder-quobyte-100f4924-b694-44aa-86f5-6b4f0a935f96" released by "delete_volume" :: held 0.715s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:54:20 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-9c3cbaf3-d1f0-433d-bf7b-ea1f80b71321 tempest-VolumesListTestJSON-944879641 None] Created reservations ['b649966e-eef8-4abf-8ff0-2b43f7c0f5e4', 'a4b3e6a1-49e9-4a5a-8b34-5500cce6b6c8', 'f3523a6f-9765-4f8b-8c39-d65d4c99bbcb', 'bc10d655-178e-47d2-a57b-d4da2dce8375'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:54:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a46b6172-4b3f-4a1c-8a5b-5f2ef643a04c tempest-VolumesExtendTest-1845360744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:54:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a46b6172-4b3f-4a1c-8a5b-5f2ef643a04c tempest-VolumesExtendTest-1845360744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:54:20 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c789d03b-804d-49ff-80a9-8a1e58eeb39b]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:54:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a46b6172-4b3f-4a1c-8a5b-5f2ef643a04c tempest-VolumesExtendTest-1845360744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9c3cbaf3-d1f0-433d-bf7b-ea1f80b71321 tempest-VolumesListTestJSON-944879641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:54:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9c3cbaf3-d1f0-433d-bf7b-ea1f80b71321 tempest-VolumesListTestJSON-944879641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:54:20 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9c3cbaf3-d1f0-433d-bf7b-ea1f80b71321 tempest-VolumesListTestJSON-944879641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:54:20 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9c3cbaf3-d1f0-433d-bf7b-ea1f80b71321 tempest-VolumesListTestJSON-944879641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:54:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9c3cbaf3-d1f0-433d-bf7b-ea1f80b71321 tempest-VolumesListTestJSON-944879641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:54:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9c3cbaf3-d1f0-433d-bf7b-ea1f80b71321 tempest-VolumesListTestJSON-944879641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:20 devstack sudo[98349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:54:20 devstack sudo[98349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:20 devstack sudo[98347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe Aug 10 12:54:20 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:20 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d0f9f079-06e2-416e-8d46-b79834821e14 tempest-VolumesListTestJSON-944879641 None] Acquiring lock "cinder-7292de7b-8f1b-4dfb-be90-14c78e96bc99-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:54:20 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d0f9f079-06e2-416e-8d46-b79834821e14 tempest-VolumesListTestJSON-944879641 None] Lock "cinder-7292de7b-8f1b-4dfb-be90-14c78e96bc99-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:54:20 devstack sudo[98349]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9c3cbaf3-d1f0-433d-bf7b-ea1f80b71321 tempest-VolumesListTestJSON-944879641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.333s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:20 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-9c3cbaf3-d1f0-433d-bf7b-ea1f80b71321 tempest-VolumesListTestJSON-944879641 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:54:20 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-9c3cbaf3-d1f0-433d-bf7b-ea1f80b71321 tempest-VolumesListTestJSON-944879641 None] Deleted volume successfully. Aug 10 12:54:20 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d0f9f079-06e2-416e-8d46-b79834821e14 tempest-VolumesListTestJSON-944879641 None] Acquiring lock "cinder-quobyte-7292de7b-8f1b-4dfb-be90-14c78e96bc99" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:54:20 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-9c3cbaf3-d1f0-433d-bf7b-ea1f80b71321 tempest-VolumesListTestJSON-944879641 None] Lock "cinder-100f4924-b694-44aa-86f5-6b4f0a935f96-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:54:20 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d0f9f079-06e2-416e-8d46-b79834821e14 tempest-VolumesListTestJSON-944879641 None] Lock "cinder-quobyte-7292de7b-8f1b-4dfb-be90-14c78e96bc99" acquired by "delete_volume" :: waited 0.020s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:54:20 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[2434ea56-0cae-42c8-a4d2-34ba65889c42]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:54:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d0f9f079-06e2-416e-8d46-b79834821e14 tempest-VolumesListTestJSON-944879641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-7292de7b-8f1b-4dfb-be90-14c78e96bc99 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:20 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a46b6172-4b3f-4a1c-8a5b-5f2ef643a04c tempest-VolumesExtendTest-1845360744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe" returned: 0 in 0.477s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a46b6172-4b3f-4a1c-8a5b-5f2ef643a04c tempest-VolumesExtendTest-1845360744 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe.19391fe9-7f9f-41d6-b129-483b48b9a38e 2G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:21 devstack sudo[98362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-7292de7b-8f1b-4dfb-be90-14c78e96bc99 Aug 10 12:54:21 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a46b6172-4b3f-4a1c-8a5b-5f2ef643a04c tempest-VolumesExtendTest-1845360744 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe.19391fe9-7f9f-41d6-b129-483b48b9a38e 2G" returned: 0 in 0.144s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a46b6172-4b3f-4a1c-8a5b-5f2ef643a04c tempest-VolumesExtendTest-1845360744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.679s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:54:21 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-a46b6172-4b3f-4a1c-8a5b-5f2ef643a04c tempest-VolumesExtendTest-1845360744 None] Extend volume completed successfully. Aug 10 12:54:21 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d0f9f079-06e2-416e-8d46-b79834821e14 tempest-VolumesListTestJSON-944879641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-7292de7b-8f1b-4dfb-be90-14c78e96bc99" returned: 0 in 0.387s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d0f9f079-06e2-416e-8d46-b79834821e14 tempest-VolumesListTestJSON-944879641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-7292de7b-8f1b-4dfb-be90-14c78e96bc99 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:21 devstack sudo[98371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-7292de7b-8f1b-4dfb-be90-14c78e96bc99 Aug 10 12:54:21 devstack sudo[98371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:21 devstack sudo[98371]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d0f9f079-06e2-416e-8d46-b79834821e14 tempest-VolumesListTestJSON-944879641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-7292de7b-8f1b-4dfb-be90-14c78e96bc99" returned: 0 in 0.267s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:21 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d0f9f079-06e2-416e-8d46-b79834821e14 tempest-VolumesListTestJSON-944879641 None] Lock "cinder-quobyte-7292de7b-8f1b-4dfb-be90-14c78e96bc99" released by "delete_volume" :: held 0.710s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:54:21 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-d0f9f079-06e2-416e-8d46-b79834821e14 tempest-VolumesListTestJSON-944879641 None] Created reservations ['e8d54b19-39a4-44a2-9551-1e54a399b8de', '00f536bd-be62-4004-b55a-2a87313cf5b4', '74767864-46ab-4614-bb31-05b371183a38', 'f1921f32-e2a9-498b-8460-3d9f72fc2e00'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:54:21 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-9cb6812e-0863-42d6-b671-a78c97b715a9 tempest-VolumesExtendTest-1845360744 None] Acquiring lock "cinder-19391fe9-7f9f-41d6-b129-483b48b9a38e-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:54:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d0f9f079-06e2-416e-8d46-b79834821e14 tempest-VolumesListTestJSON-944879641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:54:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d0f9f079-06e2-416e-8d46-b79834821e14 tempest-VolumesListTestJSON-944879641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:54:21 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-d0f9f079-06e2-416e-8d46-b79834821e14 tempest-VolumesListTestJSON-944879641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:54:21 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-d0f9f079-06e2-416e-8d46-b79834821e14 tempest-VolumesListTestJSON-944879641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:54:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d0f9f079-06e2-416e-8d46-b79834821e14 tempest-VolumesListTestJSON-944879641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:54:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d0f9f079-06e2-416e-8d46-b79834821e14 tempest-VolumesListTestJSON-944879641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:21 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-9cb6812e-0863-42d6-b671-a78c97b715a9 tempest-VolumesExtendTest-1845360744 None] Lock "cinder-19391fe9-7f9f-41d6-b129-483b48b9a38e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:54:21 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-9cb6812e-0863-42d6-b671-a78c97b715a9 tempest-VolumesExtendTest-1845360744 None] Acquiring lock "cinder-quobyte-51d0e586-3d0a-4936-86ef-9175f1fd02fe" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:54:21 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-9cb6812e-0863-42d6-b671-a78c97b715a9 tempest-VolumesExtendTest-1845360744 None] Lock "cinder-quobyte-51d0e586-3d0a-4936-86ef-9175f1fd02fe" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:54:21 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-9cb6812e-0863-42d6-b671-a78c97b715a9 tempest-VolumesExtendTest-1845360744 None] Acquiring lock "cinder-quobyte-19391fe9-7f9f-41d6-b129-483b48b9a38e" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:54:21 devstack sudo[98374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:54:21 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:21 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-9cb6812e-0863-42d6-b671-a78c97b715a9 tempest-VolumesExtendTest-1845360744 None] Lock "cinder-quobyte-19391fe9-7f9f-41d6-b129-483b48b9a38e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:54:21 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-9cb6812e-0863-42d6-b671-a78c97b715a9 tempest-VolumesExtendTest-1845360744 None] Deleting offline snapshot 19391fe9-7f9f-41d6-b129-483b48b9a38e of volume 51d0e586-3d0a-4936-86ef-9175f1fd02fe {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 12:54:21 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-9cb6812e-0863-42d6-b671-a78c97b715a9 tempest-VolumesExtendTest-1845360744 None] snapshot_file for this snap is: volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe.19391fe9-7f9f-41d6-b129-483b48b9a38e {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 12:54:21 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cd038e-2bef-4433-aa7a-64bb924d2e58]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:54:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9cb6812e-0863-42d6-b671-a78c97b715a9 tempest-VolumesExtendTest-1845360744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe.19391fe9-7f9f-41d6-b129-483b48b9a38e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:22 devstack sudo[98376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe.19391fe9-7f9f-41d6-b129-483b48b9a38e Aug 10 12:54:22 devstack sudo[98376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:22 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8d64782d-66be-4bc1-8f3f-b9487a02fbb9 tempest-VolumesListTestJSON-944879641 None] Acquiring lock "cinder-b598b7d0-6fc5-420e-93a1-773c6492c5b3-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:54:22 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d0f9f079-06e2-416e-8d46-b79834821e14 tempest-VolumesListTestJSON-944879641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.368s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:22 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-d0f9f079-06e2-416e-8d46-b79834821e14 tempest-VolumesListTestJSON-944879641 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:54:22 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-d0f9f079-06e2-416e-8d46-b79834821e14 tempest-VolumesListTestJSON-944879641 None] Deleted volume successfully. Aug 10 12:54:22 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8d64782d-66be-4bc1-8f3f-b9487a02fbb9 tempest-VolumesListTestJSON-944879641 None] Lock "cinder-b598b7d0-6fc5-420e-93a1-773c6492c5b3-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:54:22 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d0f9f079-06e2-416e-8d46-b79834821e14 tempest-VolumesListTestJSON-944879641 None] Lock "cinder-7292de7b-8f1b-4dfb-be90-14c78e96bc99-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:54:22 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8d64782d-66be-4bc1-8f3f-b9487a02fbb9 tempest-VolumesListTestJSON-944879641 None] Acquiring lock "cinder-quobyte-b598b7d0-6fc5-420e-93a1-773c6492c5b3" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:54:22 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8d64782d-66be-4bc1-8f3f-b9487a02fbb9 tempest-VolumesListTestJSON-944879641 None] Lock "cinder-quobyte-b598b7d0-6fc5-420e-93a1-773c6492c5b3" acquired by "delete_volume" :: waited 0.015s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:54:22 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[755bd346-b2b8-4007-9c53-3d25cd380962]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:54:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8d64782d-66be-4bc1-8f3f-b9487a02fbb9 tempest-VolumesListTestJSON-944879641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b598b7d0-6fc5-420e-93a1-773c6492c5b3 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:22 devstack sudo[98376]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9cb6812e-0863-42d6-b671-a78c97b715a9 tempest-VolumesExtendTest-1845360744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe.19391fe9-7f9f-41d6-b129-483b48b9a38e" returned: 0 in 0.564s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:22 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-9cb6812e-0863-42d6-b671-a78c97b715a9 tempest-VolumesExtendTest-1845360744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 12:54:22 devstack sudo[98383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b598b7d0-6fc5-420e-93a1-773c6492c5b3 Aug 10 12:54:22 devstack sudo[98383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:22 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c3c9be-4d78-4c80-984a-5fba96dfe2d2]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:54:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9cb6812e-0863-42d6-b671-a78c97b715a9 tempest-VolumesExtendTest-1845360744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:22 devstack sudo[98399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe Aug 10 12:54:22 devstack sudo[98399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:22 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-68c57d80-080f-40be-8006-f0032915e9f0 req-16414a36-91fb-4797-9a69-aa6abdc2f987 tempest-TestShelveInstance-772347230 None] Terminate volume connection completed successfully. Aug 10 12:54:22 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-68c57d80-080f-40be-8006-f0032915e9f0 req-16414a36-91fb-4797-9a69-aa6abdc2f987 tempest-TestShelveInstance-772347230 None] Deleting attachment 00d3f30f-e3d5-4743-9639-0b19b3af7e84. {{(pid=89096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Aug 10 12:54:22 devstack sudo[98383]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8d64782d-66be-4bc1-8f3f-b9487a02fbb9 tempest-VolumesListTestJSON-944879641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b598b7d0-6fc5-420e-93a1-773c6492c5b3" returned: 0 in 0.610s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8d64782d-66be-4bc1-8f3f-b9487a02fbb9 tempest-VolumesListTestJSON-944879641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b598b7d0-6fc5-420e-93a1-773c6492c5b3 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:22 devstack sudo[98408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b598b7d0-6fc5-420e-93a1-773c6492c5b3 Aug 10 12:54:22 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:23 devstack sudo[98399]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9cb6812e-0863-42d6-b671-a78c97b715a9 tempest-VolumesExtendTest-1845360744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe" returned: 0 in 0.494s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9cb6812e-0863-42d6-b671-a78c97b715a9 tempest-VolumesExtendTest-1845360744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe.19391fe9-7f9f-41d6-b129-483b48b9a38e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:23 devstack sudo[98413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe.19391fe9-7f9f-41d6-b129-483b48b9a38e Aug 10 12:54:23 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:23 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8d64782d-66be-4bc1-8f3f-b9487a02fbb9 tempest-VolumesListTestJSON-944879641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b598b7d0-6fc5-420e-93a1-773c6492c5b3" returned: 0 in 0.449s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:23 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8d64782d-66be-4bc1-8f3f-b9487a02fbb9 tempest-VolumesListTestJSON-944879641 None] Lock "cinder-quobyte-b598b7d0-6fc5-420e-93a1-773c6492c5b3" released by "delete_volume" :: held 1.105s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:54:23 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-8d64782d-66be-4bc1-8f3f-b9487a02fbb9 tempest-VolumesListTestJSON-944879641 None] Created reservations ['3dcad6ef-79d8-48f0-a634-448fb88ce77d', 'da26bd32-a04b-4284-9ee7-e159440a4c81', 'deadf0a8-e6b9-4781-b7c8-317345bbdf93', '93a9c9f8-f6d6-46c2-a470-8e147087044c'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:54:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8d64782d-66be-4bc1-8f3f-b9487a02fbb9 tempest-VolumesListTestJSON-944879641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:54:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8d64782d-66be-4bc1-8f3f-b9487a02fbb9 tempest-VolumesListTestJSON-944879641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:54:23 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8d64782d-66be-4bc1-8f3f-b9487a02fbb9 tempest-VolumesListTestJSON-944879641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:54:23 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8d64782d-66be-4bc1-8f3f-b9487a02fbb9 tempest-VolumesListTestJSON-944879641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:54:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8d64782d-66be-4bc1-8f3f-b9487a02fbb9 tempest-VolumesListTestJSON-944879641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:54:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8d64782d-66be-4bc1-8f3f-b9487a02fbb9 tempest-VolumesListTestJSON-944879641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:23 devstack sudo[98456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:54:23 devstack sudo[98456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:23 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9cb6812e-0863-42d6-b671-a78c97b715a9 tempest-VolumesExtendTest-1845360744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe.19391fe9-7f9f-41d6-b129-483b48b9a38e" returned: 0 in 0.578s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9cb6812e-0863-42d6-b671-a78c97b715a9 tempest-VolumesExtendTest-1845360744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe.19391fe9-7f9f-41d6-b129-483b48b9a38e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:23 devstack sudo[98458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe.19391fe9-7f9f-41d6-b129-483b48b9a38e Aug 10 12:54:23 devstack sudo[98458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:23 devstack sudo[98456]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8d64782d-66be-4bc1-8f3f-b9487a02fbb9 tempest-VolumesListTestJSON-944879641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.280s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:23 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-8d64782d-66be-4bc1-8f3f-b9487a02fbb9 tempest-VolumesListTestJSON-944879641 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:54:23 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-8d64782d-66be-4bc1-8f3f-b9487a02fbb9 tempest-VolumesListTestJSON-944879641 None] Deleted volume successfully. Aug 10 12:54:23 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8d64782d-66be-4bc1-8f3f-b9487a02fbb9 tempest-VolumesListTestJSON-944879641 None] Lock "cinder-b598b7d0-6fc5-420e-93a1-773c6492c5b3-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:54:23 devstack sudo[98458]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9cb6812e-0863-42d6-b671-a78c97b715a9 tempest-VolumesExtendTest-1845360744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe.19391fe9-7f9f-41d6-b129-483b48b9a38e" returned: 0 in 0.259s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:23 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-9cb6812e-0863-42d6-b671-a78c97b715a9 tempest-VolumesExtendTest-1845360744 None] Lock "cinder-quobyte-19391fe9-7f9f-41d6-b129-483b48b9a38e" released by "_delete_snapshot" :: held 2.087s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:54:23 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-9cb6812e-0863-42d6-b671-a78c97b715a9 tempest-VolumesExtendTest-1845360744 None] Lock "cinder-quobyte-51d0e586-3d0a-4936-86ef-9175f1fd02fe" released by "delete_snapshot" :: held 2.116s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:54:24 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-9cb6812e-0863-42d6-b671-a78c97b715a9 tempest-VolumesExtendTest-1845360744 None] Created reservations ['63b37428-40c7-4c42-af73-92f609bccd06', 'e3416f03-07c8-4cdc-bf0a-a28c96a5a2ab', '8c5eaefa-0cb2-433a-8cc2-09dc536e9b7f', '9934f3bc-b05f-4873-b0bb-cecca99879d8'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:54:24 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=102,cinder:UPDATE=116,cinder:INSERT=42,cinder:DELETE=9 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:54:24 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:UPDATE=117,cinder:INSERT=35,cinder:SELECT=101,cinder:DELETE=11 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:54:24 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-9cb6812e-0863-42d6-b671-a78c97b715a9 tempest-VolumesExtendTest-1845360744 None] Delete snapshot completed successfully. Aug 10 12:54:24 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-9cb6812e-0863-42d6-b671-a78c97b715a9 tempest-VolumesExtendTest-1845360744 None] Lock "cinder-19391fe9-7f9f-41d6-b129-483b48b9a38e-delete_snapshot" released by "delete_snapshot" :: held 2.265s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:54:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5c975d8f-6347-4389-824e-fdf98021d9c8 tempest-VolumesExtendTest-1845360744 None] Acquiring lock "cinder-51d0e586-3d0a-4936-86ef-9175f1fd02fe-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:54:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5c975d8f-6347-4389-824e-fdf98021d9c8 tempest-VolumesExtendTest-1845360744 None] Lock "cinder-51d0e586-3d0a-4936-86ef-9175f1fd02fe-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:54:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5c975d8f-6347-4389-824e-fdf98021d9c8 tempest-VolumesExtendTest-1845360744 None] Acquiring lock "cinder-quobyte-51d0e586-3d0a-4936-86ef-9175f1fd02fe" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:54:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5c975d8f-6347-4389-824e-fdf98021d9c8 tempest-VolumesExtendTest-1845360744 None] Lock "cinder-quobyte-51d0e586-3d0a-4936-86ef-9175f1fd02fe" acquired by "delete_volume" :: waited 0.024s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:54:25 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b19f3c0-1295-4deb-98d9-6f982343834e]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:54:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5c975d8f-6347-4389-824e-fdf98021d9c8 tempest-VolumesExtendTest-1845360744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:25 devstack sudo[98463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe Aug 10 12:54:25 devstack sudo[98463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:25 devstack sudo[98463]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5c975d8f-6347-4389-824e-fdf98021d9c8 tempest-VolumesExtendTest-1845360744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe" returned: 0 in 0.451s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5c975d8f-6347-4389-824e-fdf98021d9c8 tempest-VolumesExtendTest-1845360744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:25 devstack sudo[98470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe Aug 10 12:54:25 devstack sudo[98470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:25 devstack sudo[98470]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5c975d8f-6347-4389-824e-fdf98021d9c8 tempest-VolumesExtendTest-1845360744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51d0e586-3d0a-4936-86ef-9175f1fd02fe" returned: 0 in 0.256s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:26 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5c975d8f-6347-4389-824e-fdf98021d9c8 tempest-VolumesExtendTest-1845360744 None] Lock "cinder-quobyte-51d0e586-3d0a-4936-86ef-9175f1fd02fe" released by "delete_volume" :: held 0.786s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:54:26 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-5c975d8f-6347-4389-824e-fdf98021d9c8 tempest-VolumesExtendTest-1845360744 None] Created reservations ['1ea9a17b-b0c4-41fb-944c-514e583f4f42', '36da4376-82d1-46a5-ab78-22d5884f7d38', '5179a585-79b4-418a-93ba-33d6209d9bab', '5ce29816-6f72-49db-9049-3ff325cead55'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:54:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5c975d8f-6347-4389-824e-fdf98021d9c8 tempest-VolumesExtendTest-1845360744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:54:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5c975d8f-6347-4389-824e-fdf98021d9c8 tempest-VolumesExtendTest-1845360744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:54:26 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-5c975d8f-6347-4389-824e-fdf98021d9c8 tempest-VolumesExtendTest-1845360744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:54:26 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-5c975d8f-6347-4389-824e-fdf98021d9c8 tempest-VolumesExtendTest-1845360744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:54:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5c975d8f-6347-4389-824e-fdf98021d9c8 tempest-VolumesExtendTest-1845360744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:54:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5c975d8f-6347-4389-824e-fdf98021d9c8 tempest-VolumesExtendTest-1845360744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:26 devstack sudo[98474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:54:26 devstack sudo[98474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:26 devstack sudo[98474]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5c975d8f-6347-4389-824e-fdf98021d9c8 tempest-VolumesExtendTest-1845360744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.314s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:26 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-5c975d8f-6347-4389-824e-fdf98021d9c8 tempest-VolumesExtendTest-1845360744 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:54:26 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-5c975d8f-6347-4389-824e-fdf98021d9c8 tempest-VolumesExtendTest-1845360744 None] Deleted volume successfully. Aug 10 12:54:26 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5c975d8f-6347-4389-824e-fdf98021d9c8 tempest-VolumesExtendTest-1845360744 None] Lock "cinder-51d0e586-3d0a-4936-86ef-9175f1fd02fe-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:54:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-f8f99eed-27b7-4b4c-a34d-ad543285d631 req-af4ea1e3-ff31-46cb-b204-09cde6a7d65c tempest-TestShelveInstance-772347230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:54:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-f8f99eed-27b7-4b4c-a34d-ad543285d631 req-af4ea1e3-ff31-46cb-b204-09cde6a7d65c tempest-TestShelveInstance-772347230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:54:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-f8f99eed-27b7-4b4c-a34d-ad543285d631 req-af4ea1e3-ff31-46cb-b204-09cde6a7d65c tempest-TestShelveInstance-772347230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:54:26 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-f8f99eed-27b7-4b4c-a34d-ad543285d631 req-af4ea1e3-ff31-46cb-b204-09cde6a7d65c tempest-TestShelveInstance-772347230 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d', 'name': 'volume-e44dbc7c-4853-4204-bcab-5395d5e8a4be', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '64a40082-2952-4a63-aa3b-9f299e465e2b', 'enforce_multipath': True} {{(pid=89096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Aug 10 12:54:26 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-f8f99eed-27b7-4b4c-a34d-ad543285d631 req-af4ea1e3-ff31-46cb-b204-09cde6a7d65c tempest-TestShelveInstance-772347230 None] attachment_update completed successfully. Aug 10 12:54:28 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-0050bed1-6e4a-4301-89ca-33fbd02f3908 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:54:28 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0050bed1-6e4a-4301-89ca-33fbd02f3908 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Flow 'volume_create_manager' (8df3ee0b-c294-47c3-b20d-93e07956a097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:54:28 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0050bed1-6e4a-4301-89ca-33fbd02f3908 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6404ba2-13f6-4c32-8240-b28665777085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:28 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0050bed1-6e4a-4301-89ca-33fbd02f3908 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6404ba2-13f6-4c32-8240-b28665777085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-217613556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a31f88b9-a466-4490-a1b2-d40b03e95316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72396f60aa1c4102bc80efd1b8c13b1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:54:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:54:28Z,use_quota=True,user_id='0d495c3a78894696a0a77c081a0309aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:28 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0050bed1-6e4a-4301-89ca-33fbd02f3908 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e78797e-d41a-480f-a1de-195c4ee9c7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:28 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0050bed1-6e4a-4301-89ca-33fbd02f3908 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e78797e-d41a-480f-a1de-195c4ee9c7d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:28 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0050bed1-6e4a-4301-89ca-33fbd02f3908 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9a3358a-7303-4123-a50e-706c25f4b2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:28 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0050bed1-6e4a-4301-89ca-33fbd02f3908 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9a3358a-7303-4123-a50e-706c25f4b2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a31f88b9-a466-4490-a1b2-d40b03e95316', 'volume_name': 'volume-a31f88b9-a466-4490-a1b2-d40b03e95316', 'volume_size': 2}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:28 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0050bed1-6e4a-4301-89ca-33fbd02f3908 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc4d8f29-95d3-425a-9aba-ff1d733aba5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:28 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0050bed1-6e4a-4301-89ca-33fbd02f3908 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc4d8f29-95d3-425a-9aba-ff1d733aba5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:28 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0050bed1-6e4a-4301-89ca-33fbd02f3908 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4403b7c3-b212-4a01-85de-48d829fb9baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:28 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-0050bed1-6e4a-4301-89ca-33fbd02f3908 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Volume a31f88b9-a466-4490-a1b2-d40b03e95316: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a31f88b9-a466-4490-a1b2-d40b03e95316', 'volume_size': 2} Aug 10 12:54:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0050bed1-6e4a-4301-89ca-33fbd02f3908 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:54:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0050bed1-6e4a-4301-89ca-33fbd02f3908 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:54:28 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0050bed1-6e4a-4301-89ca-33fbd02f3908 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-217613556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a31f88b9-a466-4490-a1b2-d40b03e95316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72396f60aa1c4102bc80efd1b8c13b1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:54:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:54:28Z,use_quota=True,user_id='0d495c3a78894696a0a77c081a0309aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:54:28 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-0050bed1-6e4a-4301-89ca-33fbd02f3908 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Creating volume a31f88b9-a466-4490-a1b2-d40b03e95316 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:54:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0050bed1-6e4a-4301-89ca-33fbd02f3908 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:54:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0050bed1-6e4a-4301-89ca-33fbd02f3908 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:54:28 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0050bed1-6e4a-4301-89ca-33fbd02f3908 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:54:28 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0050bed1-6e4a-4301-89ca-33fbd02f3908 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:54:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0050bed1-6e4a-4301-89ca-33fbd02f3908 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:54:28 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0050bed1-6e4a-4301-89ca-33fbd02f3908 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:54:28 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-0050bed1-6e4a-4301-89ca-33fbd02f3908 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:54:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0050bed1-6e4a-4301-89ca-33fbd02f3908 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316 2147483648 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:28 devstack sudo[98486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316 2147483648 Aug 10 12:54:28 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:29 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0050bed1-6e4a-4301-89ca-33fbd02f3908 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316 2147483648" returned: 0 in 0.640s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0050bed1-6e4a-4301-89ca-33fbd02f3908 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:29 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316 Aug 10 12:54:29 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:29 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0050bed1-6e4a-4301-89ca-33fbd02f3908 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316" returned: 0 in 0.380s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:29 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0050bed1-6e4a-4301-89ca-33fbd02f3908 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:54:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0050bed1-6e4a-4301-89ca-33fbd02f3908 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:54:29 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0050bed1-6e4a-4301-89ca-33fbd02f3908 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4403b7c3-b212-4a01-85de-48d829fb9baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a31f88b9-a466-4490-a1b2-d40b03e95316', 'volume_size': 2}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:29 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0050bed1-6e4a-4301-89ca-33fbd02f3908 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (144a3104-f30f-490c-9fdf-0ab7a4ae2490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:29 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-0050bed1-6e4a-4301-89ca-33fbd02f3908 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Volume volume-a31f88b9-a466-4490-a1b2-d40b03e95316 (a31f88b9-a466-4490-a1b2-d40b03e95316): created successfully Aug 10 12:54:29 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0050bed1-6e4a-4301-89ca-33fbd02f3908 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (144a3104-f30f-490c-9fdf-0ab7a4ae2490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:29 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0050bed1-6e4a-4301-89ca-33fbd02f3908 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Flow 'volume_create_manager' (8df3ee0b-c294-47c3-b20d-93e07956a097) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:54:29 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-0050bed1-6e4a-4301-89ca-33fbd02f3908 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Created volume successfully. Aug 10 12:54:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4d23e417-b588-43d7-bf00-631771aabc81 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:54:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4d23e417-b588-43d7-bf00-631771aabc81 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:54:30 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-4d23e417-b588-43d7-bf00-631771aabc81 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Creating offline snapshot a9b3a46f-e136-4949-bf1d-295b73abea48 of volume a31f88b9-a466-4490-a1b2-d40b03e95316 {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 12:54:30 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b22bd1-a4b9-448d-b54b-11bce698fde3]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:54:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4d23e417-b588-43d7-bf00-631771aabc81 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:31 devstack sudo[98917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316 Aug 10 12:54:31 devstack sudo[98917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:31 devstack sudo[98917]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4d23e417-b588-43d7-bf00-631771aabc81 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316" returned: 0 in 0.622s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4d23e417-b588-43d7-bf00-631771aabc81 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316.a9b3a46f-e136-4949-bf1d-295b73abea48 2G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:31 devstack sudo[98939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316.a9b3a46f-e136-4949-bf1d-295b73abea48 2G Aug 10 12:54:31 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:31 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4d23e417-b588-43d7-bf00-631771aabc81 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316.a9b3a46f-e136-4949-bf1d-295b73abea48 2G" returned: 0 in 0.484s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4d23e417-b588-43d7-bf00-631771aabc81 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a31f88b9-a466-4490-a1b2-d40b03e95316 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316.a9b3a46f-e136-4949-bf1d-295b73abea48 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:31 devstack sudo[98957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a31f88b9-a466-4490-a1b2-d40b03e95316 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316.a9b3a46f-e136-4949-bf1d-295b73abea48 Aug 10 12:54:31 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:32 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4d23e417-b588-43d7-bf00-631771aabc81 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a31f88b9-a466-4490-a1b2-d40b03e95316 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316.a9b3a46f-e136-4949-bf1d-295b73abea48" returned: 0 in 0.327s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:32 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-4d23e417-b588-43d7-bf00-631771aabc81 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316.a9b3a46f-e136-4949-bf1d-295b73abea48 is being set with open permissions: ugo+rw Aug 10 12:54:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4d23e417-b588-43d7-bf00-631771aabc81 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316.a9b3a46f-e136-4949-bf1d-295b73abea48 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:32 devstack sudo[98974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316.a9b3a46f-e136-4949-bf1d-295b73abea48 Aug 10 12:54:32 devstack sudo[98974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:32 devstack sudo[98974]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4d23e417-b588-43d7-bf00-631771aabc81 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316.a9b3a46f-e136-4949-bf1d-295b73abea48" returned: 0 in 0.379s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4d23e417-b588-43d7-bf00-631771aabc81 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:32 devstack sudo[98977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316.info Aug 10 12:54:32 devstack sudo[98977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:33 devstack sudo[98977]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4d23e417-b588-43d7-bf00-631771aabc81 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316.info" returned: 0 in 0.285s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:33 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-4d23e417-b588-43d7-bf00-631771aabc81 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316.info is being set with open permissions: ugo+rw Aug 10 12:54:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4d23e417-b588-43d7-bf00-631771aabc81 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:33 devstack sudo[98980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316.info Aug 10 12:54:33 devstack sudo[98980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:33 devstack sudo[98980]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4d23e417-b588-43d7-bf00-631771aabc81 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316.info" returned: 0 in 0.338s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4d23e417-b588-43d7-bf00-631771aabc81 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.597s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:54:33 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-4d23e417-b588-43d7-bf00-631771aabc81 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Create snapshot completed successfully Aug 10 12:54:34 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2ff222f8-6e77-4e99-943f-8ed8860f8ee3 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Acquiring lock "cinder-a9b3a46f-e136-4949-bf1d-295b73abea48-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:54:34 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2ff222f8-6e77-4e99-943f-8ed8860f8ee3 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Lock "cinder-a9b3a46f-e136-4949-bf1d-295b73abea48-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:54:34 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2ff222f8-6e77-4e99-943f-8ed8860f8ee3 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Acquiring lock "cinder-quobyte-a31f88b9-a466-4490-a1b2-d40b03e95316" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:54:34 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2ff222f8-6e77-4e99-943f-8ed8860f8ee3 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Lock "cinder-quobyte-a31f88b9-a466-4490-a1b2-d40b03e95316" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:54:34 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2ff222f8-6e77-4e99-943f-8ed8860f8ee3 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Acquiring lock "cinder-quobyte-a9b3a46f-e136-4949-bf1d-295b73abea48" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:54:34 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2ff222f8-6e77-4e99-943f-8ed8860f8ee3 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Lock "cinder-quobyte-a9b3a46f-e136-4949-bf1d-295b73abea48" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:54:34 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-2ff222f8-6e77-4e99-943f-8ed8860f8ee3 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Deleting offline snapshot a9b3a46f-e136-4949-bf1d-295b73abea48 of volume a31f88b9-a466-4490-a1b2-d40b03e95316 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 12:54:34 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-2ff222f8-6e77-4e99-943f-8ed8860f8ee3 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] snapshot_file for this snap is: volume-a31f88b9-a466-4490-a1b2-d40b03e95316.a9b3a46f-e136-4949-bf1d-295b73abea48 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 12:54:34 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a44a6c-33ac-497f-947f-073924569494]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:54:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2ff222f8-6e77-4e99-943f-8ed8860f8ee3 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316.a9b3a46f-e136-4949-bf1d-295b73abea48 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:34 devstack sudo[98985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316.a9b3a46f-e136-4949-bf1d-295b73abea48 Aug 10 12:54:34 devstack sudo[98985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:34 devstack sudo[98985]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2ff222f8-6e77-4e99-943f-8ed8860f8ee3 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316.a9b3a46f-e136-4949-bf1d-295b73abea48" returned: 0 in 0.462s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:34 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-2ff222f8-6e77-4e99-943f-8ed8860f8ee3 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a31f88b9-a466-4490-a1b2-d40b03e95316(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 12:54:34 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c2b991-3251-4bca-932f-a839b428c40c]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:54:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2ff222f8-6e77-4e99-943f-8ed8860f8ee3 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:34 devstack sudo[98990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316 Aug 10 12:54:34 devstack sudo[98990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:35 devstack sudo[98990]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2ff222f8-6e77-4e99-943f-8ed8860f8ee3 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316" returned: 0 in 0.422s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2ff222f8-6e77-4e99-943f-8ed8860f8ee3 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316.a9b3a46f-e136-4949-bf1d-295b73abea48 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:35 devstack sudo[98996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316.a9b3a46f-e136-4949-bf1d-295b73abea48 Aug 10 12:54:35 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:35 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2ff222f8-6e77-4e99-943f-8ed8860f8ee3 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316.a9b3a46f-e136-4949-bf1d-295b73abea48" returned: 0 in 0.700s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2ff222f8-6e77-4e99-943f-8ed8860f8ee3 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316.a9b3a46f-e136-4949-bf1d-295b73abea48 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:36 devstack sudo[99001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316.a9b3a46f-e136-4949-bf1d-295b73abea48 Aug 10 12:54:36 devstack sudo[99001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:36 devstack sudo[99001]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2ff222f8-6e77-4e99-943f-8ed8860f8ee3 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316.a9b3a46f-e136-4949-bf1d-295b73abea48" returned: 0 in 0.514s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:36 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2ff222f8-6e77-4e99-943f-8ed8860f8ee3 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Lock "cinder-quobyte-a9b3a46f-e136-4949-bf1d-295b73abea48" released by "_delete_snapshot" :: held 2.290s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:54:36 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2ff222f8-6e77-4e99-943f-8ed8860f8ee3 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Lock "cinder-quobyte-a31f88b9-a466-4490-a1b2-d40b03e95316" released by "delete_snapshot" :: held 2.321s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:54:36 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-2ff222f8-6e77-4e99-943f-8ed8860f8ee3 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Created reservations ['52080a89-2bd6-41f0-bc51-85925e53b237', '4d4f69ee-ff2d-4c40-9c75-3bf4b3b5a16c', 'eed1df71-99d6-4020-b08e-c5adf23c7298', '46cad174-35cf-499f-a26f-deab95d8867e'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:54:36 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-2ff222f8-6e77-4e99-943f-8ed8860f8ee3 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Delete snapshot completed successfully. Aug 10 12:54:36 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2ff222f8-6e77-4e99-943f-8ed8860f8ee3 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Lock "cinder-a9b3a46f-e136-4949-bf1d-295b73abea48-delete_snapshot" released by "delete_snapshot" :: held 2.541s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:54:37 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5cd413e1-4504-4033-bafb-0a28cf252ef9 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Acquiring lock "cinder-a31f88b9-a466-4490-a1b2-d40b03e95316-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:54:37 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5cd413e1-4504-4033-bafb-0a28cf252ef9 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Lock "cinder-a31f88b9-a466-4490-a1b2-d40b03e95316-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:54:37 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5cd413e1-4504-4033-bafb-0a28cf252ef9 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Acquiring lock "cinder-quobyte-a31f88b9-a466-4490-a1b2-d40b03e95316" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:54:37 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5cd413e1-4504-4033-bafb-0a28cf252ef9 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Lock "cinder-quobyte-a31f88b9-a466-4490-a1b2-d40b03e95316" acquired by "delete_volume" :: waited 0.030s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:54:37 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[32105a06-bf24-4dbe-a72f-c63f6f25505a]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:54:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5cd413e1-4504-4033-bafb-0a28cf252ef9 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:38 devstack sudo[99008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316 Aug 10 12:54:38 devstack sudo[99008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:38 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-31b4e3e2-58f4-4f9f-b144-d59f6ce56d3b req-e352598b-29b5-4ada-9b4e-395e98768118 tempest-ServerActionsTestOtherA-1564634914 None] Terminate volume connection completed successfully. Aug 10 12:54:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-31b4e3e2-58f4-4f9f-b144-d59f6ce56d3b req-e352598b-29b5-4ada-9b4e-395e98768118 tempest-ServerActionsTestOtherA-1564634914 None] Deleting attachment 6cf7ec8f-2bd8-497a-864c-396c9bc97d88. {{(pid=89096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Aug 10 12:54:38 devstack sudo[99008]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5cd413e1-4504-4033-bafb-0a28cf252ef9 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316" returned: 0 in 0.976s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5cd413e1-4504-4033-bafb-0a28cf252ef9 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:38 devstack sudo[99016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316 Aug 10 12:54:38 devstack sudo[99016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:39 devstack sudo[99016]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5cd413e1-4504-4033-bafb-0a28cf252ef9 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a31f88b9-a466-4490-a1b2-d40b03e95316" returned: 0 in 0.683s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:39 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5cd413e1-4504-4033-bafb-0a28cf252ef9 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Lock "cinder-quobyte-a31f88b9-a466-4490-a1b2-d40b03e95316" released by "delete_volume" :: held 1.767s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:54:39 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-5cd413e1-4504-4033-bafb-0a28cf252ef9 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Created reservations ['b1afd97b-ff7e-494c-bb2d-9ddd617a0ec4', '12205173-6b16-46dd-81c3-e0a701adff62', '4503e6d0-f81a-4979-a4e9-f44aec19ef67', 'a07823e7-4e50-4a9a-b72f-d3ac7b5ac7ab'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:54:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5cd413e1-4504-4033-bafb-0a28cf252ef9 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:54:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5cd413e1-4504-4033-bafb-0a28cf252ef9 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:54:39 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-5cd413e1-4504-4033-bafb-0a28cf252ef9 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:54:39 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-5cd413e1-4504-4033-bafb-0a28cf252ef9 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:54:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5cd413e1-4504-4033-bafb-0a28cf252ef9 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:54:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5cd413e1-4504-4033-bafb-0a28cf252ef9 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:39 devstack sudo[99019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:54:39 devstack sudo[99019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:40 devstack sudo[99019]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5cd413e1-4504-4033-bafb-0a28cf252ef9 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.519s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:40 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-5cd413e1-4504-4033-bafb-0a28cf252ef9 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:54:40 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-5cd413e1-4504-4033-bafb-0a28cf252ef9 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Deleted volume successfully. Aug 10 12:54:40 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5cd413e1-4504-4033-bafb-0a28cf252ef9 tempest-VolumesSnapshotNegativeTestJSON-1372362176 None] Lock "cinder-a31f88b9-a466-4490-a1b2-d40b03e95316-delete_volume" released by "delete_volume" :: held 2.664s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:54:41 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:54:41 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Flow 'volume_create_manager' (81fa9a65-b7ae-4bbd-bb5d-700a697f30a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:54:41 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc1e6fd9-644d-4612-940f-4f5033652a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:41 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc1e6fd9-644d-4612-940f-4f5033652a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-930090394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=310b3a52-d6fc-4f44-9cfa-9aa82d729784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2f89a9500294060a4f1ed028640544d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:54:42Z,use_quota=True,user_id='ad51f666b1fb4067abd4007228955299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:42 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e8a629c-8473-4611-815a-33ddb177ddb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:42 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e8a629c-8473-4611-815a-33ddb177ddb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:42 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31ae6aae-0179-4c77-b3ce-6f8b6bc9f0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:42 devstack cinder-volume[89096]: DEBUG cinder.image.glance [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Creating Keystone auth plugin from conf {{(pid=89096) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 10 12:54:42 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31ae6aae-0179-4c77-b3ce-6f8b6bc9f0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '310b3a52-d6fc-4f44-9cfa-9aa82d729784', 'volume_name': 'volume-310b3a52-d6fc-4f44-9cfa-9aa82d729784', 'volume_size': 1, 'image_id': 'd127b0c1-c6db-4978-8f85-71a25140f15c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d127b0c1-c6db-4978-8f85-71a25140f15c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '84a7884b15744611bf66a9a12c498e2b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd127b0c1-c6db-4978-8f85-71a25140f15c', 'created_at': datetime.datetime(2026, 8, 10, 10, 40, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 10, 40, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d127b0c1-c6db-4978-8f85-71a25140f15c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:42 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54a78ebd-31da-4e26-8df4-7feafdef52ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:42 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54a78ebd-31da-4e26-8df4-7feafdef52ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:42 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c85cc4f8-77ce-4349-9361-f6363ce34e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:42 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Volume 310b3a52-d6fc-4f44-9cfa-9aa82d729784: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-310b3a52-d6fc-4f44-9cfa-9aa82d729784', 'volume_size': 1, 'image_id': 'd127b0c1-c6db-4978-8f85-71a25140f15c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d127b0c1-c6db-4978-8f85-71a25140f15c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '84a7884b15744611bf66a9a12c498e2b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd127b0c1-c6db-4978-8f85-71a25140f15c', 'created_at': datetime.datetime(2026, 8, 10, 10, 40, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 10, 40, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d127b0c1-c6db-4978-8f85-71a25140f15c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 10 12:54:42 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Trying to clone 310b3a52-d6fc-4f44-9cfa-9aa82d729784 from image d127b0c1-c6db-4978-8f85-71a25140f15c at location (None, [{'url': 'file:///opt/stack/data/glance/images/d127b0c1-c6db-4978-8f85-71a25140f15c', 'metadata': {}}]). {{(pid=89096) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 10 12:54:43 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_01irw52wdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89096) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 10 12:54:43 devstack cinder-volume[89096]: INFO cinder.image.image_utils [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Image download 20.69 MB at 20.69 MB/s Aug 10 12:54:43 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[5906dcb8-8ea9-4083-8e19-c0b2db9bb881]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:54:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_01irw52wdevstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:43 devstack sudo[99030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_01irw52wdevstack@QuobyteHD Aug 10 12:54:43 devstack sudo[99030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:43 devstack sudo[99030]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_01irw52wdevstack@QuobyteHD" returned: 0 in 0.563s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:43 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Temporary image d127b0c1-c6db-4978-8f85-71a25140f15c is fetched for user ad51f666b1fb4067abd4007228955299. {{(pid=89096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 10 12:54:44 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc2c0a0-21b6-47e3-8e9c-0486bcd9d514]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:54:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_01irw52wdevstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:44 devstack sudo[99035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_01irw52wdevstack@QuobyteHD Aug 10 12:54:44 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:44 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_01irw52wdevstack@QuobyteHD" returned: 0 in 0.649s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:54:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:54:44 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-930090394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=310b3a52-d6fc-4f44-9cfa-9aa82d729784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2f89a9500294060a4f1ed028640544d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:54:42Z,use_quota=True,user_id='ad51f666b1fb4067abd4007228955299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:54:44 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Creating volume 310b3a52-d6fc-4f44-9cfa-9aa82d729784 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:54:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:54:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:54:44 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:54:44 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:54:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:54:44 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:54:44 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:54:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-310b3a52-d6fc-4f44-9cfa-9aa82d729784 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:44 devstack sudo[99040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-310b3a52-d6fc-4f44-9cfa-9aa82d729784 1073741824 Aug 10 12:54:44 devstack sudo[99040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:45 devstack sudo[99040]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-310b3a52-d6fc-4f44-9cfa-9aa82d729784 1073741824" returned: 0 in 0.731s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-310b3a52-d6fc-4f44-9cfa-9aa82d729784 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:45 devstack sudo[99047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-310b3a52-d6fc-4f44-9cfa-9aa82d729784 Aug 10 12:54:45 devstack sudo[99047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:45 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f3012e7-1dec-41aa-90c5-2a4f935c742b tempest-VolumesSnapshotTestJSON-1685907550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:54:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8f3012e7-1dec-41aa-90c5-2a4f935c742b tempest-VolumesSnapshotTestJSON-1685907550 None] Flow 'volume_create_manager' (bd76d735-aea3-4147-b17e-ec9bd89712f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:54:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8f3012e7-1dec-41aa-90c5-2a4f935c742b tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f5593d-268c-47a4-9165-1f2c205a99cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8f3012e7-1dec-41aa-90c5-2a4f935c742b tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f5593d-268c-47a4-9165-1f2c205a99cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1061102299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1d6b7af-2d81-461f-8984-1ce2655dd542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1639df2f701d4ea49b53d1a78918feb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:54:46Z,use_quota=True,user_id='9399cf74bc9e487c9b1d7f123b3913af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8f3012e7-1dec-41aa-90c5-2a4f935c742b tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d54391b6-8ce1-463b-86a6-4679fd8fb51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8f3012e7-1dec-41aa-90c5-2a4f935c742b tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d54391b6-8ce1-463b-86a6-4679fd8fb51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8f3012e7-1dec-41aa-90c5-2a4f935c742b tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (407b5aab-120a-4c64-8e67-551778366c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8f3012e7-1dec-41aa-90c5-2a4f935c742b tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (407b5aab-120a-4c64-8e67-551778366c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1d6b7af-2d81-461f-8984-1ce2655dd542', 'volume_name': 'volume-a1d6b7af-2d81-461f-8984-1ce2655dd542', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8f3012e7-1dec-41aa-90c5-2a4f935c742b tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71e70ce6-2792-419a-9658-f3202fd224d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8f3012e7-1dec-41aa-90c5-2a4f935c742b tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71e70ce6-2792-419a-9658-f3202fd224d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8f3012e7-1dec-41aa-90c5-2a4f935c742b tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ad72a21-e338-46c6-ade9-366fee981154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:46 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-8f3012e7-1dec-41aa-90c5-2a4f935c742b tempest-VolumesSnapshotTestJSON-1685907550 None] Volume a1d6b7af-2d81-461f-8984-1ce2655dd542: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1d6b7af-2d81-461f-8984-1ce2655dd542', 'volume_size': 1} Aug 10 12:54:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8f3012e7-1dec-41aa-90c5-2a4f935c742b tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:54:46 devstack sudo[99047]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-310b3a52-d6fc-4f44-9cfa-9aa82d729784" returned: 0 in 0.455s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:46 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] <== create_volume: return (1274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:54:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:54:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8f3012e7-1dec-41aa-90c5-2a4f935c742b tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.060s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:54:46 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8f3012e7-1dec-41aa-90c5-2a4f935c742b tempest-VolumesSnapshotTestJSON-1685907550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1061102299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1d6b7af-2d81-461f-8984-1ce2655dd542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1639df2f701d4ea49b53d1a78918feb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:54:46Z,use_quota=True,user_id='9399cf74bc9e487c9b1d7f123b3913af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:54:46 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-8f3012e7-1dec-41aa-90c5-2a4f935c742b tempest-VolumesSnapshotTestJSON-1685907550 None] Creating volume a1d6b7af-2d81-461f-8984-1ce2655dd542 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:54:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8f3012e7-1dec-41aa-90c5-2a4f935c742b tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:54:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8f3012e7-1dec-41aa-90c5-2a4f935c742b tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:54:46 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8f3012e7-1dec-41aa-90c5-2a4f935c742b tempest-VolumesSnapshotTestJSON-1685907550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:54:46 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8f3012e7-1dec-41aa-90c5-2a4f935c742b tempest-VolumesSnapshotTestJSON-1685907550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:54:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8f3012e7-1dec-41aa-90c5-2a4f935c742b tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:54:46 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8f3012e7-1dec-41aa-90c5-2a4f935c742b tempest-VolumesSnapshotTestJSON-1685907550 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:54:46 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-8f3012e7-1dec-41aa-90c5-2a4f935c742b tempest-VolumesSnapshotTestJSON-1685907550 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:54:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8f3012e7-1dec-41aa-90c5-2a4f935c742b tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:46 devstack sudo[99050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542 1073741824 Aug 10 12:54:46 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:46 devstack cinder-volume[89096]: DEBUG cinder.volume.volume_utils [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Attempting download of d127b0c1-c6db-4978-8f85-71a25140f15c ((None, [{'url': 'file:///opt/stack/data/glance/images/d127b0c1-c6db-4978-8f85-71a25140f15c', 'metadata': {}}])) to volume 310b3a52-d6fc-4f44-9cfa-9aa82d729784. {{(pid=89096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 10 12:54:46 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[10df2319-9eb5-405c-b651-e9d0cc36cada]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:54:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d127b0c1-c6db-4978-8f85-71a25140f15c_w3k3n84o {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:46 devstack sudo[99052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d127b0c1-c6db-4978-8f85-71a25140f15c_w3k3n84o Aug 10 12:54:46 devstack sudo[99052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:46 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:46 devstack sudo[99052]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8f3012e7-1dec-41aa-90c5-2a4f935c742b tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542 1073741824" returned: 0 in 0.557s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d127b0c1-c6db-4978-8f85-71a25140f15c_w3k3n84o" returned: 0 in 0.451s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d127b0c1-c6db-4978-8f85-71a25140f15c_w3k3n84o {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8f3012e7-1dec-41aa-90c5-2a4f935c742b tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:46 devstack sudo[99061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542 Aug 10 12:54:46 devstack sudo[99061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:46 devstack sudo[99060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d127b0c1-c6db-4978-8f85-71a25140f15c_w3k3n84o Aug 10 12:54:46 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:47 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d127b0c1-c6db-4978-8f85-71a25140f15c_w3k3n84o" returned: 1 in 0.406s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d127b0c1-c6db-4978-8f85-71a25140f15c_w3k3n84o' failed. Not Retrying. {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 12:54:47 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b8aad8-2291-4e65-88dd-89bebf744ce1]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:54:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_01irw52wdevstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:47 devstack sudo[99061]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8f3012e7-1dec-41aa-90c5-2a4f935c742b tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542" returned: 0 in 0.461s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:47 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8f3012e7-1dec-41aa-90c5-2a4f935c742b tempest-VolumesSnapshotTestJSON-1685907550 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:54:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8f3012e7-1dec-41aa-90c5-2a4f935c742b tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:54:47 devstack sudo[99067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_01irw52wdevstack@QuobyteHD Aug 10 12:54:47 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8f3012e7-1dec-41aa-90c5-2a4f935c742b tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ad72a21-e338-46c6-ade9-366fee981154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1d6b7af-2d81-461f-8984-1ce2655dd542', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8f3012e7-1dec-41aa-90c5-2a4f935c742b tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (298d1e5b-82a0-42e6-b5e1-6918a658dc41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:47 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-8f3012e7-1dec-41aa-90c5-2a4f935c742b tempest-VolumesSnapshotTestJSON-1685907550 None] Volume volume-a1d6b7af-2d81-461f-8984-1ce2655dd542 (a1d6b7af-2d81-461f-8984-1ce2655dd542): created successfully Aug 10 12:54:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8f3012e7-1dec-41aa-90c5-2a4f935c742b tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (298d1e5b-82a0-42e6-b5e1-6918a658dc41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8f3012e7-1dec-41aa-90c5-2a4f935c742b tempest-VolumesSnapshotTestJSON-1685907550 None] Flow 'volume_create_manager' (bd76d735-aea3-4147-b17e-ec9bd89712f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:54:47 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-8f3012e7-1dec-41aa-90c5-2a4f935c742b tempest-VolumesSnapshotTestJSON-1685907550 None] Created volume successfully. Aug 10 12:54:47 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_01irw52wdevstack@QuobyteHD" returned: 0 in 0.441s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:47 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] d127b0c1-c6db-4978-8f85-71a25140f15c was qcow2, converting to qcow2 {{(pid=89096) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 10 12:54:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_01irw52wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-310b3a52-d6fc-4f44-9cfa-9aa82d729784 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:47 devstack sudo[99073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_01irw52wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-310b3a52-d6fc-4f44-9cfa-9aa82d729784 Aug 10 12:54:47 devstack sudo[99073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8f4fdd6b-7ce3-412e-a8e1-028a10b1e71b tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:54:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8f4fdd6b-7ce3-412e-a8e1-028a10b1e71b tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:54:48 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-8f4fdd6b-7ce3-412e-a8e1-028a10b1e71b tempest-VolumesSnapshotTestJSON-1685907550 None] Creating offline snapshot e31731f5-51bf-4e2a-812b-b358e8f76f61 of volume a1d6b7af-2d81-461f-8984-1ce2655dd542 {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 12:54:48 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfc01d5-68a6-4aca-afec-a52aeb6f1ce8]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:54:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8f4fdd6b-7ce3-412e-a8e1-028a10b1e71b tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:48 devstack sudo[99081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542 Aug 10 12:54:48 devstack sudo[99081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:48 devstack sudo[99081]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8f4fdd6b-7ce3-412e-a8e1-028a10b1e71b tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542" returned: 0 in 0.515s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8f4fdd6b-7ce3-412e-a8e1-028a10b1e71b tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542.e31731f5-51bf-4e2a-812b-b358e8f76f61 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:49 devstack sudo[99099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542.e31731f5-51bf-4e2a-812b-b358e8f76f61 1G Aug 10 12:54:49 devstack sudo[99099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:49 devstack sudo[99099]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8f4fdd6b-7ce3-412e-a8e1-028a10b1e71b tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542.e31731f5-51bf-4e2a-812b-b358e8f76f61 1G" returned: 0 in 0.525s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8f4fdd6b-7ce3-412e-a8e1-028a10b1e71b tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1d6b7af-2d81-461f-8984-1ce2655dd542 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542.e31731f5-51bf-4e2a-812b-b358e8f76f61 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:49 devstack sudo[99109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1d6b7af-2d81-461f-8984-1ce2655dd542 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542.e31731f5-51bf-4e2a-812b-b358e8f76f61 Aug 10 12:54:49 devstack sudo[99109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:49 devstack sudo[99073]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_01irw52wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-310b3a52-d6fc-4f44-9cfa-9aa82d729784" returned: 0 in 2.313s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:49 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_01irw52wdevstack@QuobyteHD, size 112.00 MB, duration 2.31 sec, destination /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-310b3a52-d6fc-4f44-9cfa-9aa82d729784 {{(pid=89096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 12:54:49 devstack cinder-volume[89096]: INFO cinder.image.image_utils [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Converted 112.00 MB image at 48.40 MB/s Aug 10 12:54:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-310b3a52-d6fc-4f44-9cfa-9aa82d729784 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:49 devstack sudo[99109]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8f4fdd6b-7ce3-412e-a8e1-028a10b1e71b tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1d6b7af-2d81-461f-8984-1ce2655dd542 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542.e31731f5-51bf-4e2a-812b-b358e8f76f61" returned: 0 in 0.354s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:49 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-8f4fdd6b-7ce3-412e-a8e1-028a10b1e71b tempest-VolumesSnapshotTestJSON-1685907550 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542.e31731f5-51bf-4e2a-812b-b358e8f76f61 is being set with open permissions: ugo+rw Aug 10 12:54:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8f4fdd6b-7ce3-412e-a8e1-028a10b1e71b tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542.e31731f5-51bf-4e2a-812b-b358e8f76f61 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:49 devstack sudo[99118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-310b3a52-d6fc-4f44-9cfa-9aa82d729784 1G Aug 10 12:54:49 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:49 devstack sudo[99139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542.e31731f5-51bf-4e2a-812b-b358e8f76f61 Aug 10 12:54:49 devstack sudo[99139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:50 devstack sudo[99139]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8f4fdd6b-7ce3-412e-a8e1-028a10b1e71b tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542.e31731f5-51bf-4e2a-812b-b358e8f76f61" returned: 0 in 0.266s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8f4fdd6b-7ce3-412e-a8e1-028a10b1e71b tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:50 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-310b3a52-d6fc-4f44-9cfa-9aa82d729784 1G" returned: 0 in 0.351s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:50 devstack cinder-volume[89096]: DEBUG cinder.volume.volume_utils [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Downloaded image d127b0c1-c6db-4978-8f85-71a25140f15c ((None, [{'url': 'file:///opt/stack/data/glance/images/d127b0c1-c6db-4978-8f85-71a25140f15c', 'metadata': {}}])) to volume 310b3a52-d6fc-4f44-9cfa-9aa82d729784 successfully. {{(pid=89096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 10 12:54:50 devstack sudo[99146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542.info Aug 10 12:54:50 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Temporary image d127b0c1-c6db-4978-8f85-71a25140f15c for user ad51f666b1fb4067abd4007228955299 is deleted. {{(pid=89096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 10 12:54:50 devstack sudo[99146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:50 devstack cinder-volume[89096]: DEBUG cinder.volume.volume_utils [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Marking volume 310b3a52-d6fc-4f44-9cfa-9aa82d729784 as bootable. {{(pid=89096) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 10 12:54:50 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Copying metadata from image d127b0c1-c6db-4978-8f85-71a25140f15c to 310b3a52-d6fc-4f44-9cfa-9aa82d729784. {{(pid=89096) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 10 12:54:50 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Creating volume glance metadata for volume 310b3a52-d6fc-4f44-9cfa-9aa82d729784 backed by image d127b0c1-c6db-4978-8f85-71a25140f15c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd127b0c1-c6db-4978-8f85-71a25140f15c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89096) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 10 12:54:50 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c85cc4f8-77ce-4349-9361-f6363ce34e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-310b3a52-d6fc-4f44-9cfa-9aa82d729784', 'volume_size': 1, 'image_id': 'd127b0c1-c6db-4978-8f85-71a25140f15c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d127b0c1-c6db-4978-8f85-71a25140f15c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '84a7884b15744611bf66a9a12c498e2b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd127b0c1-c6db-4978-8f85-71a25140f15c', 'created_at': datetime.datetime(2026, 8, 10, 10, 40, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 10, 40, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d127b0c1-c6db-4978-8f85-71a25140f15c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:50 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3f3e5d0-ab08-49c9-888e-5c96b527ef71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:50 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Volume volume-310b3a52-d6fc-4f44-9cfa-9aa82d729784 (310b3a52-d6fc-4f44-9cfa-9aa82d729784): created successfully Aug 10 12:54:50 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3f3e5d0-ab08-49c9-888e-5c96b527ef71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:50 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Flow 'volume_create_manager' (81fa9a65-b7ae-4bbd-bb5d-700a697f30a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:54:50 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-d32b4cf8-2909-4631-9f2e-cee08914db22 tempest-ServerActionsTestOtherA-1564634914 None] Created volume successfully. Aug 10 12:54:50 devstack sudo[99146]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8f4fdd6b-7ce3-412e-a8e1-028a10b1e71b tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542.info" returned: 0 in 0.419s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:50 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-8f4fdd6b-7ce3-412e-a8e1-028a10b1e71b tempest-VolumesSnapshotTestJSON-1685907550 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542.info is being set with open permissions: ugo+rw Aug 10 12:54:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8f4fdd6b-7ce3-412e-a8e1-028a10b1e71b tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:50 devstack sudo[99149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542.info Aug 10 12:54:50 devstack sudo[99149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:50 devstack sudo[99149]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8f4fdd6b-7ce3-412e-a8e1-028a10b1e71b tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542.info" returned: 0 in 0.314s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8f4fdd6b-7ce3-412e-a8e1-028a10b1e71b tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.549s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:54:50 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-8f4fdd6b-7ce3-412e-a8e1-028a10b1e71b tempest-VolumesSnapshotTestJSON-1685907550 None] Create snapshot completed successfully Aug 10 12:54:51 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-df4b43ab-ac88-4fe8-b5c9-130ec06a0193 tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "cinder-e31731f5-51bf-4e2a-812b-b358e8f76f61-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:54:51 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-df4b43ab-ac88-4fe8-b5c9-130ec06a0193 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-e31731f5-51bf-4e2a-812b-b358e8f76f61-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:54:51 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-df4b43ab-ac88-4fe8-b5c9-130ec06a0193 tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "cinder-quobyte-a1d6b7af-2d81-461f-8984-1ce2655dd542" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:54:51 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-df4b43ab-ac88-4fe8-b5c9-130ec06a0193 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-quobyte-a1d6b7af-2d81-461f-8984-1ce2655dd542" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:54:51 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-df4b43ab-ac88-4fe8-b5c9-130ec06a0193 tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "cinder-quobyte-e31731f5-51bf-4e2a-812b-b358e8f76f61" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:54:51 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-df4b43ab-ac88-4fe8-b5c9-130ec06a0193 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-quobyte-e31731f5-51bf-4e2a-812b-b358e8f76f61" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:54:51 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-df4b43ab-ac88-4fe8-b5c9-130ec06a0193 tempest-VolumesSnapshotTestJSON-1685907550 None] Deleting offline snapshot e31731f5-51bf-4e2a-812b-b358e8f76f61 of volume a1d6b7af-2d81-461f-8984-1ce2655dd542 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 12:54:51 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-df4b43ab-ac88-4fe8-b5c9-130ec06a0193 tempest-VolumesSnapshotTestJSON-1685907550 None] snapshot_file for this snap is: volume-a1d6b7af-2d81-461f-8984-1ce2655dd542.e31731f5-51bf-4e2a-812b-b358e8f76f61 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 12:54:51 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f8b5e8-2c8f-4c05-bed7-159a4ad6dbc7]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:54:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-df4b43ab-ac88-4fe8-b5c9-130ec06a0193 tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542.e31731f5-51bf-4e2a-812b-b358e8f76f61 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:52 devstack sudo[99152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542.e31731f5-51bf-4e2a-812b-b358e8f76f61 Aug 10 12:54:52 devstack sudo[99152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:52 devstack sudo[99152]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-df4b43ab-ac88-4fe8-b5c9-130ec06a0193 tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542.e31731f5-51bf-4e2a-812b-b358e8f76f61" returned: 0 in 0.573s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:52 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-df4b43ab-ac88-4fe8-b5c9-130ec06a0193 tempest-VolumesSnapshotTestJSON-1685907550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1d6b7af-2d81-461f-8984-1ce2655dd542(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 12:54:52 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e30f79c-968d-400d-9791-0fb00ab1cf78]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:54:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-df4b43ab-ac88-4fe8-b5c9-130ec06a0193 tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:52 devstack sudo[99161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542 Aug 10 12:54:52 devstack sudo[99161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:53 devstack sudo[99161]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-df4b43ab-ac88-4fe8-b5c9-130ec06a0193 tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542" returned: 0 in 0.477s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-df4b43ab-ac88-4fe8-b5c9-130ec06a0193 tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542.e31731f5-51bf-4e2a-812b-b358e8f76f61 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:53 devstack sudo[99168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542.e31731f5-51bf-4e2a-812b-b358e8f76f61 Aug 10 12:54:53 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:53 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-df4b43ab-ac88-4fe8-b5c9-130ec06a0193 tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542.e31731f5-51bf-4e2a-812b-b358e8f76f61" returned: 0 in 0.616s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-df4b43ab-ac88-4fe8-b5c9-130ec06a0193 tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542.e31731f5-51bf-4e2a-812b-b358e8f76f61 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:53 devstack sudo[99173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542.e31731f5-51bf-4e2a-812b-b358e8f76f61 Aug 10 12:54:53 devstack sudo[99173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:54 devstack sudo[99173]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-df4b43ab-ac88-4fe8-b5c9-130ec06a0193 tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542.e31731f5-51bf-4e2a-812b-b358e8f76f61" returned: 0 in 0.397s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:54 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-df4b43ab-ac88-4fe8-b5c9-130ec06a0193 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-quobyte-e31731f5-51bf-4e2a-812b-b358e8f76f61" released by "_delete_snapshot" :: held 2.243s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:54:54 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-df4b43ab-ac88-4fe8-b5c9-130ec06a0193 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-quobyte-a1d6b7af-2d81-461f-8984-1ce2655dd542" released by "delete_snapshot" :: held 2.275s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:54:54 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-df4b43ab-ac88-4fe8-b5c9-130ec06a0193 tempest-VolumesSnapshotTestJSON-1685907550 None] Created reservations ['81954274-03eb-497f-8e24-a59f908505c4', '7d547072-a18f-4075-ad86-0e04375add50', '347d95a3-b3a5-48f8-bfc0-db012e43d943', 'c91357c9-3ba3-4341-acae-e4e1586f8d5d'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:54:54 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-df4b43ab-ac88-4fe8-b5c9-130ec06a0193 tempest-VolumesSnapshotTestJSON-1685907550 None] Delete snapshot completed successfully. Aug 10 12:54:54 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-df4b43ab-ac88-4fe8-b5c9-130ec06a0193 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-e31731f5-51bf-4e2a-812b-b358e8f76f61-delete_snapshot" released by "delete_snapshot" :: held 2.530s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:54:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-a5547500-4c31-4c24-b95f-658090925de9 req-ac20a92b-4eab-49be-bea1-3c307bc4de57 tempest-ServerActionsTestOtherA-1564634914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:54:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-a5547500-4c31-4c24-b95f-658090925de9 req-ac20a92b-4eab-49be-bea1-3c307bc4de57 tempest-ServerActionsTestOtherA-1564634914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:54:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-a5547500-4c31-4c24-b95f-658090925de9 req-ac20a92b-4eab-49be-bea1-3c307bc4de57 tempest-ServerActionsTestOtherA-1564634914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:54:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-a5547500-4c31-4c24-b95f-658090925de9 req-ac20a92b-4eab-49be-bea1-3c307bc4de57 tempest-ServerActionsTestOtherA-1564634914 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d', 'name': 'volume-310b3a52-d6fc-4f44-9cfa-9aa82d729784', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a1b4d792-181f-4e85-bf62-65b1e25a53b8', 'enforce_multipath': True} {{(pid=89096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Aug 10 12:54:54 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-a5547500-4c31-4c24-b95f-658090925de9 req-ac20a92b-4eab-49be-bea1-3c307bc4de57 tempest-ServerActionsTestOtherA-1564634914 None] attachment_update completed successfully. Aug 10 12:54:55 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8ef8197-01e3-4fc8-a48e-d39c2255b982 tempest-VolumesSnapshotTestJSON-1685907550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:54:55 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f8ef8197-01e3-4fc8-a48e-d39c2255b982 tempest-VolumesSnapshotTestJSON-1685907550 None] Flow 'volume_create_manager' (77f56fb0-70ac-44e0-9051-3abbe61ece48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:54:55 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f8ef8197-01e3-4fc8-a48e-d39c2255b982 tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83b28564-42f2-4e67-9b5e-a43a2fc9d2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:55 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f8ef8197-01e3-4fc8-a48e-d39c2255b982 tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83b28564-42f2-4e67-9b5e-a43a2fc9d2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-334395088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=268e507a-66ba-4be0-ae34-283444956f9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1639df2f701d4ea49b53d1a78918feb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:54:56Z,use_quota=True,user_id='9399cf74bc9e487c9b1d7f123b3913af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:55 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f8ef8197-01e3-4fc8-a48e-d39c2255b982 tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1254371-d78d-400c-87ad-da5ee839af90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:55 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f8ef8197-01e3-4fc8-a48e-d39c2255b982 tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1254371-d78d-400c-87ad-da5ee839af90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:55 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f8ef8197-01e3-4fc8-a48e-d39c2255b982 tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc2f85b-2dd0-4a4a-91eb-a744b329ae70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:55 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f8ef8197-01e3-4fc8-a48e-d39c2255b982 tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc2f85b-2dd0-4a4a-91eb-a744b329ae70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '268e507a-66ba-4be0-ae34-283444956f9b', 'volume_name': 'volume-268e507a-66ba-4be0-ae34-283444956f9b', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:55 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f8ef8197-01e3-4fc8-a48e-d39c2255b982 tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3fcb3d1-9472-49cc-ae92-dc3354bb7f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:55 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f8ef8197-01e3-4fc8-a48e-d39c2255b982 tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3fcb3d1-9472-49cc-ae92-dc3354bb7f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:55 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f8ef8197-01e3-4fc8-a48e-d39c2255b982 tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0554c846-f92f-4605-a96e-26bca8d6db13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:55 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-f8ef8197-01e3-4fc8-a48e-d39c2255b982 tempest-VolumesSnapshotTestJSON-1685907550 None] Volume 268e507a-66ba-4be0-ae34-283444956f9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-268e507a-66ba-4be0-ae34-283444956f9b', 'volume_size': 1} Aug 10 12:54:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f8ef8197-01e3-4fc8-a48e-d39c2255b982 tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:54:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f8ef8197-01e3-4fc8-a48e-d39c2255b982 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:54:55 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f8ef8197-01e3-4fc8-a48e-d39c2255b982 tempest-VolumesSnapshotTestJSON-1685907550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-334395088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=268e507a-66ba-4be0-ae34-283444956f9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1639df2f701d4ea49b53d1a78918feb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:54:56Z,use_quota=True,user_id='9399cf74bc9e487c9b1d7f123b3913af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:54:55 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-f8ef8197-01e3-4fc8-a48e-d39c2255b982 tempest-VolumesSnapshotTestJSON-1685907550 None] Creating volume 268e507a-66ba-4be0-ae34-283444956f9b {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:54:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f8ef8197-01e3-4fc8-a48e-d39c2255b982 tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:54:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f8ef8197-01e3-4fc8-a48e-d39c2255b982 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:54:55 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f8ef8197-01e3-4fc8-a48e-d39c2255b982 tempest-VolumesSnapshotTestJSON-1685907550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:54:55 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f8ef8197-01e3-4fc8-a48e-d39c2255b982 tempest-VolumesSnapshotTestJSON-1685907550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:54:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f8ef8197-01e3-4fc8-a48e-d39c2255b982 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:54:55 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f8ef8197-01e3-4fc8-a48e-d39c2255b982 tempest-VolumesSnapshotTestJSON-1685907550 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:54:55 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-f8ef8197-01e3-4fc8-a48e-d39c2255b982 tempest-VolumesSnapshotTestJSON-1685907550 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:54:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f8ef8197-01e3-4fc8-a48e-d39c2255b982 tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:55 devstack sudo[99184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b 1073741824 Aug 10 12:54:55 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:56 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f8ef8197-01e3-4fc8-a48e-d39c2255b982 tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b 1073741824" returned: 0 in 0.740s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f8ef8197-01e3-4fc8-a48e-d39c2255b982 tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:56 devstack sudo[99189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b Aug 10 12:54:56 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:57 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f8ef8197-01e3-4fc8-a48e-d39c2255b982 tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b" returned: 0 in 0.372s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:57 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f8ef8197-01e3-4fc8-a48e-d39c2255b982 tempest-VolumesSnapshotTestJSON-1685907550 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:54:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f8ef8197-01e3-4fc8-a48e-d39c2255b982 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:54:57 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f8ef8197-01e3-4fc8-a48e-d39c2255b982 tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0554c846-f92f-4605-a96e-26bca8d6db13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-268e507a-66ba-4be0-ae34-283444956f9b', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:57 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f8ef8197-01e3-4fc8-a48e-d39c2255b982 tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0f7bfda-9385-4f8d-9bc1-ec0c3a97dcdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:54:57 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-f8ef8197-01e3-4fc8-a48e-d39c2255b982 tempest-VolumesSnapshotTestJSON-1685907550 None] Volume volume-268e507a-66ba-4be0-ae34-283444956f9b (268e507a-66ba-4be0-ae34-283444956f9b): created successfully Aug 10 12:54:57 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f8ef8197-01e3-4fc8-a48e-d39c2255b982 tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0f7bfda-9385-4f8d-9bc1-ec0c3a97dcdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:54:57 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f8ef8197-01e3-4fc8-a48e-d39c2255b982 tempest-VolumesSnapshotTestJSON-1685907550 None] Flow 'volume_create_manager' (77f56fb0-70ac-44e0-9051-3abbe61ece48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:54:57 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-f8ef8197-01e3-4fc8-a48e-d39c2255b982 tempest-VolumesSnapshotTestJSON-1685907550 None] Created volume successfully. Aug 10 12:54:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6a628c81-bd34-49bd-971c-49ac4fa8f9cd tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:54:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6a628c81-bd34-49bd-971c-49ac4fa8f9cd tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:54:58 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-6a628c81-bd34-49bd-971c-49ac4fa8f9cd tempest-VolumesSnapshotTestJSON-1685907550 None] Creating offline snapshot e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd of volume 268e507a-66ba-4be0-ae34-283444956f9b {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 12:54:58 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[41073ae5-948d-46b4-8024-dc8693ace884]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:54:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6a628c81-bd34-49bd-971c-49ac4fa8f9cd tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:58 devstack sudo[99218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b Aug 10 12:54:58 devstack sudo[99218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:59 devstack sudo[99218]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6a628c81-bd34-49bd-971c-49ac4fa8f9cd tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b" returned: 0 in 0.631s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6a628c81-bd34-49bd-971c-49ac4fa8f9cd tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b.e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:59 devstack sudo[99233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b.e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd 1G Aug 10 12:54:59 devstack sudo[99233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:54:59 devstack sudo[99233]: pam_unix(sudo:session): session closed for user root Aug 10 12:54:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6a628c81-bd34-49bd-971c-49ac4fa8f9cd tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b.e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd 1G" returned: 0 in 0.608s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:54:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6a628c81-bd34-49bd-971c-49ac4fa8f9cd tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-268e507a-66ba-4be0-ae34-283444956f9b -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b.e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:54:59 devstack sudo[99252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-268e507a-66ba-4be0-ae34-283444956f9b -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b.e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd Aug 10 12:54:59 devstack sudo[99252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:00 devstack sudo[99252]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6a628c81-bd34-49bd-971c-49ac4fa8f9cd tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-268e507a-66ba-4be0-ae34-283444956f9b -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b.e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd" returned: 0 in 0.388s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:00 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-6a628c81-bd34-49bd-971c-49ac4fa8f9cd tempest-VolumesSnapshotTestJSON-1685907550 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b.e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd is being set with open permissions: ugo+rw Aug 10 12:55:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6a628c81-bd34-49bd-971c-49ac4fa8f9cd tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b.e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:00 devstack sudo[99269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b.e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd Aug 10 12:55:00 devstack sudo[99269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:00 devstack sudo[99269]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6a628c81-bd34-49bd-971c-49ac4fa8f9cd tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b.e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd" returned: 0 in 0.298s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6a628c81-bd34-49bd-971c-49ac4fa8f9cd tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:00 devstack sudo[99272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b.info Aug 10 12:55:00 devstack sudo[99272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:00 devstack sudo[99272]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6a628c81-bd34-49bd-971c-49ac4fa8f9cd tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b.info" returned: 0 in 0.282s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:00 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-6a628c81-bd34-49bd-971c-49ac4fa8f9cd tempest-VolumesSnapshotTestJSON-1685907550 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b.info is being set with open permissions: ugo+rw Aug 10 12:55:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6a628c81-bd34-49bd-971c-49ac4fa8f9cd tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:00 devstack sudo[99275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b.info Aug 10 12:55:00 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:01 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6a628c81-bd34-49bd-971c-49ac4fa8f9cd tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b.info" returned: 0 in 0.411s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6a628c81-bd34-49bd-971c-49ac4fa8f9cd tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.785s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:55:01 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-6a628c81-bd34-49bd-971c-49ac4fa8f9cd tempest-VolumesSnapshotTestJSON-1685907550 None] Create snapshot completed successfully Aug 10 12:55:02 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:55:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Flow 'volume_create_manager' (2a7c8cda-2791-4e8a-8470-3b5d15a90fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:55:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (926c35cc-160b-4b3a-bdd9-79de2a19a54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (926c35cc-160b-4b3a-bdd9-79de2a19a54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1321405055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df3addbd-dd29-43e9-a9f1-94037171d64a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1639df2f701d4ea49b53d1a78918feb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:55:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:55:02Z,use_quota=True,user_id='9399cf74bc9e487c9b1d7f123b3913af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d8319b-3ddc-4cf9-9240-34e45b69f712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d8319b-3ddc-4cf9-9240-34e45b69f712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b352920-e32a-4d30-b784-db569fbe89ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b352920-e32a-4d30-b784-db569fbe89ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'df3addbd-dd29-43e9-a9f1-94037171d64a', 'volume_name': 'volume-df3addbd-dd29-43e9-a9f1-94037171d64a', 'volume_size': 2, 'snapshot_id': 'e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd'}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (205801d4-d8b7-456f-94de-c1ada5c379a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (205801d4-d8b7-456f-94de-c1ada5c379a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7518893-21c3-4eee-8434-589fb8bcfe2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:02 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Volume df3addbd-dd29-43e9-a9f1-94037171d64a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-df3addbd-dd29-43e9-a9f1-94037171d64a', 'volume_size': 2, 'snapshot_id': 'e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd'} Aug 10 12:55:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:55:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:55:02 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "cinder-quobyte-e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd-df3addbd-dd29-43e9-a9f1-94037171d64a" by "_create_volume_from_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:55:02 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-quobyte-e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd-df3addbd-dd29-43e9-a9f1-94037171d64a" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:55:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Creating volume df3addbd-dd29-43e9-a9f1-94037171d64a from snapshot e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd {{(pid=89096) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 10 12:55:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:55:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:55:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:55:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:55:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:55:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:55:02 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "cinder-quobyte-df3addbd-dd29-43e9-a9f1-94037171d64a" by "_copy_volume_from_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:55:02 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-quobyte-df3addbd-dd29-43e9-a9f1-94037171d64a" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:55:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] snapshot: e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd, volume: df3addbd-dd29-43e9-a9f1-94037171d64a, {{(pid=89096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 10 12:55:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:55:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:55:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:55:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:55:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:55:02 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aff1225-9657-4cd0-af21-d9b88210f92c]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:55:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b.e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:02 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b.e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd Aug 10 12:55:02 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:03 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b.e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd" returned: 0 in 0.535s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-268e507a-66ba-4be0-ae34-283444956f9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 12:55:03 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf148e2-eb1b-4013-a9f4-81e6cb660675]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:55:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:03 devstack sudo[99290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b Aug 10 12:55:03 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:03 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 12:55:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:55:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:55:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:55:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:55:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:55:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:03 devstack sudo[99295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:55:03 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:03 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b" returned: 0 in 0.662s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b {{(pid=89096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 10 12:55:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Creating direct copy from snapshot {{(pid=89096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 10 12:55:03 devstack cinder-volume[89096]: DEBUG cinder.utils [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Path /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-df3addbd-dd29-43e9-a9f1-94037171d64a not found in is_blk_device check {{(pid=89096) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 10 12:55:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-df3addbd-dd29-43e9-a9f1-94037171d64a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:04 devstack sudo[99297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-df3addbd-dd29-43e9-a9f1-94037171d64a Aug 10 12:55:04 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:04 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.651s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:04 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:55:04 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager._thread_info {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 12:55:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread count: 28 {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 12:55:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread info: [<_MainThread(MainThread, started 130607683133568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Aug 10 12:55:11 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-df3addbd-dd29-43e9-a9f1-94037171d64a" returned: 0 in 7.766s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:11 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Image conversion details: src /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b, size 1024.00 MB, duration 7.77 sec, destination /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-df3addbd-dd29-43e9-a9f1-94037171d64a {{(pid=89096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 12:55:11 devstack cinder-volume[89096]: INFO cinder.image.image_utils [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Converted 1024.00 MB image at 131.84 MB/s Aug 10 12:55:11 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-df3addbd-dd29-43e9-a9f1-94037171d64a is being set with open permissions: ugo+rw Aug 10 12:55:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-df3addbd-dd29-43e9-a9f1-94037171d64a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:11 devstack sudo[99658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-df3addbd-dd29-43e9-a9f1-94037171d64a Aug 10 12:55:11 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:12 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-df3addbd-dd29-43e9-a9f1-94037171d64a" returned: 0 in 0.439s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:12 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-quobyte-df3addbd-dd29-43e9-a9f1-94037171d64a" released by "_copy_volume_from_snapshot" :: held 9.546s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:55:12 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-quobyte-e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd-df3addbd-dd29-43e9-a9f1-94037171d64a" released by "_create_volume_from_snapshot" :: held 9.633s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:55:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.650s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:55:12 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7518893-21c3-4eee-8434-589fb8bcfe2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df3addbd-dd29-43e9-a9f1-94037171d64a', 'volume_size': 2, 'snapshot_id': 'e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd'}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:12 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e5aae66-036a-49ad-b45c-86f0c3ecf30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:12 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Volume volume-df3addbd-dd29-43e9-a9f1-94037171d64a (df3addbd-dd29-43e9-a9f1-94037171d64a): created successfully Aug 10 12:55:12 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e5aae66-036a-49ad-b45c-86f0c3ecf30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:12 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Flow 'volume_create_manager' (2a7c8cda-2791-4e8a-8470-3b5d15a90fbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:55:12 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-073c2bb9-cd17-4e73-b01f-6e18986e7996 tempest-VolumesSnapshotTestJSON-1685907550 None] Created volume successfully. Aug 10 12:55:13 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-3451db5f-29aa-469e-bd3e-d136da64777a tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "cinder-df3addbd-dd29-43e9-a9f1-94037171d64a-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:55:13 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-3451db5f-29aa-469e-bd3e-d136da64777a tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-df3addbd-dd29-43e9-a9f1-94037171d64a-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:55:13 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-3451db5f-29aa-469e-bd3e-d136da64777a tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "cinder-quobyte-df3addbd-dd29-43e9-a9f1-94037171d64a" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:55:13 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-3451db5f-29aa-469e-bd3e-d136da64777a tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-quobyte-df3addbd-dd29-43e9-a9f1-94037171d64a" acquired by "delete_volume" :: waited 0.055s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:55:13 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d4fb66-c099-4268-b99e-fbf0a00bc899]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:55:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3451db5f-29aa-469e-bd3e-d136da64777a tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-df3addbd-dd29-43e9-a9f1-94037171d64a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:14 devstack sudo[99749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-df3addbd-dd29-43e9-a9f1-94037171d64a Aug 10 12:55:14 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:14 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3451db5f-29aa-469e-bd3e-d136da64777a tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-df3addbd-dd29-43e9-a9f1-94037171d64a" returned: 0 in 0.740s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3451db5f-29aa-469e-bd3e-d136da64777a tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-df3addbd-dd29-43e9-a9f1-94037171d64a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:14 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-df3addbd-dd29-43e9-a9f1-94037171d64a Aug 10 12:55:14 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:15 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3451db5f-29aa-469e-bd3e-d136da64777a tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-df3addbd-dd29-43e9-a9f1-94037171d64a" returned: 0 in 0.576s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:15 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-3451db5f-29aa-469e-bd3e-d136da64777a tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-quobyte-df3addbd-dd29-43e9-a9f1-94037171d64a" released by "delete_volume" :: held 1.417s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:55:15 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-3451db5f-29aa-469e-bd3e-d136da64777a tempest-VolumesSnapshotTestJSON-1685907550 None] Created reservations ['bb7d949a-eda2-4e7b-ba23-25082fb7dc46', 'e2fcbb97-2212-4120-b7a7-3f27bf8f077c', '187f1940-56b1-4bdb-9acb-014307e167a0', '160bc661-dc4c-45da-87c7-fcfc4adf29e9'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:55:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3451db5f-29aa-469e-bd3e-d136da64777a tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:55:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3451db5f-29aa-469e-bd3e-d136da64777a tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:55:15 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3451db5f-29aa-469e-bd3e-d136da64777a tempest-VolumesSnapshotTestJSON-1685907550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:55:15 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3451db5f-29aa-469e-bd3e-d136da64777a tempest-VolumesSnapshotTestJSON-1685907550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:55:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3451db5f-29aa-469e-bd3e-d136da64777a tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:55:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3451db5f-29aa-469e-bd3e-d136da64777a tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:15 devstack sudo[99783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:55:15 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:16 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3451db5f-29aa-469e-bd3e-d136da64777a tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.542s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:16 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-3451db5f-29aa-469e-bd3e-d136da64777a tempest-VolumesSnapshotTestJSON-1685907550 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:55:16 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-3451db5f-29aa-469e-bd3e-d136da64777a tempest-VolumesSnapshotTestJSON-1685907550 None] Deleted volume successfully. Aug 10 12:55:16 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-3451db5f-29aa-469e-bd3e-d136da64777a tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-df3addbd-dd29-43e9-a9f1-94037171d64a-delete_volume" released by "delete_volume" :: held 2.452s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:55:16 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-20b33e5b-19d7-4541-8858-5ca9c5fa2b8f tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "cinder-e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:55:16 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-20b33e5b-19d7-4541-8858-5ca9c5fa2b8f tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:55:16 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-20b33e5b-19d7-4541-8858-5ca9c5fa2b8f tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "cinder-quobyte-268e507a-66ba-4be0-ae34-283444956f9b" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:55:16 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-20b33e5b-19d7-4541-8858-5ca9c5fa2b8f tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-quobyte-268e507a-66ba-4be0-ae34-283444956f9b" acquired by "delete_snapshot" :: waited 0.056s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:55:16 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-20b33e5b-19d7-4541-8858-5ca9c5fa2b8f tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "cinder-quobyte-e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:55:16 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-20b33e5b-19d7-4541-8858-5ca9c5fa2b8f tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-quobyte-e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd" acquired by "_delete_snapshot" :: waited 0.063s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:55:16 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-20b33e5b-19d7-4541-8858-5ca9c5fa2b8f tempest-VolumesSnapshotTestJSON-1685907550 None] Deleting offline snapshot e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd of volume 268e507a-66ba-4be0-ae34-283444956f9b {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 12:55:16 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-20b33e5b-19d7-4541-8858-5ca9c5fa2b8f tempest-VolumesSnapshotTestJSON-1685907550 None] snapshot_file for this snap is: volume-268e507a-66ba-4be0-ae34-283444956f9b.e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 12:55:16 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ba7260-b32b-4fa0-8806-45799c569c89]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:55:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-20b33e5b-19d7-4541-8858-5ca9c5fa2b8f tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b.e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:16 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-1c2bcdcb-0284-483b-b6ec-4b430efc2b73 req-ad781d9d-d46a-4f09-8310-c7ee4311e6df tempest-TestShelveInstance-772347230 None] Terminate volume connection completed successfully. Aug 10 12:55:16 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-1c2bcdcb-0284-483b-b6ec-4b430efc2b73 req-ad781d9d-d46a-4f09-8310-c7ee4311e6df tempest-TestShelveInstance-772347230 None] Deleting attachment 64a40082-2952-4a63-aa3b-9f299e465e2b. {{(pid=89096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Aug 10 12:55:16 devstack sudo[99789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b.e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd Aug 10 12:55:16 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:17 devstack cinder-volume[89096]: DEBUG cinder.coordination [req-1c2bcdcb-0284-483b-b6ec-4b430efc2b73 req-d339ea3d-800d-42fe-9824-30e0851f1491 tempest-TestShelveInstance-772347230 None] Acquiring lock "cinder-e44dbc7c-4853-4204-bcab-5395d5e8a4be-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:55:17 devstack cinder-volume[89096]: DEBUG cinder.coordination [req-1c2bcdcb-0284-483b-b6ec-4b430efc2b73 req-d339ea3d-800d-42fe-9824-30e0851f1491 tempest-TestShelveInstance-772347230 None] Lock "cinder-e44dbc7c-4853-4204-bcab-5395d5e8a4be-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:55:17 devstack cinder-volume[89096]: DEBUG cinder.coordination [req-1c2bcdcb-0284-483b-b6ec-4b430efc2b73 req-d339ea3d-800d-42fe-9824-30e0851f1491 tempest-TestShelveInstance-772347230 None] Acquiring lock "cinder-quobyte-e44dbc7c-4853-4204-bcab-5395d5e8a4be" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:55:17 devstack cinder-volume[89096]: DEBUG cinder.coordination [req-1c2bcdcb-0284-483b-b6ec-4b430efc2b73 req-d339ea3d-800d-42fe-9824-30e0851f1491 tempest-TestShelveInstance-772347230 None] Lock "cinder-quobyte-e44dbc7c-4853-4204-bcab-5395d5e8a4be" acquired by "delete_volume" :: waited 0.059s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:55:17 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d534a0f-598a-4197-a0cb-604865640c89]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:55:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-1c2bcdcb-0284-483b-b6ec-4b430efc2b73 req-d339ea3d-800d-42fe-9824-30e0851f1491 tempest-TestShelveInstance-772347230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e44dbc7c-4853-4204-bcab-5395d5e8a4be {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:17 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-20b33e5b-19d7-4541-8858-5ca9c5fa2b8f tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b.e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd" returned: 0 in 1.255s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:17 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-20b33e5b-19d7-4541-8858-5ca9c5fa2b8f tempest-VolumesSnapshotTestJSON-1685907550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-268e507a-66ba-4be0-ae34-283444956f9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 12:55:17 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[9389fadf-50d1-4325-962b-31e005a25808]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:55:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-20b33e5b-19d7-4541-8858-5ca9c5fa2b8f tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:18 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e44dbc7c-4853-4204-bcab-5395d5e8a4be Aug 10 12:55:18 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:18 devstack sudo[99797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b Aug 10 12:55:18 devstack sudo[99797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:18 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-1c2bcdcb-0284-483b-b6ec-4b430efc2b73 req-d339ea3d-800d-42fe-9824-30e0851f1491 tempest-TestShelveInstance-772347230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e44dbc7c-4853-4204-bcab-5395d5e8a4be" returned: 0 in 1.232s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-1c2bcdcb-0284-483b-b6ec-4b430efc2b73 req-d339ea3d-800d-42fe-9824-30e0851f1491 tempest-TestShelveInstance-772347230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e44dbc7c-4853-4204-bcab-5395d5e8a4be {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:18 devstack sudo[99808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e44dbc7c-4853-4204-bcab-5395d5e8a4be Aug 10 12:55:18 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:19 devstack sudo[99797]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-20b33e5b-19d7-4541-8858-5ca9c5fa2b8f tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b" returned: 0 in 1.103s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-20b33e5b-19d7-4541-8858-5ca9c5fa2b8f tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b.e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:19 devstack sudo[99811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b.e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd Aug 10 12:55:19 devstack sudo[99811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:19 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-1c2bcdcb-0284-483b-b6ec-4b430efc2b73 req-d339ea3d-800d-42fe-9824-30e0851f1491 tempest-TestShelveInstance-772347230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e44dbc7c-4853-4204-bcab-5395d5e8a4be" returned: 0 in 0.541s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:19 devstack cinder-volume[89096]: DEBUG cinder.coordination [req-1c2bcdcb-0284-483b-b6ec-4b430efc2b73 req-d339ea3d-800d-42fe-9824-30e0851f1491 tempest-TestShelveInstance-772347230 None] Lock "cinder-quobyte-e44dbc7c-4853-4204-bcab-5395d5e8a4be" released by "delete_volume" :: held 1.880s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:55:19 devstack cinder-volume[89096]: DEBUG cinder.quota [req-1c2bcdcb-0284-483b-b6ec-4b430efc2b73 req-d339ea3d-800d-42fe-9824-30e0851f1491 tempest-TestShelveInstance-772347230 None] Created reservations ['a53fd5b7-885a-442f-b9ee-5dd6f296e975', '8c24974d-7a2c-4cb8-b634-96b50ab3e242', '03f17495-bff4-49ef-8c06-7dfd4d3d3f93', '3e3bce92-9849-435f-8c53-97cfe2ce8a68'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:55:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-1c2bcdcb-0284-483b-b6ec-4b430efc2b73 req-d339ea3d-800d-42fe-9824-30e0851f1491 tempest-TestShelveInstance-772347230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:55:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-1c2bcdcb-0284-483b-b6ec-4b430efc2b73 req-d339ea3d-800d-42fe-9824-30e0851f1491 tempest-TestShelveInstance-772347230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:55:19 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [req-1c2bcdcb-0284-483b-b6ec-4b430efc2b73 req-d339ea3d-800d-42fe-9824-30e0851f1491 tempest-TestShelveInstance-772347230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:55:19 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [req-1c2bcdcb-0284-483b-b6ec-4b430efc2b73 req-d339ea3d-800d-42fe-9824-30e0851f1491 tempest-TestShelveInstance-772347230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:55:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-1c2bcdcb-0284-483b-b6ec-4b430efc2b73 req-d339ea3d-800d-42fe-9824-30e0851f1491 tempest-TestShelveInstance-772347230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:55:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-1c2bcdcb-0284-483b-b6ec-4b430efc2b73 req-d339ea3d-800d-42fe-9824-30e0851f1491 tempest-TestShelveInstance-772347230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:19 devstack sudo[99818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:55:19 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:19 devstack sudo[99811]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-20b33e5b-19d7-4541-8858-5ca9c5fa2b8f tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b.e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd" returned: 0 in 0.710s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-20b33e5b-19d7-4541-8858-5ca9c5fa2b8f tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b.e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:19 devstack sudo[99820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b.e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd Aug 10 12:55:19 devstack sudo[99820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:20 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-1c2bcdcb-0284-483b-b6ec-4b430efc2b73 req-d339ea3d-800d-42fe-9824-30e0851f1491 tempest-TestShelveInstance-772347230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.392s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:20 devstack cinder-volume[89096]: DEBUG cinder.manager [req-1c2bcdcb-0284-483b-b6ec-4b430efc2b73 req-d339ea3d-800d-42fe-9824-30e0851f1491 tempest-TestShelveInstance-772347230 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:55:20 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-1c2bcdcb-0284-483b-b6ec-4b430efc2b73 req-d339ea3d-800d-42fe-9824-30e0851f1491 tempest-TestShelveInstance-772347230 None] Deleted volume successfully. Aug 10 12:55:20 devstack cinder-volume[89096]: DEBUG cinder.coordination [req-1c2bcdcb-0284-483b-b6ec-4b430efc2b73 req-d339ea3d-800d-42fe-9824-30e0851f1491 tempest-TestShelveInstance-772347230 None] Lock "cinder-e44dbc7c-4853-4204-bcab-5395d5e8a4be-delete_volume" released by "delete_volume" :: held 2.848s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:55:20 devstack sudo[99820]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-20b33e5b-19d7-4541-8858-5ca9c5fa2b8f tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b.e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd" returned: 0 in 0.406s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:20 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-20b33e5b-19d7-4541-8858-5ca9c5fa2b8f tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-quobyte-e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd" released by "_delete_snapshot" :: held 3.761s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:55:20 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-20b33e5b-19d7-4541-8858-5ca9c5fa2b8f tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-quobyte-268e507a-66ba-4be0-ae34-283444956f9b" released by "delete_snapshot" :: held 3.847s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:55:20 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-20b33e5b-19d7-4541-8858-5ca9c5fa2b8f tempest-VolumesSnapshotTestJSON-1685907550 None] Created reservations ['977c50a4-c6ab-47aa-b726-30dc4b871d99', 'bff0ce69-8a68-4b94-80cc-cd57093115d0', '927c31cb-44af-496d-b5aa-10ebc0d79e8c', '04ce384a-5165-49ff-b41d-77e7e206007a'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:55:20 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-20b33e5b-19d7-4541-8858-5ca9c5fa2b8f tempest-VolumesSnapshotTestJSON-1685907550 None] Delete snapshot completed successfully. Aug 10 12:55:20 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-20b33e5b-19d7-4541-8858-5ca9c5fa2b8f tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-e0f9f2fb-bd8c-495c-96fd-6d147c77b2fd-delete_snapshot" released by "delete_snapshot" :: held 4.202s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:55:20 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-eab21125-fa2c-4e0f-a976-b14f373698d2 tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "cinder-268e507a-66ba-4be0-ae34-283444956f9b-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:55:21 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-eab21125-fa2c-4e0f-a976-b14f373698d2 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-268e507a-66ba-4be0-ae34-283444956f9b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:55:21 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-eab21125-fa2c-4e0f-a976-b14f373698d2 tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "cinder-quobyte-268e507a-66ba-4be0-ae34-283444956f9b" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:55:21 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-eab21125-fa2c-4e0f-a976-b14f373698d2 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-quobyte-268e507a-66ba-4be0-ae34-283444956f9b" acquired by "delete_volume" :: waited 0.023s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:55:21 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccf1587-c4ae-48e1-9364-17c2815fefce]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:55:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-eab21125-fa2c-4e0f-a976-b14f373698d2 tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:21 devstack sudo[99825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b Aug 10 12:55:21 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:21 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-eab21125-fa2c-4e0f-a976-b14f373698d2 tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b" returned: 0 in 0.788s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-eab21125-fa2c-4e0f-a976-b14f373698d2 tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:22 devstack sudo[99831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b Aug 10 12:55:22 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:22 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-eab21125-fa2c-4e0f-a976-b14f373698d2 tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-268e507a-66ba-4be0-ae34-283444956f9b" returned: 0 in 0.401s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:22 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-eab21125-fa2c-4e0f-a976-b14f373698d2 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-quobyte-268e507a-66ba-4be0-ae34-283444956f9b" released by "delete_volume" :: held 1.314s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:55:22 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-eab21125-fa2c-4e0f-a976-b14f373698d2 tempest-VolumesSnapshotTestJSON-1685907550 None] Created reservations ['8fb8422a-df5d-43a4-bb80-fadcae45b771', 'ae47bdca-8755-4dc8-b638-d32baaafbc94', '4677634e-005f-44a4-87d4-adc9d3310581', 'b94e8e60-2ea5-480c-beef-9a8cad2bf826'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:55:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-eab21125-fa2c-4e0f-a976-b14f373698d2 tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:55:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-eab21125-fa2c-4e0f-a976-b14f373698d2 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:55:22 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-eab21125-fa2c-4e0f-a976-b14f373698d2 tempest-VolumesSnapshotTestJSON-1685907550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:55:22 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-eab21125-fa2c-4e0f-a976-b14f373698d2 tempest-VolumesSnapshotTestJSON-1685907550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:55:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-eab21125-fa2c-4e0f-a976-b14f373698d2 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:55:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-eab21125-fa2c-4e0f-a976-b14f373698d2 tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:22 devstack sudo[99835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:55:22 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:22 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-eab21125-fa2c-4e0f-a976-b14f373698d2 tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.330s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:22 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-eab21125-fa2c-4e0f-a976-b14f373698d2 tempest-VolumesSnapshotTestJSON-1685907550 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:55:22 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-eab21125-fa2c-4e0f-a976-b14f373698d2 tempest-VolumesSnapshotTestJSON-1685907550 None] Deleted volume successfully. Aug 10 12:55:22 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-eab21125-fa2c-4e0f-a976-b14f373698d2 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-268e507a-66ba-4be0-ae34-283444956f9b-delete_volume" released by "delete_volume" :: held 1.976s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:55:23 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-27e01978-b0d4-451c-9862-70118dd84f57 req-046e7d3f-ffd8-413f-ba98-0d14d679879b tempest-ServerActionsTestOtherA-1564634914 None] Terminate volume connection completed successfully. Aug 10 12:55:23 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-27e01978-b0d4-451c-9862-70118dd84f57 req-046e7d3f-ffd8-413f-ba98-0d14d679879b tempest-ServerActionsTestOtherA-1564634914 None] Deleting attachment a1b4d792-181f-4e85-bf62-65b1e25a53b8. {{(pid=89096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Aug 10 12:55:24 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=99,cinder:INSERT=20,cinder:UPDATE=80,cinder:DELETE=3 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:55:24 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:UPDATE=89,cinder:SELECT=89,cinder:INSERT=33,cinder:DELETE=10 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:55:24 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4ca03b4-8f46-400d-93e7-f8725346f2ab tempest-VolumesSnapshotTestJSON-1685907550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:55:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4ca03b4-8f46-400d-93e7-f8725346f2ab tempest-VolumesSnapshotTestJSON-1685907550 None] Flow 'volume_create_manager' (a7b6ad22-1156-4db1-b9d4-f2c3b4bd08fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:55:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4ca03b4-8f46-400d-93e7-f8725346f2ab tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9243969d-1208-4bb9-bb9b-e56c603e246d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4ca03b4-8f46-400d-93e7-f8725346f2ab tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9243969d-1208-4bb9-bb9b-e56c603e246d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-184483266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a3e0ccc-0862-45a0-8b79-5d5c996df282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1639df2f701d4ea49b53d1a78918feb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:55:24Z,use_quota=True,user_id='9399cf74bc9e487c9b1d7f123b3913af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4ca03b4-8f46-400d-93e7-f8725346f2ab tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08b4d351-b81a-4531-a630-d77b8383d193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4ca03b4-8f46-400d-93e7-f8725346f2ab tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08b4d351-b81a-4531-a630-d77b8383d193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4ca03b4-8f46-400d-93e7-f8725346f2ab tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9af92e79-6c50-4336-8867-00e1b698cccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4ca03b4-8f46-400d-93e7-f8725346f2ab tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9af92e79-6c50-4336-8867-00e1b698cccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a3e0ccc-0862-45a0-8b79-5d5c996df282', 'volume_name': 'volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4ca03b4-8f46-400d-93e7-f8725346f2ab tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06d55253-89b7-4be2-bcbb-5946cdf3fe75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4ca03b4-8f46-400d-93e7-f8725346f2ab tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06d55253-89b7-4be2-bcbb-5946cdf3fe75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4ca03b4-8f46-400d-93e7-f8725346f2ab tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3896ced6-b77a-4cc9-bff4-e67fc12e9769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:24 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-f4ca03b4-8f46-400d-93e7-f8725346f2ab tempest-VolumesSnapshotTestJSON-1685907550 None] Volume 0a3e0ccc-0862-45a0-8b79-5d5c996df282: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282', 'volume_size': 1} Aug 10 12:55:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f4ca03b4-8f46-400d-93e7-f8725346f2ab tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:55:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f4ca03b4-8f46-400d-93e7-f8725346f2ab tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:55:24 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f4ca03b4-8f46-400d-93e7-f8725346f2ab tempest-VolumesSnapshotTestJSON-1685907550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-184483266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a3e0ccc-0862-45a0-8b79-5d5c996df282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1639df2f701d4ea49b53d1a78918feb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:55:24Z,use_quota=True,user_id='9399cf74bc9e487c9b1d7f123b3913af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:55:24 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-f4ca03b4-8f46-400d-93e7-f8725346f2ab tempest-VolumesSnapshotTestJSON-1685907550 None] Creating volume 0a3e0ccc-0862-45a0-8b79-5d5c996df282 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:55:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f4ca03b4-8f46-400d-93e7-f8725346f2ab tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:55:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f4ca03b4-8f46-400d-93e7-f8725346f2ab tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:55:24 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f4ca03b4-8f46-400d-93e7-f8725346f2ab tempest-VolumesSnapshotTestJSON-1685907550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:55:24 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f4ca03b4-8f46-400d-93e7-f8725346f2ab tempest-VolumesSnapshotTestJSON-1685907550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:55:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f4ca03b4-8f46-400d-93e7-f8725346f2ab tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:55:24 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f4ca03b4-8f46-400d-93e7-f8725346f2ab tempest-VolumesSnapshotTestJSON-1685907550 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:55:24 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-f4ca03b4-8f46-400d-93e7-f8725346f2ab tempest-VolumesSnapshotTestJSON-1685907550 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:55:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f4ca03b4-8f46-400d-93e7-f8725346f2ab tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:24 devstack sudo[99904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282 1073741824 Aug 10 12:55:24 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:25 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f4ca03b4-8f46-400d-93e7-f8725346f2ab tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282 1073741824" returned: 0 in 0.717s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f4ca03b4-8f46-400d-93e7-f8725346f2ab tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:25 devstack sudo[99912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282 Aug 10 12:55:25 devstack sudo[99912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:25 devstack sudo[99912]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f4ca03b4-8f46-400d-93e7-f8725346f2ab tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282" returned: 0 in 0.377s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:25 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f4ca03b4-8f46-400d-93e7-f8725346f2ab tempest-VolumesSnapshotTestJSON-1685907550 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:55:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f4ca03b4-8f46-400d-93e7-f8725346f2ab tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:55:25 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4ca03b4-8f46-400d-93e7-f8725346f2ab tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3896ced6-b77a-4cc9-bff4-e67fc12e9769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:25 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4ca03b4-8f46-400d-93e7-f8725346f2ab tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a51dc19-dd4a-44e5-8c5c-c9f208a83548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:25 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-f4ca03b4-8f46-400d-93e7-f8725346f2ab tempest-VolumesSnapshotTestJSON-1685907550 None] Volume volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282 (0a3e0ccc-0862-45a0-8b79-5d5c996df282): created successfully Aug 10 12:55:25 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4ca03b4-8f46-400d-93e7-f8725346f2ab tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a51dc19-dd4a-44e5-8c5c-c9f208a83548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:25 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4ca03b4-8f46-400d-93e7-f8725346f2ab tempest-VolumesSnapshotTestJSON-1685907550 None] Flow 'volume_create_manager' (a7b6ad22-1156-4db1-b9d4-f2c3b4bd08fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:55:25 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-f4ca03b4-8f46-400d-93e7-f8725346f2ab tempest-VolumesSnapshotTestJSON-1685907550 None] Created volume successfully. Aug 10 12:55:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-27e01978-b0d4-451c-9862-70118dd84f57 req-8073dae4-68b4-43e8-be44-708ee0351f0b tempest-ServerActionsTestOtherA-1564634914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:55:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-27e01978-b0d4-451c-9862-70118dd84f57 req-8073dae4-68b4-43e8-be44-708ee0351f0b tempest-ServerActionsTestOtherA-1564634914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:55:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-27e01978-b0d4-451c-9862-70118dd84f57 req-8073dae4-68b4-43e8-be44-708ee0351f0b tempest-ServerActionsTestOtherA-1564634914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:55:26 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-27e01978-b0d4-451c-9862-70118dd84f57 req-8073dae4-68b4-43e8-be44-708ee0351f0b tempest-ServerActionsTestOtherA-1564634914 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d', 'name': 'volume-310b3a52-d6fc-4f44-9cfa-9aa82d729784', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2852c73e-f1f9-419f-992b-60e1be8a4b4a', 'enforce_multipath': True} {{(pid=89096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Aug 10 12:55:26 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-27e01978-b0d4-451c-9862-70118dd84f57 req-8073dae4-68b4-43e8-be44-708ee0351f0b tempest-ServerActionsTestOtherA-1564634914 None] attachment_update completed successfully. Aug 10 12:55:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-23432e0b-d17d-496c-92fd-b5a11d61c50e tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:55:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-23432e0b-d17d-496c-92fd-b5a11d61c50e tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:55:26 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-23432e0b-d17d-496c-92fd-b5a11d61c50e tempest-VolumesSnapshotTestJSON-1685907550 None] Creating offline snapshot ba577b47-7ff7-4e71-8bb3-93dc51e1081a of volume 0a3e0ccc-0862-45a0-8b79-5d5c996df282 {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 12:55:26 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d77f64-5717-44ca-8916-2e5145acf8a1]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:55:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-23432e0b-d17d-496c-92fd-b5a11d61c50e tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:27 devstack sudo[99923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282 Aug 10 12:55:27 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:27 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-23432e0b-d17d-496c-92fd-b5a11d61c50e tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282" returned: 0 in 0.772s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-23432e0b-d17d-496c-92fd-b5a11d61c50e tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282.ba577b47-7ff7-4e71-8bb3-93dc51e1081a 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:27 devstack sudo[100009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282.ba577b47-7ff7-4e71-8bb3-93dc51e1081a 1G Aug 10 12:55:27 devstack sudo[100009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:28 devstack sudo[100009]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-23432e0b-d17d-496c-92fd-b5a11d61c50e tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282.ba577b47-7ff7-4e71-8bb3-93dc51e1081a 1G" returned: 0 in 0.882s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-23432e0b-d17d-496c-92fd-b5a11d61c50e tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282.ba577b47-7ff7-4e71-8bb3-93dc51e1081a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:28 devstack sudo[100355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282.ba577b47-7ff7-4e71-8bb3-93dc51e1081a Aug 10 12:55:28 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:28 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-23432e0b-d17d-496c-92fd-b5a11d61c50e tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282.ba577b47-7ff7-4e71-8bb3-93dc51e1081a" returned: 0 in 0.427s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:28 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-23432e0b-d17d-496c-92fd-b5a11d61c50e tempest-VolumesSnapshotTestJSON-1685907550 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282.ba577b47-7ff7-4e71-8bb3-93dc51e1081a is being set with open permissions: ugo+rw Aug 10 12:55:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-23432e0b-d17d-496c-92fd-b5a11d61c50e tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282.ba577b47-7ff7-4e71-8bb3-93dc51e1081a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:28 devstack sudo[100373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282.ba577b47-7ff7-4e71-8bb3-93dc51e1081a Aug 10 12:55:28 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:29 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-23432e0b-d17d-496c-92fd-b5a11d61c50e tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282.ba577b47-7ff7-4e71-8bb3-93dc51e1081a" returned: 0 in 0.407s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-23432e0b-d17d-496c-92fd-b5a11d61c50e tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:29 devstack sudo[100396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282.info Aug 10 12:55:29 devstack sudo[100396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:29 devstack sudo[100396]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-23432e0b-d17d-496c-92fd-b5a11d61c50e tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282.info" returned: 0 in 0.370s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:29 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-23432e0b-d17d-496c-92fd-b5a11d61c50e tempest-VolumesSnapshotTestJSON-1685907550 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282.info is being set with open permissions: ugo+rw Aug 10 12:55:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-23432e0b-d17d-496c-92fd-b5a11d61c50e tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:29 devstack sudo[100411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282.info Aug 10 12:55:29 devstack sudo[100411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:30 devstack sudo[100411]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-23432e0b-d17d-496c-92fd-b5a11d61c50e tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282.info" returned: 0 in 0.404s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-23432e0b-d17d-496c-92fd-b5a11d61c50e tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.439s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:55:30 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-23432e0b-d17d-496c-92fd-b5a11d61c50e tempest-VolumesSnapshotTestJSON-1685907550 None] Create snapshot completed successfully Aug 10 12:55:32 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:55:32 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Flow 'volume_create_manager' (83248f0c-b31a-4ac0-94a8-689b85dc982f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:55:32 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8307bce-186f-49a3-8578-204312c5ce35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:32 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8307bce-186f-49a3-8578-204312c5ce35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-110640225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f18d362-8c43-44c9-968d-a12f6f7d5940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1639df2f701d4ea49b53d1a78918feb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ba577b47-7ff7-4e71-8bb3-93dc51e1081a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:55:32Z,use_quota=True,user_id='9399cf74bc9e487c9b1d7f123b3913af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:32 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (402cefaa-85c1-438c-818e-2294937a643a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:32 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (402cefaa-85c1-438c-818e-2294937a643a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:32 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13f63ac-1dff-48d9-bcc1-ad3d6e5dafbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:32 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13f63ac-1dff-48d9-bcc1-ad3d6e5dafbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2f18d362-8c43-44c9-968d-a12f6f7d5940', 'volume_name': 'volume-2f18d362-8c43-44c9-968d-a12f6f7d5940', 'volume_size': 1, 'snapshot_id': 'ba577b47-7ff7-4e71-8bb3-93dc51e1081a'}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:32 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db0ea293-642c-489a-bd8f-145f61995a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:32 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db0ea293-642c-489a-bd8f-145f61995a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:32 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a0dbd75-3a24-4355-ae3d-725971e3ed25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:32 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Volume 2f18d362-8c43-44c9-968d-a12f6f7d5940: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2f18d362-8c43-44c9-968d-a12f6f7d5940', 'volume_size': 1, 'snapshot_id': 'ba577b47-7ff7-4e71-8bb3-93dc51e1081a'} Aug 10 12:55:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:55:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:55:32 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "cinder-quobyte-ba577b47-7ff7-4e71-8bb3-93dc51e1081a-2f18d362-8c43-44c9-968d-a12f6f7d5940" by "_create_volume_from_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:55:32 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-quobyte-ba577b47-7ff7-4e71-8bb3-93dc51e1081a-2f18d362-8c43-44c9-968d-a12f6f7d5940" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:55:32 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Creating volume 2f18d362-8c43-44c9-968d-a12f6f7d5940 from snapshot ba577b47-7ff7-4e71-8bb3-93dc51e1081a {{(pid=89096) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 10 12:55:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:55:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:55:32 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:55:32 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:55:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:55:32 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:55:32 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "cinder-quobyte-2f18d362-8c43-44c9-968d-a12f6f7d5940" by "_copy_volume_from_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:55:32 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-quobyte-2f18d362-8c43-44c9-968d-a12f6f7d5940" acquired by "_copy_volume_from_snapshot" :: waited 0.051s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:55:32 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] snapshot: ba577b47-7ff7-4e71-8bb3-93dc51e1081a, volume: 2f18d362-8c43-44c9-968d-a12f6f7d5940, {{(pid=89096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 10 12:55:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:55:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:55:32 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:55:32 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:55:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:55:32 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0947453-9a7f-40e9-bf59-f33bf93a7e3c]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:55:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282.ba577b47-7ff7-4e71-8bb3-93dc51e1081a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:32 devstack sudo[100458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282.ba577b47-7ff7-4e71-8bb3-93dc51e1081a Aug 10 12:55:32 devstack sudo[100458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:33 devstack sudo[100458]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282.ba577b47-7ff7-4e71-8bb3-93dc51e1081a" returned: 0 in 0.883s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:33 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 12:55:33 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83260d0-82af-4bf0-b26e-b6dd5251de0b]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:55:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:33 devstack sudo[100483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282 Aug 10 12:55:33 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:34 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282" returned: 0 in 0.715s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:34 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282 {{(pid=89096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 10 12:55:34 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Creating direct copy from snapshot {{(pid=89096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 10 12:55:34 devstack cinder-volume[89096]: DEBUG cinder.utils [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Path /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2f18d362-8c43-44c9-968d-a12f6f7d5940 not found in is_blk_device check {{(pid=89096) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 10 12:55:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2f18d362-8c43-44c9-968d-a12f6f7d5940 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:34 devstack sudo[100508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2f18d362-8c43-44c9-968d-a12f6f7d5940 Aug 10 12:55:34 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:42 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=13,cinder:INSERT=2,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:55:42 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=14,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:55:44 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2f18d362-8c43-44c9-968d-a12f6f7d5940" returned: 0 in 10.367s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:44 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Image conversion details: src /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282, size 1024.00 MB, duration 10.37 sec, destination /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2f18d362-8c43-44c9-968d-a12f6f7d5940 {{(pid=89096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 12:55:44 devstack cinder-volume[89096]: INFO cinder.image.image_utils [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Converted 1024.00 MB image at 98.76 MB/s Aug 10 12:55:44 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2f18d362-8c43-44c9-968d-a12f6f7d5940 is being set with open permissions: ugo+rw Aug 10 12:55:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2f18d362-8c43-44c9-968d-a12f6f7d5940 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:44 devstack sudo[100532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2f18d362-8c43-44c9-968d-a12f6f7d5940 Aug 10 12:55:44 devstack sudo[100532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:45 devstack sudo[100532]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2f18d362-8c43-44c9-968d-a12f6f7d5940" returned: 0 in 0.430s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:45 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-quobyte-2f18d362-8c43-44c9-968d-a12f6f7d5940" released by "_copy_volume_from_snapshot" :: held 12.597s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:55:45 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-quobyte-ba577b47-7ff7-4e71-8bb3-93dc51e1081a-2f18d362-8c43-44c9-968d-a12f6f7d5940" released by "_create_volume_from_snapshot" :: held 12.775s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:55:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.814s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:55:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a0dbd75-3a24-4355-ae3d-725971e3ed25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f18d362-8c43-44c9-968d-a12f6f7d5940', 'volume_size': 1, 'snapshot_id': 'ba577b47-7ff7-4e71-8bb3-93dc51e1081a'}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a76bdce-f2d0-4ce4-8535-9339d7a1540e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:45 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Volume volume-2f18d362-8c43-44c9-968d-a12f6f7d5940 (2f18d362-8c43-44c9-968d-a12f6f7d5940): created successfully Aug 10 12:55:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a76bdce-f2d0-4ce4-8535-9339d7a1540e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Flow 'volume_create_manager' (83248f0c-b31a-4ac0-94a8-689b85dc982f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:55:45 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-e2ef7b3d-9b39-4415-af82-f1c9aa30ffe8 tempest-VolumesSnapshotTestJSON-1685907550 None] Created volume successfully. Aug 10 12:55:45 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-31da447a-13a0-4ebc-be0c-456eca8445b2 tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "cinder-2f18d362-8c43-44c9-968d-a12f6f7d5940-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:55:46 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-31da447a-13a0-4ebc-be0c-456eca8445b2 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-2f18d362-8c43-44c9-968d-a12f6f7d5940-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:55:46 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-85139c3c-85c2-4707-8fb7-771424dfb5eb tempest-TestMinimumBasicScenario-252509828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:55:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-85139c3c-85c2-4707-8fb7-771424dfb5eb tempest-TestMinimumBasicScenario-252509828 None] Flow 'volume_create_manager' (a438a253-5fa0-4a84-9928-63e5beae43fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:55:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-85139c3c-85c2-4707-8fb7-771424dfb5eb tempest-TestMinimumBasicScenario-252509828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc88f14c-ef6b-4d59-8a39-f920446dca97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-85139c3c-85c2-4707-8fb7-771424dfb5eb tempest-TestMinimumBasicScenario-252509828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc88f14c-ef6b-4d59-8a39-f920446dca97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-6280465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8f3ce0e-bd03-41e1-afd1-176245b32e79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc2f7821a77471fb4d6ba52ec1524d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:55:46Z,use_quota=True,user_id='77398acb57644164a4874926b9c8d985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-85139c3c-85c2-4707-8fb7-771424dfb5eb tempest-TestMinimumBasicScenario-252509828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48cb30ac-82b4-42f3-8531-5307ff2779bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-85139c3c-85c2-4707-8fb7-771424dfb5eb tempest-TestMinimumBasicScenario-252509828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48cb30ac-82b4-42f3-8531-5307ff2779bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-85139c3c-85c2-4707-8fb7-771424dfb5eb tempest-TestMinimumBasicScenario-252509828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11afa50a-6958-4656-98ed-4f38477428e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-85139c3c-85c2-4707-8fb7-771424dfb5eb tempest-TestMinimumBasicScenario-252509828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11afa50a-6958-4656-98ed-4f38477428e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8f3ce0e-bd03-41e1-afd1-176245b32e79', 'volume_name': 'volume-c8f3ce0e-bd03-41e1-afd1-176245b32e79', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-85139c3c-85c2-4707-8fb7-771424dfb5eb tempest-TestMinimumBasicScenario-252509828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f3d4470-1530-4de4-b04d-550a46425c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-85139c3c-85c2-4707-8fb7-771424dfb5eb tempest-TestMinimumBasicScenario-252509828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f3d4470-1530-4de4-b04d-550a46425c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-85139c3c-85c2-4707-8fb7-771424dfb5eb tempest-TestMinimumBasicScenario-252509828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a9b378-6b05-41d4-a77e-d38748f5a0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:46 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-85139c3c-85c2-4707-8fb7-771424dfb5eb tempest-TestMinimumBasicScenario-252509828 None] Volume c8f3ce0e-bd03-41e1-afd1-176245b32e79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8f3ce0e-bd03-41e1-afd1-176245b32e79', 'volume_size': 1} Aug 10 12:55:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-85139c3c-85c2-4707-8fb7-771424dfb5eb tempest-TestMinimumBasicScenario-252509828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:55:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-85139c3c-85c2-4707-8fb7-771424dfb5eb tempest-TestMinimumBasicScenario-252509828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:55:46 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-85139c3c-85c2-4707-8fb7-771424dfb5eb tempest-TestMinimumBasicScenario-252509828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-6280465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8f3ce0e-bd03-41e1-afd1-176245b32e79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc2f7821a77471fb4d6ba52ec1524d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:55:46Z,use_quota=True,user_id='77398acb57644164a4874926b9c8d985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:55:46 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-85139c3c-85c2-4707-8fb7-771424dfb5eb tempest-TestMinimumBasicScenario-252509828 None] Creating volume c8f3ce0e-bd03-41e1-afd1-176245b32e79 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:55:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-85139c3c-85c2-4707-8fb7-771424dfb5eb tempest-TestMinimumBasicScenario-252509828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:55:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-85139c3c-85c2-4707-8fb7-771424dfb5eb tempest-TestMinimumBasicScenario-252509828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:55:46 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-85139c3c-85c2-4707-8fb7-771424dfb5eb tempest-TestMinimumBasicScenario-252509828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:55:46 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-85139c3c-85c2-4707-8fb7-771424dfb5eb tempest-TestMinimumBasicScenario-252509828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:55:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-85139c3c-85c2-4707-8fb7-771424dfb5eb tempest-TestMinimumBasicScenario-252509828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:55:46 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-85139c3c-85c2-4707-8fb7-771424dfb5eb tempest-TestMinimumBasicScenario-252509828 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:55:46 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-85139c3c-85c2-4707-8fb7-771424dfb5eb tempest-TestMinimumBasicScenario-252509828 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:55:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-85139c3c-85c2-4707-8fb7-771424dfb5eb tempest-TestMinimumBasicScenario-252509828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c8f3ce0e-bd03-41e1-afd1-176245b32e79 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:46 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c8f3ce0e-bd03-41e1-afd1-176245b32e79 1073741824 Aug 10 12:55:46 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:46 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-31da447a-13a0-4ebc-be0c-456eca8445b2 tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "cinder-quobyte-2f18d362-8c43-44c9-968d-a12f6f7d5940" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:55:46 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-31da447a-13a0-4ebc-be0c-456eca8445b2 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-quobyte-2f18d362-8c43-44c9-968d-a12f6f7d5940" acquired by "delete_volume" :: waited 0.041s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:55:46 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5067a5-86a3-4c8c-87ff-098a0cb1f2fe]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:55:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-31da447a-13a0-4ebc-be0c-456eca8445b2 tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2f18d362-8c43-44c9-968d-a12f6f7d5940 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:46 devstack sudo[100537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2f18d362-8c43-44c9-968d-a12f6f7d5940 Aug 10 12:55:46 devstack sudo[100537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:47 devstack sudo[100537]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-31da447a-13a0-4ebc-be0c-456eca8445b2 tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2f18d362-8c43-44c9-968d-a12f6f7d5940" returned: 0 in 0.605s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-31da447a-13a0-4ebc-be0c-456eca8445b2 tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2f18d362-8c43-44c9-968d-a12f6f7d5940 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:47 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-85139c3c-85c2-4707-8fb7-771424dfb5eb tempest-TestMinimumBasicScenario-252509828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c8f3ce0e-bd03-41e1-afd1-176245b32e79 1073741824" returned: 0 in 0.891s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:47 devstack sudo[100570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2f18d362-8c43-44c9-968d-a12f6f7d5940 Aug 10 12:55:47 devstack sudo[100570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-85139c3c-85c2-4707-8fb7-771424dfb5eb tempest-TestMinimumBasicScenario-252509828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c8f3ce0e-bd03-41e1-afd1-176245b32e79 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:47 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c8f3ce0e-bd03-41e1-afd1-176245b32e79 Aug 10 12:55:47 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:47 devstack sudo[100570]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-31da447a-13a0-4ebc-be0c-456eca8445b2 tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2f18d362-8c43-44c9-968d-a12f6f7d5940" returned: 0 in 0.451s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:47 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-31da447a-13a0-4ebc-be0c-456eca8445b2 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-quobyte-2f18d362-8c43-44c9-968d-a12f6f7d5940" released by "delete_volume" :: held 1.158s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:55:47 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-31da447a-13a0-4ebc-be0c-456eca8445b2 tempest-VolumesSnapshotTestJSON-1685907550 None] Created reservations ['147213fc-1b73-4ec5-8ae7-6602bee74890', '4bf2a7ec-1f01-4edc-b1e7-f2ef384ef56c', 'ff227d38-bca5-4307-b95d-1cc8516c41d5', '666ef3f7-171e-44d1-94b7-8be81d4fa3f8'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:55:47 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-85139c3c-85c2-4707-8fb7-771424dfb5eb tempest-TestMinimumBasicScenario-252509828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c8f3ce0e-bd03-41e1-afd1-176245b32e79" returned: 0 in 0.498s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:47 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-85139c3c-85c2-4707-8fb7-771424dfb5eb tempest-TestMinimumBasicScenario-252509828 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:55:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-85139c3c-85c2-4707-8fb7-771424dfb5eb tempest-TestMinimumBasicScenario-252509828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:55:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-85139c3c-85c2-4707-8fb7-771424dfb5eb tempest-TestMinimumBasicScenario-252509828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a9b378-6b05-41d4-a77e-d38748f5a0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8f3ce0e-bd03-41e1-afd1-176245b32e79', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-85139c3c-85c2-4707-8fb7-771424dfb5eb tempest-TestMinimumBasicScenario-252509828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbc5b638-5b07-48ee-9b29-247ab0581858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:47 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-85139c3c-85c2-4707-8fb7-771424dfb5eb tempest-TestMinimumBasicScenario-252509828 None] Volume volume-c8f3ce0e-bd03-41e1-afd1-176245b32e79 (c8f3ce0e-bd03-41e1-afd1-176245b32e79): created successfully Aug 10 12:55:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-85139c3c-85c2-4707-8fb7-771424dfb5eb tempest-TestMinimumBasicScenario-252509828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbc5b638-5b07-48ee-9b29-247ab0581858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-85139c3c-85c2-4707-8fb7-771424dfb5eb tempest-TestMinimumBasicScenario-252509828 None] Flow 'volume_create_manager' (a438a253-5fa0-4a84-9928-63e5beae43fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:55:47 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-85139c3c-85c2-4707-8fb7-771424dfb5eb tempest-TestMinimumBasicScenario-252509828 None] Created volume successfully. Aug 10 12:55:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-31da447a-13a0-4ebc-be0c-456eca8445b2 tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:55:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-31da447a-13a0-4ebc-be0c-456eca8445b2 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:55:47 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-31da447a-13a0-4ebc-be0c-456eca8445b2 tempest-VolumesSnapshotTestJSON-1685907550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:55:47 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-31da447a-13a0-4ebc-be0c-456eca8445b2 tempest-VolumesSnapshotTestJSON-1685907550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:55:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-31da447a-13a0-4ebc-be0c-456eca8445b2 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:55:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-31da447a-13a0-4ebc-be0c-456eca8445b2 tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:47 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:55:47 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:48 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-31da447a-13a0-4ebc-be0c-456eca8445b2 tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.290s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:48 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-31da447a-13a0-4ebc-be0c-456eca8445b2 tempest-VolumesSnapshotTestJSON-1685907550 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:55:48 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-31da447a-13a0-4ebc-be0c-456eca8445b2 tempest-VolumesSnapshotTestJSON-1685907550 None] Deleted volume successfully. Aug 10 12:55:48 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-31da447a-13a0-4ebc-be0c-456eca8445b2 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-2f18d362-8c43-44c9-968d-a12f6f7d5940-delete_volume" released by "delete_volume" :: held 2.135s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:55:48 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-033b710f-687c-423a-806a-25fb9d162712 tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "cinder-ba577b47-7ff7-4e71-8bb3-93dc51e1081a-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:55:48 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-033b710f-687c-423a-806a-25fb9d162712 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-ba577b47-7ff7-4e71-8bb3-93dc51e1081a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:55:48 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-033b710f-687c-423a-806a-25fb9d162712 tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "cinder-quobyte-0a3e0ccc-0862-45a0-8b79-5d5c996df282" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:55:48 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-033b710f-687c-423a-806a-25fb9d162712 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-quobyte-0a3e0ccc-0862-45a0-8b79-5d5c996df282" acquired by "delete_snapshot" :: waited 0.033s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:55:48 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-033b710f-687c-423a-806a-25fb9d162712 tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "cinder-quobyte-ba577b47-7ff7-4e71-8bb3-93dc51e1081a" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:55:48 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-033b710f-687c-423a-806a-25fb9d162712 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-quobyte-ba577b47-7ff7-4e71-8bb3-93dc51e1081a" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:55:48 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-033b710f-687c-423a-806a-25fb9d162712 tempest-VolumesSnapshotTestJSON-1685907550 None] Deleting offline snapshot ba577b47-7ff7-4e71-8bb3-93dc51e1081a of volume 0a3e0ccc-0862-45a0-8b79-5d5c996df282 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 12:55:48 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-033b710f-687c-423a-806a-25fb9d162712 tempest-VolumesSnapshotTestJSON-1685907550 None] snapshot_file for this snap is: volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282.ba577b47-7ff7-4e71-8bb3-93dc51e1081a {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 12:55:48 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2ee9fb-cd1f-45fb-b9bc-04e4a6f684d3]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:55:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-033b710f-687c-423a-806a-25fb9d162712 tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282.ba577b47-7ff7-4e71-8bb3-93dc51e1081a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:48 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282.ba577b47-7ff7-4e71-8bb3-93dc51e1081a Aug 10 12:55:48 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:49 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-033b710f-687c-423a-806a-25fb9d162712 tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282.ba577b47-7ff7-4e71-8bb3-93dc51e1081a" returned: 0 in 0.836s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:49 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-033b710f-687c-423a-806a-25fb9d162712 tempest-VolumesSnapshotTestJSON-1685907550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 12:55:49 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54711ca-2012-4b24-946f-aeee279085ab]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:55:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-033b710f-687c-423a-806a-25fb9d162712 tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:49 devstack sudo[100596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282 Aug 10 12:55:49 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-33a6a468-09ea-4b8d-920b-5d39813a3f06 req-aace72c6-ff44-4df8-918c-f538e520382d tempest-TestMinimumBasicScenario-252509828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:55:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-33a6a468-09ea-4b8d-920b-5d39813a3f06 req-aace72c6-ff44-4df8-918c-f538e520382d tempest-TestMinimumBasicScenario-252509828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:55:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-33a6a468-09ea-4b8d-920b-5d39813a3f06 req-aace72c6-ff44-4df8-918c-f538e520382d tempest-TestMinimumBasicScenario-252509828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:55:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-33a6a468-09ea-4b8d-920b-5d39813a3f06 req-aace72c6-ff44-4df8-918c-f538e520382d tempest-TestMinimumBasicScenario-252509828 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d', 'name': 'volume-c8f3ce0e-bd03-41e1-afd1-176245b32e79', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8fec807d-0ab8-4143-af97-9379e9e503c4', 'enforce_multipath': True} {{(pid=89096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Aug 10 12:55:50 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-33a6a468-09ea-4b8d-920b-5d39813a3f06 req-aace72c6-ff44-4df8-918c-f538e520382d tempest-TestMinimumBasicScenario-252509828 None] attachment_update completed successfully. Aug 10 12:55:50 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-033b710f-687c-423a-806a-25fb9d162712 tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282" returned: 0 in 0.680s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-033b710f-687c-423a-806a-25fb9d162712 tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282.ba577b47-7ff7-4e71-8bb3-93dc51e1081a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:50 devstack sudo[100601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282.ba577b47-7ff7-4e71-8bb3-93dc51e1081a Aug 10 12:55:50 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:50 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-033b710f-687c-423a-806a-25fb9d162712 tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282.ba577b47-7ff7-4e71-8bb3-93dc51e1081a" returned: 0 in 0.574s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-033b710f-687c-423a-806a-25fb9d162712 tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282.ba577b47-7ff7-4e71-8bb3-93dc51e1081a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:50 devstack sudo[100611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282.ba577b47-7ff7-4e71-8bb3-93dc51e1081a Aug 10 12:55:50 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:51 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-62b9e96d-7b44-47c8-97c5-d12545707afd tempest-CreateVolumesFromImageTest-1468854996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:55:51 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-62b9e96d-7b44-47c8-97c5-d12545707afd tempest-CreateVolumesFromImageTest-1468854996 None] Flow 'volume_create_manager' (3270c9a0-f14a-4a7e-8340-48edd7a9d73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:55:51 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-62b9e96d-7b44-47c8-97c5-d12545707afd tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dba4643b-1370-41be-b9ad-384aa22eb7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:51 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-62b9e96d-7b44-47c8-97c5-d12545707afd tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dba4643b-1370-41be-b9ad-384aa22eb7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1366834840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eb447c9-d737-4577-9474-3ffba8eb8fe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='109b294a80734813bee0595d60d238f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:55:51Z,use_quota=True,user_id='eee19226d90f4eb699d2cdeacb451f5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:51 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-62b9e96d-7b44-47c8-97c5-d12545707afd tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1110b08d-c3b7-4935-a45c-9261841c6276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:51 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-62b9e96d-7b44-47c8-97c5-d12545707afd tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1110b08d-c3b7-4935-a45c-9261841c6276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:51 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-62b9e96d-7b44-47c8-97c5-d12545707afd tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd25b56c-2ef1-4d88-9f67-b4720daa6523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:51 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-62b9e96d-7b44-47c8-97c5-d12545707afd tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd25b56c-2ef1-4d88-9f67-b4720daa6523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0eb447c9-d737-4577-9474-3ffba8eb8fe6', 'volume_name': 'volume-0eb447c9-d737-4577-9474-3ffba8eb8fe6', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:51 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-62b9e96d-7b44-47c8-97c5-d12545707afd tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc511cf4-fcbe-41c4-b0d6-a3f822a4f775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:51 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-62b9e96d-7b44-47c8-97c5-d12545707afd tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc511cf4-fcbe-41c4-b0d6-a3f822a4f775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:51 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-62b9e96d-7b44-47c8-97c5-d12545707afd tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb58027c-b8ab-42e2-9655-05dd4b0ad053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:51 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-62b9e96d-7b44-47c8-97c5-d12545707afd tempest-CreateVolumesFromImageTest-1468854996 None] Volume 0eb447c9-d737-4577-9474-3ffba8eb8fe6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0eb447c9-d737-4577-9474-3ffba8eb8fe6', 'volume_size': 1} Aug 10 12:55:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-62b9e96d-7b44-47c8-97c5-d12545707afd tempest-CreateVolumesFromImageTest-1468854996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:55:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-62b9e96d-7b44-47c8-97c5-d12545707afd tempest-CreateVolumesFromImageTest-1468854996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:55:51 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-62b9e96d-7b44-47c8-97c5-d12545707afd tempest-CreateVolumesFromImageTest-1468854996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1366834840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eb447c9-d737-4577-9474-3ffba8eb8fe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='109b294a80734813bee0595d60d238f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:55:51Z,use_quota=True,user_id='eee19226d90f4eb699d2cdeacb451f5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:55:51 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-62b9e96d-7b44-47c8-97c5-d12545707afd tempest-CreateVolumesFromImageTest-1468854996 None] Creating volume 0eb447c9-d737-4577-9474-3ffba8eb8fe6 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:55:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-62b9e96d-7b44-47c8-97c5-d12545707afd tempest-CreateVolumesFromImageTest-1468854996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:55:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-62b9e96d-7b44-47c8-97c5-d12545707afd tempest-CreateVolumesFromImageTest-1468854996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:55:51 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-62b9e96d-7b44-47c8-97c5-d12545707afd tempest-CreateVolumesFromImageTest-1468854996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:55:51 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-62b9e96d-7b44-47c8-97c5-d12545707afd tempest-CreateVolumesFromImageTest-1468854996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:55:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-62b9e96d-7b44-47c8-97c5-d12545707afd tempest-CreateVolumesFromImageTest-1468854996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:55:51 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-62b9e96d-7b44-47c8-97c5-d12545707afd tempest-CreateVolumesFromImageTest-1468854996 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:55:51 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-62b9e96d-7b44-47c8-97c5-d12545707afd tempest-CreateVolumesFromImageTest-1468854996 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:55:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-62b9e96d-7b44-47c8-97c5-d12545707afd tempest-CreateVolumesFromImageTest-1468854996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0eb447c9-d737-4577-9474-3ffba8eb8fe6 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:51 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0eb447c9-d737-4577-9474-3ffba8eb8fe6 1073741824 Aug 10 12:55:51 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:51 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-033b710f-687c-423a-806a-25fb9d162712 tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282.ba577b47-7ff7-4e71-8bb3-93dc51e1081a" returned: 0 in 0.759s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:51 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-033b710f-687c-423a-806a-25fb9d162712 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-quobyte-ba577b47-7ff7-4e71-8bb3-93dc51e1081a" released by "_delete_snapshot" :: held 3.146s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:55:51 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-033b710f-687c-423a-806a-25fb9d162712 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-quobyte-0a3e0ccc-0862-45a0-8b79-5d5c996df282" released by "delete_snapshot" :: held 3.218s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:55:52 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-033b710f-687c-423a-806a-25fb9d162712 tempest-VolumesSnapshotTestJSON-1685907550 None] Created reservations ['ab814ae5-d4c7-4764-8c77-47a2af8964d9', 'c9432687-467d-45c4-a788-8e3e3ce0b696', '8e800264-69b4-4fcf-b126-4ebb4425cc9a', '64d65851-9fdb-425c-8e97-8c5d3b249c2f'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:55:52 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-64580d88-b95b-4091-b68a-6f05a5a4b8cb tempest-CreateVolumesFromImageTest-1468854996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:55:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-64580d88-b95b-4091-b68a-6f05a5a4b8cb tempest-CreateVolumesFromImageTest-1468854996 None] Flow 'volume_create_manager' (7ad3f84e-f6a0-4993-b593-495c983b9bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:55:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-64580d88-b95b-4091-b68a-6f05a5a4b8cb tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6915072d-c24b-4594-8d30-087bab604c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-64580d88-b95b-4091-b68a-6f05a5a4b8cb tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6915072d-c24b-4594-8d30-087bab604c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1301285251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b079c0f-5f5c-420a-a415-4e88efa8666e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='109b294a80734813bee0595d60d238f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:55:52Z,use_quota=True,user_id='eee19226d90f4eb699d2cdeacb451f5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-64580d88-b95b-4091-b68a-6f05a5a4b8cb tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e836e05e-2b17-4831-ad80-691412ba04e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-64580d88-b95b-4091-b68a-6f05a5a4b8cb tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e836e05e-2b17-4831-ad80-691412ba04e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-64580d88-b95b-4091-b68a-6f05a5a4b8cb tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa0903d7-c7f1-411e-b02a-4cc250ccbca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-64580d88-b95b-4091-b68a-6f05a5a4b8cb tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa0903d7-c7f1-411e-b02a-4cc250ccbca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b079c0f-5f5c-420a-a415-4e88efa8666e', 'volume_name': 'volume-5b079c0f-5f5c-420a-a415-4e88efa8666e', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-64580d88-b95b-4091-b68a-6f05a5a4b8cb tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c3cb4e6-e338-42e0-b430-a12b96385e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-64580d88-b95b-4091-b68a-6f05a5a4b8cb tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c3cb4e6-e338-42e0-b430-a12b96385e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-64580d88-b95b-4091-b68a-6f05a5a4b8cb tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (743d3db8-0423-4698-aedc-0b3dd0e7bcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:52 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-64580d88-b95b-4091-b68a-6f05a5a4b8cb tempest-CreateVolumesFromImageTest-1468854996 None] Volume 5b079c0f-5f5c-420a-a415-4e88efa8666e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b079c0f-5f5c-420a-a415-4e88efa8666e', 'volume_size': 1} Aug 10 12:55:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-64580d88-b95b-4091-b68a-6f05a5a4b8cb tempest-CreateVolumesFromImageTest-1468854996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:55:52 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-033b710f-687c-423a-806a-25fb9d162712 tempest-VolumesSnapshotTestJSON-1685907550 None] Delete snapshot completed successfully. Aug 10 12:55:52 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-033b710f-687c-423a-806a-25fb9d162712 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-ba577b47-7ff7-4e71-8bb3-93dc51e1081a-delete_snapshot" released by "delete_snapshot" :: held 3.790s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:55:52 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-62b9e96d-7b44-47c8-97c5-d12545707afd tempest-CreateVolumesFromImageTest-1468854996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0eb447c9-d737-4577-9474-3ffba8eb8fe6 1073741824" returned: 0 in 1.062s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-62b9e96d-7b44-47c8-97c5-d12545707afd tempest-CreateVolumesFromImageTest-1468854996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0eb447c9-d737-4577-9474-3ffba8eb8fe6 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:52 devstack sudo[100624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0eb447c9-d737-4577-9474-3ffba8eb8fe6 Aug 10 12:55:52 devstack sudo[100624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:52 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f1206b2-6ce5-45e5-a28e-8a7536a983bb tempest-CreateVolumesFromImageTest-1468854996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:55:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6f1206b2-6ce5-45e5-a28e-8a7536a983bb tempest-CreateVolumesFromImageTest-1468854996 None] Flow 'volume_create_manager' (45a8de61-6cb5-447d-b645-da0f7bb9507f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:55:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6f1206b2-6ce5-45e5-a28e-8a7536a983bb tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0f8923e-154f-40bd-83e7-e62410b25122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6f1206b2-6ce5-45e5-a28e-8a7536a983bb tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0f8923e-154f-40bd-83e7-e62410b25122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1230391028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48960c08-9248-4c3e-ae44-0ae2054434f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='109b294a80734813bee0595d60d238f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:55:53Z,use_quota=True,user_id='eee19226d90f4eb699d2cdeacb451f5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6f1206b2-6ce5-45e5-a28e-8a7536a983bb tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (220fe40b-c8b0-47d3-a918-9cd76ed978dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6f1206b2-6ce5-45e5-a28e-8a7536a983bb tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (220fe40b-c8b0-47d3-a918-9cd76ed978dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6f1206b2-6ce5-45e5-a28e-8a7536a983bb tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95d6bc0b-27c1-4b95-a5b2-2241c30bb279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6f1206b2-6ce5-45e5-a28e-8a7536a983bb tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95d6bc0b-27c1-4b95-a5b2-2241c30bb279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48960c08-9248-4c3e-ae44-0ae2054434f4', 'volume_name': 'volume-48960c08-9248-4c3e-ae44-0ae2054434f4', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6f1206b2-6ce5-45e5-a28e-8a7536a983bb tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d1d06db-743a-415a-978c-7cf960477faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6f1206b2-6ce5-45e5-a28e-8a7536a983bb tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d1d06db-743a-415a-978c-7cf960477faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6f1206b2-6ce5-45e5-a28e-8a7536a983bb tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (595e591c-c5b6-40d0-8e4d-a20dbb082710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:53 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-6f1206b2-6ce5-45e5-a28e-8a7536a983bb tempest-CreateVolumesFromImageTest-1468854996 None] Volume 48960c08-9248-4c3e-ae44-0ae2054434f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48960c08-9248-4c3e-ae44-0ae2054434f4', 'volume_size': 1} Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6f1206b2-6ce5-45e5-a28e-8a7536a983bb tempest-CreateVolumesFromImageTest-1468854996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:55:53 devstack sudo[100624]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-62b9e96d-7b44-47c8-97c5-d12545707afd tempest-CreateVolumesFromImageTest-1468854996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0eb447c9-d737-4577-9474-3ffba8eb8fe6" returned: 0 in 0.631s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-62b9e96d-7b44-47c8-97c5-d12545707afd tempest-CreateVolumesFromImageTest-1468854996 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-62b9e96d-7b44-47c8-97c5-d12545707afd tempest-CreateVolumesFromImageTest-1468854996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.782s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-64580d88-b95b-4091-b68a-6f05a5a4b8cb tempest-CreateVolumesFromImageTest-1468854996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.960s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-64580d88-b95b-4091-b68a-6f05a5a4b8cb tempest-CreateVolumesFromImageTest-1468854996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1301285251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b079c0f-5f5c-420a-a415-4e88efa8666e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='109b294a80734813bee0595d60d238f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:55:52Z,use_quota=True,user_id='eee19226d90f4eb699d2cdeacb451f5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-64580d88-b95b-4091-b68a-6f05a5a4b8cb tempest-CreateVolumesFromImageTest-1468854996 None] Creating volume 5b079c0f-5f5c-420a-a415-4e88efa8666e {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-64580d88-b95b-4091-b68a-6f05a5a4b8cb tempest-CreateVolumesFromImageTest-1468854996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-64580d88-b95b-4091-b68a-6f05a5a4b8cb tempest-CreateVolumesFromImageTest-1468854996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-64580d88-b95b-4091-b68a-6f05a5a4b8cb tempest-CreateVolumesFromImageTest-1468854996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-64580d88-b95b-4091-b68a-6f05a5a4b8cb tempest-CreateVolumesFromImageTest-1468854996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-64580d88-b95b-4091-b68a-6f05a5a4b8cb tempest-CreateVolumesFromImageTest-1468854996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-64580d88-b95b-4091-b68a-6f05a5a4b8cb tempest-CreateVolumesFromImageTest-1468854996 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:55:53 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-64580d88-b95b-4091-b68a-6f05a5a4b8cb tempest-CreateVolumesFromImageTest-1468854996 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-64580d88-b95b-4091-b68a-6f05a5a4b8cb tempest-CreateVolumesFromImageTest-1468854996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b079c0f-5f5c-420a-a415-4e88efa8666e 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-62b9e96d-7b44-47c8-97c5-d12545707afd tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb58027c-b8ab-42e2-9655-05dd4b0ad053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eb447c9-d737-4577-9474-3ffba8eb8fe6', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-62b9e96d-7b44-47c8-97c5-d12545707afd tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fb1d4ee-9c1a-41ae-8e29-30822aef7054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:53 devstack sudo[100647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b079c0f-5f5c-420a-a415-4e88efa8666e 1073741824 Aug 10 12:55:53 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-83a4612e-5d0b-4738-997c-a304b906ac1e tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "cinder-0a3e0ccc-0862-45a0-8b79-5d5c996df282-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:55:53 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-62b9e96d-7b44-47c8-97c5-d12545707afd tempest-CreateVolumesFromImageTest-1468854996 None] Volume volume-0eb447c9-d737-4577-9474-3ffba8eb8fe6 (0eb447c9-d737-4577-9474-3ffba8eb8fe6): created successfully Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-62b9e96d-7b44-47c8-97c5-d12545707afd tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fb1d4ee-9c1a-41ae-8e29-30822aef7054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-62b9e96d-7b44-47c8-97c5-d12545707afd tempest-CreateVolumesFromImageTest-1468854996 None] Flow 'volume_create_manager' (3270c9a0-f14a-4a7e-8340-48edd7a9d73c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:55:53 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-62b9e96d-7b44-47c8-97c5-d12545707afd tempest-CreateVolumesFromImageTest-1468854996 None] Created volume successfully. Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-83a4612e-5d0b-4738-997c-a304b906ac1e tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-0a3e0ccc-0862-45a0-8b79-5d5c996df282-delete_volume" acquired by "delete_volume" :: waited 0.130s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-83a4612e-5d0b-4738-997c-a304b906ac1e tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "cinder-quobyte-0a3e0ccc-0862-45a0-8b79-5d5c996df282" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-83a4612e-5d0b-4738-997c-a304b906ac1e tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-quobyte-0a3e0ccc-0862-45a0-8b79-5d5c996df282" acquired by "delete_volume" :: waited 0.039s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf920ab-db29-42cc-a9ec-1e9ddaf497de]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-83a4612e-5d0b-4738-997c-a304b906ac1e tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-71ed8205-49b5-47c2-8e9b-e3e7fb566561 tempest-CreateVolumesFromImageTest-1468854996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-71ed8205-49b5-47c2-8e9b-e3e7fb566561 tempest-CreateVolumesFromImageTest-1468854996 None] Flow 'volume_create_manager' (ff514f5e-15fe-4de4-9cc0-5b529fa28e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-71ed8205-49b5-47c2-8e9b-e3e7fb566561 tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abb6bf3e-0151-46e8-bc65-a984f89dced6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-71ed8205-49b5-47c2-8e9b-e3e7fb566561 tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abb6bf3e-0151-46e8-bc65-a984f89dced6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-715246428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35eac6cb-06b0-4fc4-bad6-cd3f4c437e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='109b294a80734813bee0595d60d238f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:55:54Z,use_quota=True,user_id='eee19226d90f4eb699d2cdeacb451f5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-71ed8205-49b5-47c2-8e9b-e3e7fb566561 tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5b091ad-97aa-4a91-8cab-8efd1202f1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-71ed8205-49b5-47c2-8e9b-e3e7fb566561 tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5b091ad-97aa-4a91-8cab-8efd1202f1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-71ed8205-49b5-47c2-8e9b-e3e7fb566561 tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7241101a-686d-448e-8124-20ec55d033cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-71ed8205-49b5-47c2-8e9b-e3e7fb566561 tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7241101a-686d-448e-8124-20ec55d033cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35eac6cb-06b0-4fc4-bad6-cd3f4c437e4e', 'volume_name': 'volume-35eac6cb-06b0-4fc4-bad6-cd3f4c437e4e', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:53 devstack sudo[100651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282 Aug 10 12:55:53 devstack sudo[100651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-71ed8205-49b5-47c2-8e9b-e3e7fb566561 tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93b21d0f-5250-49e4-bcaf-955e2fea7dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-71ed8205-49b5-47c2-8e9b-e3e7fb566561 tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93b21d0f-5250-49e4-bcaf-955e2fea7dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-71ed8205-49b5-47c2-8e9b-e3e7fb566561 tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce39c77-8e1f-4d8d-b96b-34ea89bc47df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:53 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-71ed8205-49b5-47c2-8e9b-e3e7fb566561 tempest-CreateVolumesFromImageTest-1468854996 None] Volume 35eac6cb-06b0-4fc4-bad6-cd3f4c437e4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35eac6cb-06b0-4fc4-bad6-cd3f4c437e4e', 'volume_size': 1} Aug 10 12:55:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-71ed8205-49b5-47c2-8e9b-e3e7fb566561 tempest-CreateVolumesFromImageTest-1468854996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:55:54 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-64580d88-b95b-4091-b68a-6f05a5a4b8cb tempest-CreateVolumesFromImageTest-1468854996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b079c0f-5f5c-420a-a415-4e88efa8666e 1073741824" returned: 0 in 0.983s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d41ae78-09ae-4f32-bee9-e4299dcc2b9d tempest-CreateVolumesFromImageTest-1468854996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6d41ae78-09ae-4f32-bee9-e4299dcc2b9d tempest-CreateVolumesFromImageTest-1468854996 None] Flow 'volume_create_manager' (ceef31da-1081-4a57-9ba2-7904f53bebc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6d41ae78-09ae-4f32-bee9-e4299dcc2b9d tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f99071b4-a754-4484-af77-c2ed4798544b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:54 devstack sudo[100651]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6d41ae78-09ae-4f32-bee9-e4299dcc2b9d tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f99071b4-a754-4484-af77-c2ed4798544b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1738560147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fc7a6b2-2380-4c6d-b3e8-e8118d07241d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='109b294a80734813bee0595d60d238f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:55:54Z,use_quota=True,user_id='eee19226d90f4eb699d2cdeacb451f5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6d41ae78-09ae-4f32-bee9-e4299dcc2b9d tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8adff6c7-c41d-41a0-8f52-eba62cabd414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6d41ae78-09ae-4f32-bee9-e4299dcc2b9d tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8adff6c7-c41d-41a0-8f52-eba62cabd414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6d41ae78-09ae-4f32-bee9-e4299dcc2b9d tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (606ed3c7-bfb8-4bb7-87a3-bc1fa27f320a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6d41ae78-09ae-4f32-bee9-e4299dcc2b9d tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (606ed3c7-bfb8-4bb7-87a3-bc1fa27f320a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fc7a6b2-2380-4c6d-b3e8-e8118d07241d', 'volume_name': 'volume-4fc7a6b2-2380-4c6d-b3e8-e8118d07241d', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6d41ae78-09ae-4f32-bee9-e4299dcc2b9d tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0006a3c3-9cb6-4533-96d3-6862a3bbd1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6d41ae78-09ae-4f32-bee9-e4299dcc2b9d tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0006a3c3-9cb6-4533-96d3-6862a3bbd1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6d41ae78-09ae-4f32-bee9-e4299dcc2b9d tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f604632-9b26-4b2d-99cf-2d328b8db601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:54 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-6d41ae78-09ae-4f32-bee9-e4299dcc2b9d tempest-CreateVolumesFromImageTest-1468854996 None] Volume 4fc7a6b2-2380-4c6d-b3e8-e8118d07241d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fc7a6b2-2380-4c6d-b3e8-e8118d07241d', 'volume_size': 1} Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6d41ae78-09ae-4f32-bee9-e4299dcc2b9d tempest-CreateVolumesFromImageTest-1468854996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-83a4612e-5d0b-4738-997c-a304b906ac1e tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282" returned: 0 in 0.606s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-83a4612e-5d0b-4738-997c-a304b906ac1e tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-64580d88-b95b-4091-b68a-6f05a5a4b8cb tempest-CreateVolumesFromImageTest-1468854996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b079c0f-5f5c-420a-a415-4e88efa8666e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:54 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282 Aug 10 12:55:54 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:54 devstack sudo[100658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b079c0f-5f5c-420a-a415-4e88efa8666e Aug 10 12:55:54 devstack sudo[100658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:54 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-83a4612e-5d0b-4738-997c-a304b906ac1e tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0a3e0ccc-0862-45a0-8b79-5d5c996df282" returned: 0 in 0.266s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-83a4612e-5d0b-4738-997c-a304b906ac1e tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-quobyte-0a3e0ccc-0862-45a0-8b79-5d5c996df282" released by "delete_volume" :: held 0.999s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:55:54 devstack sudo[100658]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-64580d88-b95b-4091-b68a-6f05a5a4b8cb tempest-CreateVolumesFromImageTest-1468854996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b079c0f-5f5c-420a-a415-4e88efa8666e" returned: 0 in 0.279s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-64580d88-b95b-4091-b68a-6f05a5a4b8cb tempest-CreateVolumesFromImageTest-1468854996 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-64580d88-b95b-4091-b68a-6f05a5a4b8cb tempest-CreateVolumesFromImageTest-1468854996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6f1206b2-6ce5-45e5-a28e-8a7536a983bb tempest-CreateVolumesFromImageTest-1468854996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.531s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6f1206b2-6ce5-45e5-a28e-8a7536a983bb tempest-CreateVolumesFromImageTest-1468854996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1230391028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48960c08-9248-4c3e-ae44-0ae2054434f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='109b294a80734813bee0595d60d238f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:55:53Z,use_quota=True,user_id='eee19226d90f4eb699d2cdeacb451f5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-6f1206b2-6ce5-45e5-a28e-8a7536a983bb tempest-CreateVolumesFromImageTest-1468854996 None] Creating volume 48960c08-9248-4c3e-ae44-0ae2054434f4 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6f1206b2-6ce5-45e5-a28e-8a7536a983bb tempest-CreateVolumesFromImageTest-1468854996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6f1206b2-6ce5-45e5-a28e-8a7536a983bb tempest-CreateVolumesFromImageTest-1468854996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6f1206b2-6ce5-45e5-a28e-8a7536a983bb tempest-CreateVolumesFromImageTest-1468854996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6f1206b2-6ce5-45e5-a28e-8a7536a983bb tempest-CreateVolumesFromImageTest-1468854996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6f1206b2-6ce5-45e5-a28e-8a7536a983bb tempest-CreateVolumesFromImageTest-1468854996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6f1206b2-6ce5-45e5-a28e-8a7536a983bb tempest-CreateVolumesFromImageTest-1468854996 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:55:54 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-6f1206b2-6ce5-45e5-a28e-8a7536a983bb tempest-CreateVolumesFromImageTest-1468854996 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6f1206b2-6ce5-45e5-a28e-8a7536a983bb tempest-CreateVolumesFromImageTest-1468854996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-48960c08-9248-4c3e-ae44-0ae2054434f4 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:54 devstack sudo[100663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-48960c08-9248-4c3e-ae44-0ae2054434f4 1073741824 Aug 10 12:55:54 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-64580d88-b95b-4091-b68a-6f05a5a4b8cb tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (743d3db8-0423-4698-aedc-0b3dd0e7bcd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b079c0f-5f5c-420a-a415-4e88efa8666e', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-64580d88-b95b-4091-b68a-6f05a5a4b8cb tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6be98774-9b89-4c73-9452-a8a95881dae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:54 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-64580d88-b95b-4091-b68a-6f05a5a4b8cb tempest-CreateVolumesFromImageTest-1468854996 None] Volume volume-5b079c0f-5f5c-420a-a415-4e88efa8666e (5b079c0f-5f5c-420a-a415-4e88efa8666e): created successfully Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-64580d88-b95b-4091-b68a-6f05a5a4b8cb tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6be98774-9b89-4c73-9452-a8a95881dae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-64580d88-b95b-4091-b68a-6f05a5a4b8cb tempest-CreateVolumesFromImageTest-1468854996 None] Flow 'volume_create_manager' (7ad3f84e-f6a0-4993-b593-495c983b9bd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:55:54 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-64580d88-b95b-4091-b68a-6f05a5a4b8cb tempest-CreateVolumesFromImageTest-1468854996 None] Created volume successfully. Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-83a4612e-5d0b-4738-997c-a304b906ac1e tempest-VolumesSnapshotTestJSON-1685907550 None] Created reservations ['9fae3644-c889-46aa-9362-1300d1c38e29', '59d099fb-1d7c-47e0-8c42-b1ba84275c7f', '58f5a04e-9778-4d3c-bb72-2cf380f19070', '3b5416ca-8ed5-4ff4-b9ab-5a255b17b635'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-83a4612e-5d0b-4738-997c-a304b906ac1e tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-83a4612e-5d0b-4738-997c-a304b906ac1e tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-83a4612e-5d0b-4738-997c-a304b906ac1e tempest-VolumesSnapshotTestJSON-1685907550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-83a4612e-5d0b-4738-997c-a304b906ac1e tempest-VolumesSnapshotTestJSON-1685907550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-83a4612e-5d0b-4738-997c-a304b906ac1e tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:55:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-83a4612e-5d0b-4738-997c-a304b906ac1e tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:54 devstack sudo[100665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:55:54 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:55 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-83a4612e-5d0b-4738-997c-a304b906ac1e tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.286s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:55 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-83a4612e-5d0b-4738-997c-a304b906ac1e tempest-VolumesSnapshotTestJSON-1685907550 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:55:55 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-83a4612e-5d0b-4738-997c-a304b906ac1e tempest-VolumesSnapshotTestJSON-1685907550 None] Deleted volume successfully. Aug 10 12:55:55 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6f1206b2-6ce5-45e5-a28e-8a7536a983bb tempest-CreateVolumesFromImageTest-1468854996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-48960c08-9248-4c3e-ae44-0ae2054434f4 1073741824" returned: 0 in 0.463s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:55 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-83a4612e-5d0b-4738-997c-a304b906ac1e tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-0a3e0ccc-0862-45a0-8b79-5d5c996df282-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:55:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6f1206b2-6ce5-45e5-a28e-8a7536a983bb tempest-CreateVolumesFromImageTest-1468854996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-48960c08-9248-4c3e-ae44-0ae2054434f4 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:55 devstack sudo[100672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-48960c08-9248-4c3e-ae44-0ae2054434f4 Aug 10 12:55:55 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:55 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6f1206b2-6ce5-45e5-a28e-8a7536a983bb tempest-CreateVolumesFromImageTest-1468854996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-48960c08-9248-4c3e-ae44-0ae2054434f4" returned: 0 in 0.274s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:55 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6f1206b2-6ce5-45e5-a28e-8a7536a983bb tempest-CreateVolumesFromImageTest-1468854996 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:55:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6f1206b2-6ce5-45e5-a28e-8a7536a983bb tempest-CreateVolumesFromImageTest-1468854996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:55:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-71ed8205-49b5-47c2-8e9b-e3e7fb566561 tempest-CreateVolumesFromImageTest-1468854996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.502s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:55:55 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-71ed8205-49b5-47c2-8e9b-e3e7fb566561 tempest-CreateVolumesFromImageTest-1468854996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-715246428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35eac6cb-06b0-4fc4-bad6-cd3f4c437e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='109b294a80734813bee0595d60d238f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:55:54Z,use_quota=True,user_id='eee19226d90f4eb699d2cdeacb451f5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:55:55 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-71ed8205-49b5-47c2-8e9b-e3e7fb566561 tempest-CreateVolumesFromImageTest-1468854996 None] Creating volume 35eac6cb-06b0-4fc4-bad6-cd3f4c437e4e {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:55:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-71ed8205-49b5-47c2-8e9b-e3e7fb566561 tempest-CreateVolumesFromImageTest-1468854996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:55:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-71ed8205-49b5-47c2-8e9b-e3e7fb566561 tempest-CreateVolumesFromImageTest-1468854996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:55:55 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-71ed8205-49b5-47c2-8e9b-e3e7fb566561 tempest-CreateVolumesFromImageTest-1468854996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:55:55 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-71ed8205-49b5-47c2-8e9b-e3e7fb566561 tempest-CreateVolumesFromImageTest-1468854996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:55:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-71ed8205-49b5-47c2-8e9b-e3e7fb566561 tempest-CreateVolumesFromImageTest-1468854996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:55:55 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-71ed8205-49b5-47c2-8e9b-e3e7fb566561 tempest-CreateVolumesFromImageTest-1468854996 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:55:55 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-71ed8205-49b5-47c2-8e9b-e3e7fb566561 tempest-CreateVolumesFromImageTest-1468854996 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:55:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-71ed8205-49b5-47c2-8e9b-e3e7fb566561 tempest-CreateVolumesFromImageTest-1468854996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-35eac6cb-06b0-4fc4-bad6-cd3f4c437e4e 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:55 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6f1206b2-6ce5-45e5-a28e-8a7536a983bb tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (595e591c-c5b6-40d0-8e4d-a20dbb082710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48960c08-9248-4c3e-ae44-0ae2054434f4', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:55 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6f1206b2-6ce5-45e5-a28e-8a7536a983bb tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee5ae955-9c95-4c25-a34f-3ea2259b8b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:55 devstack sudo[100675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-35eac6cb-06b0-4fc4-bad6-cd3f4c437e4e 1073741824 Aug 10 12:55:55 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:55 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-6f1206b2-6ce5-45e5-a28e-8a7536a983bb tempest-CreateVolumesFromImageTest-1468854996 None] Volume volume-48960c08-9248-4c3e-ae44-0ae2054434f4 (48960c08-9248-4c3e-ae44-0ae2054434f4): created successfully Aug 10 12:55:55 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6f1206b2-6ce5-45e5-a28e-8a7536a983bb tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee5ae955-9c95-4c25-a34f-3ea2259b8b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:55 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6f1206b2-6ce5-45e5-a28e-8a7536a983bb tempest-CreateVolumesFromImageTest-1468854996 None] Flow 'volume_create_manager' (45a8de61-6cb5-447d-b645-da0f7bb9507f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:55:55 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-6f1206b2-6ce5-45e5-a28e-8a7536a983bb tempest-CreateVolumesFromImageTest-1468854996 None] Created volume successfully. Aug 10 12:55:55 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c098009d-75c9-4352-a49c-bb298117fa85 tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "cinder-a1d6b7af-2d81-461f-8984-1ce2655dd542-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:55:55 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c098009d-75c9-4352-a49c-bb298117fa85 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-a1d6b7af-2d81-461f-8984-1ce2655dd542-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:55:55 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c098009d-75c9-4352-a49c-bb298117fa85 tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "cinder-quobyte-a1d6b7af-2d81-461f-8984-1ce2655dd542" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:55:55 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c098009d-75c9-4352-a49c-bb298117fa85 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-quobyte-a1d6b7af-2d81-461f-8984-1ce2655dd542" acquired by "delete_volume" :: waited 0.021s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:55:55 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bde4918-2cf5-4e80-a942-e3d7f72c44b0]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:55:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c098009d-75c9-4352-a49c-bb298117fa85 tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:56 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-71ed8205-49b5-47c2-8e9b-e3e7fb566561 tempest-CreateVolumesFromImageTest-1468854996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-35eac6cb-06b0-4fc4-bad6-cd3f4c437e4e 1073741824" returned: 0 in 0.589s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:56 devstack sudo[100681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542 Aug 10 12:55:56 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-71ed8205-49b5-47c2-8e9b-e3e7fb566561 tempest-CreateVolumesFromImageTest-1468854996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-35eac6cb-06b0-4fc4-bad6-cd3f4c437e4e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:56 devstack sudo[100684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-35eac6cb-06b0-4fc4-bad6-cd3f4c437e4e Aug 10 12:55:56 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:56 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c098009d-75c9-4352-a49c-bb298117fa85 tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542" returned: 0 in 0.443s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c098009d-75c9-4352-a49c-bb298117fa85 tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:56 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:56 devstack sudo[100690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542 Aug 10 12:55:56 devstack sudo[100690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-71ed8205-49b5-47c2-8e9b-e3e7fb566561 tempest-CreateVolumesFromImageTest-1468854996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-35eac6cb-06b0-4fc4-bad6-cd3f4c437e4e" returned: 0 in 0.294s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:56 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-71ed8205-49b5-47c2-8e9b-e3e7fb566561 tempest-CreateVolumesFromImageTest-1468854996 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:55:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-71ed8205-49b5-47c2-8e9b-e3e7fb566561 tempest-CreateVolumesFromImageTest-1468854996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:55:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6d41ae78-09ae-4f32-bee9-e4299dcc2b9d tempest-CreateVolumesFromImageTest-1468854996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.059s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:55:56 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6d41ae78-09ae-4f32-bee9-e4299dcc2b9d tempest-CreateVolumesFromImageTest-1468854996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1738560147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fc7a6b2-2380-4c6d-b3e8-e8118d07241d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='109b294a80734813bee0595d60d238f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:55:54Z,use_quota=True,user_id='eee19226d90f4eb699d2cdeacb451f5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:55:56 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-6d41ae78-09ae-4f32-bee9-e4299dcc2b9d tempest-CreateVolumesFromImageTest-1468854996 None] Creating volume 4fc7a6b2-2380-4c6d-b3e8-e8118d07241d {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:55:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6d41ae78-09ae-4f32-bee9-e4299dcc2b9d tempest-CreateVolumesFromImageTest-1468854996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:55:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6d41ae78-09ae-4f32-bee9-e4299dcc2b9d tempest-CreateVolumesFromImageTest-1468854996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:55:56 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6d41ae78-09ae-4f32-bee9-e4299dcc2b9d tempest-CreateVolumesFromImageTest-1468854996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:55:56 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6d41ae78-09ae-4f32-bee9-e4299dcc2b9d tempest-CreateVolumesFromImageTest-1468854996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:55:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6d41ae78-09ae-4f32-bee9-e4299dcc2b9d tempest-CreateVolumesFromImageTest-1468854996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:55:56 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6d41ae78-09ae-4f32-bee9-e4299dcc2b9d tempest-CreateVolumesFromImageTest-1468854996 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:55:56 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-6d41ae78-09ae-4f32-bee9-e4299dcc2b9d tempest-CreateVolumesFromImageTest-1468854996 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:55:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6d41ae78-09ae-4f32-bee9-e4299dcc2b9d tempest-CreateVolumesFromImageTest-1468854996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4fc7a6b2-2380-4c6d-b3e8-e8118d07241d 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:56 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-71ed8205-49b5-47c2-8e9b-e3e7fb566561 tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce39c77-8e1f-4d8d-b96b-34ea89bc47df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35eac6cb-06b0-4fc4-bad6-cd3f4c437e4e', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:56 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-71ed8205-49b5-47c2-8e9b-e3e7fb566561 tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (912179cc-e387-4382-9bc2-d81384ee59b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:56 devstack sudo[100692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4fc7a6b2-2380-4c6d-b3e8-e8118d07241d 1073741824 Aug 10 12:55:56 devstack sudo[100692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:56 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-71ed8205-49b5-47c2-8e9b-e3e7fb566561 tempest-CreateVolumesFromImageTest-1468854996 None] Volume volume-35eac6cb-06b0-4fc4-bad6-cd3f4c437e4e (35eac6cb-06b0-4fc4-bad6-cd3f4c437e4e): created successfully Aug 10 12:55:56 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-71ed8205-49b5-47c2-8e9b-e3e7fb566561 tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (912179cc-e387-4382-9bc2-d81384ee59b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:56 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-71ed8205-49b5-47c2-8e9b-e3e7fb566561 tempest-CreateVolumesFromImageTest-1468854996 None] Flow 'volume_create_manager' (ff514f5e-15fe-4de4-9cc0-5b529fa28e2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:55:56 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-71ed8205-49b5-47c2-8e9b-e3e7fb566561 tempest-CreateVolumesFromImageTest-1468854996 None] Created volume successfully. Aug 10 12:55:56 devstack sudo[100690]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c098009d-75c9-4352-a49c-bb298117fa85 tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a1d6b7af-2d81-461f-8984-1ce2655dd542" returned: 0 in 0.343s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:56 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c098009d-75c9-4352-a49c-bb298117fa85 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-quobyte-a1d6b7af-2d81-461f-8984-1ce2655dd542" released by "delete_volume" :: held 0.867s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:55:56 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-c098009d-75c9-4352-a49c-bb298117fa85 tempest-VolumesSnapshotTestJSON-1685907550 None] Created reservations ['fbd445f4-ef0c-47f0-a57f-b78028c8c28e', 'f40b8c7f-6af1-432d-b878-f465f9bb7e10', '2d9169f4-718a-4626-81b5-b4335b9efb10', 'd282e2bb-af39-4b3e-bac1-f1bc3eae1122'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:55:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c098009d-75c9-4352-a49c-bb298117fa85 tempest-VolumesSnapshotTestJSON-1685907550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:55:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c098009d-75c9-4352-a49c-bb298117fa85 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:55:56 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c098009d-75c9-4352-a49c-bb298117fa85 tempest-VolumesSnapshotTestJSON-1685907550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:55:56 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c098009d-75c9-4352-a49c-bb298117fa85 tempest-VolumesSnapshotTestJSON-1685907550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:55:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c098009d-75c9-4352-a49c-bb298117fa85 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:55:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c098009d-75c9-4352-a49c-bb298117fa85 tempest-VolumesSnapshotTestJSON-1685907550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:56 devstack sudo[100700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:55:56 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:57 devstack sudo[100692]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6d41ae78-09ae-4f32-bee9-e4299dcc2b9d tempest-CreateVolumesFromImageTest-1468854996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4fc7a6b2-2380-4c6d-b3e8-e8118d07241d 1073741824" returned: 0 in 0.604s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6d41ae78-09ae-4f32-bee9-e4299dcc2b9d tempest-CreateVolumesFromImageTest-1468854996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4fc7a6b2-2380-4c6d-b3e8-e8118d07241d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:57 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4fc7a6b2-2380-4c6d-b3e8-e8118d07241d Aug 10 12:55:57 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:57 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c098009d-75c9-4352-a49c-bb298117fa85 tempest-VolumesSnapshotTestJSON-1685907550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.308s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:57 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-c098009d-75c9-4352-a49c-bb298117fa85 tempest-VolumesSnapshotTestJSON-1685907550 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:55:57 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-c098009d-75c9-4352-a49c-bb298117fa85 tempest-VolumesSnapshotTestJSON-1685907550 None] Deleted volume successfully. Aug 10 12:55:57 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c098009d-75c9-4352-a49c-bb298117fa85 tempest-VolumesSnapshotTestJSON-1685907550 None] Lock "cinder-a1d6b7af-2d81-461f-8984-1ce2655dd542-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:55:57 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6d41ae78-09ae-4f32-bee9-e4299dcc2b9d tempest-CreateVolumesFromImageTest-1468854996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4fc7a6b2-2380-4c6d-b3e8-e8118d07241d" returned: 0 in 0.305s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:57 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6d41ae78-09ae-4f32-bee9-e4299dcc2b9d tempest-CreateVolumesFromImageTest-1468854996 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:55:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6d41ae78-09ae-4f32-bee9-e4299dcc2b9d tempest-CreateVolumesFromImageTest-1468854996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:55:57 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6d41ae78-09ae-4f32-bee9-e4299dcc2b9d tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f604632-9b26-4b2d-99cf-2d328b8db601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fc7a6b2-2380-4c6d-b3e8-e8118d07241d', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:57 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6d41ae78-09ae-4f32-bee9-e4299dcc2b9d tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f93988d-da1e-4b31-84ed-5c75a0984b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:55:57 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-6d41ae78-09ae-4f32-bee9-e4299dcc2b9d tempest-CreateVolumesFromImageTest-1468854996 None] Volume volume-4fc7a6b2-2380-4c6d-b3e8-e8118d07241d (4fc7a6b2-2380-4c6d-b3e8-e8118d07241d): created successfully Aug 10 12:55:57 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6d41ae78-09ae-4f32-bee9-e4299dcc2b9d tempest-CreateVolumesFromImageTest-1468854996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f93988d-da1e-4b31-84ed-5c75a0984b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:55:57 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6d41ae78-09ae-4f32-bee9-e4299dcc2b9d tempest-CreateVolumesFromImageTest-1468854996 None] Flow 'volume_create_manager' (ceef31da-1081-4a57-9ba2-7904f53bebc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:55:57 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-6d41ae78-09ae-4f32-bee9-e4299dcc2b9d tempest-CreateVolumesFromImageTest-1468854996 None] Created volume successfully. Aug 10 12:55:57 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-862725ea-04ca-4e23-995b-531dba6d7ff4 tempest-CreateVolumesFromImageTest-1468854996 None] Acquiring lock "cinder-4fc7a6b2-2380-4c6d-b3e8-e8118d07241d-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:55:57 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-862725ea-04ca-4e23-995b-531dba6d7ff4 tempest-CreateVolumesFromImageTest-1468854996 None] Lock "cinder-4fc7a6b2-2380-4c6d-b3e8-e8118d07241d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:55:57 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-862725ea-04ca-4e23-995b-531dba6d7ff4 tempest-CreateVolumesFromImageTest-1468854996 None] Acquiring lock "cinder-quobyte-4fc7a6b2-2380-4c6d-b3e8-e8118d07241d" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:55:57 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-862725ea-04ca-4e23-995b-531dba6d7ff4 tempest-CreateVolumesFromImageTest-1468854996 None] Lock "cinder-quobyte-4fc7a6b2-2380-4c6d-b3e8-e8118d07241d" acquired by "delete_volume" :: waited 0.023s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:55:57 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c9d665-13c3-4fa1-aad2-8935e6139eff]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:55:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-862725ea-04ca-4e23-995b-531dba6d7ff4 tempest-CreateVolumesFromImageTest-1468854996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4fc7a6b2-2380-4c6d-b3e8-e8118d07241d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:58 devstack sudo[100706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4fc7a6b2-2380-4c6d-b3e8-e8118d07241d Aug 10 12:55:58 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:58 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-862725ea-04ca-4e23-995b-531dba6d7ff4 tempest-CreateVolumesFromImageTest-1468854996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4fc7a6b2-2380-4c6d-b3e8-e8118d07241d" returned: 0 in 0.400s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-862725ea-04ca-4e23-995b-531dba6d7ff4 tempest-CreateVolumesFromImageTest-1468854996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4fc7a6b2-2380-4c6d-b3e8-e8118d07241d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:58 devstack sudo[100712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4fc7a6b2-2380-4c6d-b3e8-e8118d07241d Aug 10 12:55:58 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:58 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-862725ea-04ca-4e23-995b-531dba6d7ff4 tempest-CreateVolumesFromImageTest-1468854996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4fc7a6b2-2380-4c6d-b3e8-e8118d07241d" returned: 0 in 0.324s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:58 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-862725ea-04ca-4e23-995b-531dba6d7ff4 tempest-CreateVolumesFromImageTest-1468854996 None] Lock "cinder-quobyte-4fc7a6b2-2380-4c6d-b3e8-e8118d07241d" released by "delete_volume" :: held 0.806s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:55:58 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-862725ea-04ca-4e23-995b-531dba6d7ff4 tempest-CreateVolumesFromImageTest-1468854996 None] Created reservations ['f7528b18-3ff8-4409-b7bc-18d27bfab3a3', '4f9016a0-052d-48ce-94dc-623cbb4b8231', '2cd060b3-481e-4776-8ac3-a15cdf005296', '2dc4a0fd-b61e-41f2-8c66-eb6888c7449c'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:55:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-862725ea-04ca-4e23-995b-531dba6d7ff4 tempest-CreateVolumesFromImageTest-1468854996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:55:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-862725ea-04ca-4e23-995b-531dba6d7ff4 tempest-CreateVolumesFromImageTest-1468854996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:55:58 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-862725ea-04ca-4e23-995b-531dba6d7ff4 tempest-CreateVolumesFromImageTest-1468854996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:55:58 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-862725ea-04ca-4e23-995b-531dba6d7ff4 tempest-CreateVolumesFromImageTest-1468854996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:55:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-862725ea-04ca-4e23-995b-531dba6d7ff4 tempest-CreateVolumesFromImageTest-1468854996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:55:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-862725ea-04ca-4e23-995b-531dba6d7ff4 tempest-CreateVolumesFromImageTest-1468854996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:58 devstack sudo[100717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:55:58 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:58 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-bf750cdb-1666-41fc-a860-66e87ea2943a tempest-CreateVolumesFromImageTest-1468854996 None] Acquiring lock "cinder-35eac6cb-06b0-4fc4-bad6-cd3f4c437e4e-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:55:58 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-bf750cdb-1666-41fc-a860-66e87ea2943a tempest-CreateVolumesFromImageTest-1468854996 None] Lock "cinder-35eac6cb-06b0-4fc4-bad6-cd3f4c437e4e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:55:59 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-bf750cdb-1666-41fc-a860-66e87ea2943a tempest-CreateVolumesFromImageTest-1468854996 None] Acquiring lock "cinder-quobyte-35eac6cb-06b0-4fc4-bad6-cd3f4c437e4e" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:55:59 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-bf750cdb-1666-41fc-a860-66e87ea2943a tempest-CreateVolumesFromImageTest-1468854996 None] Lock "cinder-quobyte-35eac6cb-06b0-4fc4-bad6-cd3f4c437e4e" acquired by "delete_volume" :: waited 0.032s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:55:59 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7089e5-1ad8-40ef-ac5f-30a136d875a9]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:55:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-bf750cdb-1666-41fc-a860-66e87ea2943a tempest-CreateVolumesFromImageTest-1468854996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-35eac6cb-06b0-4fc4-bad6-cd3f4c437e4e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:59 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-862725ea-04ca-4e23-995b-531dba6d7ff4 tempest-CreateVolumesFromImageTest-1468854996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.348s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:59 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-862725ea-04ca-4e23-995b-531dba6d7ff4 tempest-CreateVolumesFromImageTest-1468854996 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:55:59 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-862725ea-04ca-4e23-995b-531dba6d7ff4 tempest-CreateVolumesFromImageTest-1468854996 None] Deleted volume successfully. Aug 10 12:55:59 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-862725ea-04ca-4e23-995b-531dba6d7ff4 tempest-CreateVolumesFromImageTest-1468854996 None] Lock "cinder-4fc7a6b2-2380-4c6d-b3e8-e8118d07241d-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:55:59 devstack sudo[100720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-35eac6cb-06b0-4fc4-bad6-cd3f4c437e4e Aug 10 12:55:59 devstack sudo[100720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:59 devstack sudo[100720]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-bf750cdb-1666-41fc-a860-66e87ea2943a tempest-CreateVolumesFromImageTest-1468854996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-35eac6cb-06b0-4fc4-bad6-cd3f4c437e4e" returned: 0 in 0.410s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-bf750cdb-1666-41fc-a860-66e87ea2943a tempest-CreateVolumesFromImageTest-1468854996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-35eac6cb-06b0-4fc4-bad6-cd3f4c437e4e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:59 devstack sudo[100725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-35eac6cb-06b0-4fc4-bad6-cd3f4c437e4e Aug 10 12:55:59 devstack sudo[100725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:55:59 devstack sudo[100725]: pam_unix(sudo:session): session closed for user root Aug 10 12:55:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-bf750cdb-1666-41fc-a860-66e87ea2943a tempest-CreateVolumesFromImageTest-1468854996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-35eac6cb-06b0-4fc4-bad6-cd3f4c437e4e" returned: 0 in 0.268s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:55:59 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-bf750cdb-1666-41fc-a860-66e87ea2943a tempest-CreateVolumesFromImageTest-1468854996 None] Lock "cinder-quobyte-35eac6cb-06b0-4fc4-bad6-cd3f4c437e4e" released by "delete_volume" :: held 0.737s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:55:59 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-bf750cdb-1666-41fc-a860-66e87ea2943a tempest-CreateVolumesFromImageTest-1468854996 None] Created reservations ['f74e04c1-3efa-4b9c-aa58-73d0ded32f57', 'a2461f7f-be78-4352-a5ed-a4060112c111', '8b9a6b04-0276-49ff-b564-434d891e384e', 'b769c545-6fc0-483b-83c0-38991145eab5'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:55:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-bf750cdb-1666-41fc-a860-66e87ea2943a tempest-CreateVolumesFromImageTest-1468854996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:55:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-bf750cdb-1666-41fc-a860-66e87ea2943a tempest-CreateVolumesFromImageTest-1468854996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:55:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-bf750cdb-1666-41fc-a860-66e87ea2943a tempest-CreateVolumesFromImageTest-1468854996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:55:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-bf750cdb-1666-41fc-a860-66e87ea2943a tempest-CreateVolumesFromImageTest-1468854996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:55:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-bf750cdb-1666-41fc-a860-66e87ea2943a tempest-CreateVolumesFromImageTest-1468854996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:55:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-bf750cdb-1666-41fc-a860-66e87ea2943a tempest-CreateVolumesFromImageTest-1468854996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:55:59 devstack sudo[100728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:55:59 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:00 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e8c1b7b1-8dee-4732-9471-f7c2758c298a tempest-CreateVolumesFromImageTest-1468854996 None] Acquiring lock "cinder-48960c08-9248-4c3e-ae44-0ae2054434f4-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:56:00 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-bf750cdb-1666-41fc-a860-66e87ea2943a tempest-CreateVolumesFromImageTest-1468854996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.366s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:00 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-bf750cdb-1666-41fc-a860-66e87ea2943a tempest-CreateVolumesFromImageTest-1468854996 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:56:00 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-bf750cdb-1666-41fc-a860-66e87ea2943a tempest-CreateVolumesFromImageTest-1468854996 None] Deleted volume successfully. Aug 10 12:56:00 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e8c1b7b1-8dee-4732-9471-f7c2758c298a tempest-CreateVolumesFromImageTest-1468854996 None] Lock "cinder-48960c08-9248-4c3e-ae44-0ae2054434f4-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:56:00 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-bf750cdb-1666-41fc-a860-66e87ea2943a tempest-CreateVolumesFromImageTest-1468854996 None] Lock "cinder-35eac6cb-06b0-4fc4-bad6-cd3f4c437e4e-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:56:00 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e8c1b7b1-8dee-4732-9471-f7c2758c298a tempest-CreateVolumesFromImageTest-1468854996 None] Acquiring lock "cinder-quobyte-48960c08-9248-4c3e-ae44-0ae2054434f4" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:56:00 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e8c1b7b1-8dee-4732-9471-f7c2758c298a tempest-CreateVolumesFromImageTest-1468854996 None] Lock "cinder-quobyte-48960c08-9248-4c3e-ae44-0ae2054434f4" acquired by "delete_volume" :: waited 0.028s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:56:00 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdb5541-92af-432f-a420-5b6ee70aaf81]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:56:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e8c1b7b1-8dee-4732-9471-f7c2758c298a tempest-CreateVolumesFromImageTest-1468854996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-48960c08-9248-4c3e-ae44-0ae2054434f4 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:00 devstack sudo[100732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-48960c08-9248-4c3e-ae44-0ae2054434f4 Aug 10 12:56:00 devstack sudo[100732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:00 devstack sudo[100732]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e8c1b7b1-8dee-4732-9471-f7c2758c298a tempest-CreateVolumesFromImageTest-1468854996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-48960c08-9248-4c3e-ae44-0ae2054434f4" returned: 0 in 0.403s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e8c1b7b1-8dee-4732-9471-f7c2758c298a tempest-CreateVolumesFromImageTest-1468854996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-48960c08-9248-4c3e-ae44-0ae2054434f4 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:00 devstack sudo[100737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-48960c08-9248-4c3e-ae44-0ae2054434f4 Aug 10 12:56:00 devstack sudo[100737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:01 devstack sudo[100737]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e8c1b7b1-8dee-4732-9471-f7c2758c298a tempest-CreateVolumesFromImageTest-1468854996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-48960c08-9248-4c3e-ae44-0ae2054434f4" returned: 0 in 0.523s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:01 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e8c1b7b1-8dee-4732-9471-f7c2758c298a tempest-CreateVolumesFromImageTest-1468854996 None] Lock "cinder-quobyte-48960c08-9248-4c3e-ae44-0ae2054434f4" released by "delete_volume" :: held 1.003s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:56:01 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-e8c1b7b1-8dee-4732-9471-f7c2758c298a tempest-CreateVolumesFromImageTest-1468854996 None] Created reservations ['c95620b3-8e0c-4eb3-8a05-37ec492b09af', 'f8af1769-c0e3-4fa6-a17b-5bbec855ba7f', '4ffc74cb-1648-47d8-b1ff-30a20df13a53', 'dafd41d9-3ef7-4a4a-ba07-a8f5ff6a8d92'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:56:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e8c1b7b1-8dee-4732-9471-f7c2758c298a tempest-CreateVolumesFromImageTest-1468854996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:56:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e8c1b7b1-8dee-4732-9471-f7c2758c298a tempest-CreateVolumesFromImageTest-1468854996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:56:01 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e8c1b7b1-8dee-4732-9471-f7c2758c298a tempest-CreateVolumesFromImageTest-1468854996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:56:01 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e8c1b7b1-8dee-4732-9471-f7c2758c298a tempest-CreateVolumesFromImageTest-1468854996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:56:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e8c1b7b1-8dee-4732-9471-f7c2758c298a tempest-CreateVolumesFromImageTest-1468854996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:56:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e8c1b7b1-8dee-4732-9471-f7c2758c298a tempest-CreateVolumesFromImageTest-1468854996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:01 devstack sudo[100743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:56:01 devstack sudo[100743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:02 devstack sudo[100743]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e8c1b7b1-8dee-4732-9471-f7c2758c298a tempest-CreateVolumesFromImageTest-1468854996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.355s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:02 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-e8c1b7b1-8dee-4732-9471-f7c2758c298a tempest-CreateVolumesFromImageTest-1468854996 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:56:02 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-e8c1b7b1-8dee-4732-9471-f7c2758c298a tempest-CreateVolumesFromImageTest-1468854996 None] Deleted volume successfully. Aug 10 12:56:02 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e8c1b7b1-8dee-4732-9471-f7c2758c298a tempest-CreateVolumesFromImageTest-1468854996 None] Lock "cinder-48960c08-9248-4c3e-ae44-0ae2054434f4-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:56:02 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-895a29b2-447d-49af-b2ad-e8db230ef2f1 tempest-CreateVolumesFromImageTest-1468854996 None] Acquiring lock "cinder-5b079c0f-5f5c-420a-a415-4e88efa8666e-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:56:02 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-895a29b2-447d-49af-b2ad-e8db230ef2f1 tempest-CreateVolumesFromImageTest-1468854996 None] Lock "cinder-5b079c0f-5f5c-420a-a415-4e88efa8666e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:56:02 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-895a29b2-447d-49af-b2ad-e8db230ef2f1 tempest-CreateVolumesFromImageTest-1468854996 None] Acquiring lock "cinder-quobyte-5b079c0f-5f5c-420a-a415-4e88efa8666e" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:56:02 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-895a29b2-447d-49af-b2ad-e8db230ef2f1 tempest-CreateVolumesFromImageTest-1468854996 None] Lock "cinder-quobyte-5b079c0f-5f5c-420a-a415-4e88efa8666e" acquired by "delete_volume" :: waited 0.030s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:56:02 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85e9f23-628a-4567-a072-6495635bf09d]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:56:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-895a29b2-447d-49af-b2ad-e8db230ef2f1 tempest-CreateVolumesFromImageTest-1468854996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b079c0f-5f5c-420a-a415-4e88efa8666e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:02 devstack sudo[100750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b079c0f-5f5c-420a-a415-4e88efa8666e Aug 10 12:56:02 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:03 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-895a29b2-447d-49af-b2ad-e8db230ef2f1 tempest-CreateVolumesFromImageTest-1468854996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b079c0f-5f5c-420a-a415-4e88efa8666e" returned: 0 in 0.453s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-895a29b2-447d-49af-b2ad-e8db230ef2f1 tempest-CreateVolumesFromImageTest-1468854996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b079c0f-5f5c-420a-a415-4e88efa8666e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:03 devstack sudo[100766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b079c0f-5f5c-420a-a415-4e88efa8666e Aug 10 12:56:03 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:03 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-895a29b2-447d-49af-b2ad-e8db230ef2f1 tempest-CreateVolumesFromImageTest-1468854996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5b079c0f-5f5c-420a-a415-4e88efa8666e" returned: 0 in 0.348s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:03 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-895a29b2-447d-49af-b2ad-e8db230ef2f1 tempest-CreateVolumesFromImageTest-1468854996 None] Lock "cinder-quobyte-5b079c0f-5f5c-420a-a415-4e88efa8666e" released by "delete_volume" :: held 0.863s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:56:03 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-895a29b2-447d-49af-b2ad-e8db230ef2f1 tempest-CreateVolumesFromImageTest-1468854996 None] Created reservations ['799a9d26-f286-487a-a7e1-af23960dc139', '680f531d-9986-42f8-9d9d-16317fe7c115', '7431c5bd-e26e-48ad-9f34-01be5c9ebbdd', '7eec59e5-ffa9-4b53-b0f7-1d9d641abb70'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:56:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-895a29b2-447d-49af-b2ad-e8db230ef2f1 tempest-CreateVolumesFromImageTest-1468854996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:56:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-895a29b2-447d-49af-b2ad-e8db230ef2f1 tempest-CreateVolumesFromImageTest-1468854996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:56:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-895a29b2-447d-49af-b2ad-e8db230ef2f1 tempest-CreateVolumesFromImageTest-1468854996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:56:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-895a29b2-447d-49af-b2ad-e8db230ef2f1 tempest-CreateVolumesFromImageTest-1468854996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:56:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-895a29b2-447d-49af-b2ad-e8db230ef2f1 tempest-CreateVolumesFromImageTest-1468854996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:56:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-895a29b2-447d-49af-b2ad-e8db230ef2f1 tempest-CreateVolumesFromImageTest-1468854996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:03 devstack sudo[100771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:56:03 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:03 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 12:56:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:56:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:56:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:56:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:56:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:56:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:03 devstack sudo[100773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:56:03 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ce8ce6e8-d2bf-426a-93b5-a78537e772cb tempest-CreateVolumesFromImageTest-1468854996 None] Acquiring lock "cinder-0eb447c9-d737-4577-9474-3ffba8eb8fe6-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:56:03 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:04 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ce8ce6e8-d2bf-426a-93b5-a78537e772cb tempest-CreateVolumesFromImageTest-1468854996 None] Lock "cinder-0eb447c9-d737-4577-9474-3ffba8eb8fe6-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:56:04 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ce8ce6e8-d2bf-426a-93b5-a78537e772cb tempest-CreateVolumesFromImageTest-1468854996 None] Acquiring lock "cinder-quobyte-0eb447c9-d737-4577-9474-3ffba8eb8fe6" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:56:04 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ce8ce6e8-d2bf-426a-93b5-a78537e772cb tempest-CreateVolumesFromImageTest-1468854996 None] Lock "cinder-quobyte-0eb447c9-d737-4577-9474-3ffba8eb8fe6" acquired by "delete_volume" :: waited 0.029s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:56:04 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[028b25b5-5773-46cf-8405-0c5a7ffcca31]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:56:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ce8ce6e8-d2bf-426a-93b5-a78537e772cb tempest-CreateVolumesFromImageTest-1468854996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0eb447c9-d737-4577-9474-3ffba8eb8fe6 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:04 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-895a29b2-447d-49af-b2ad-e8db230ef2f1 tempest-CreateVolumesFromImageTest-1468854996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.567s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:04 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-895a29b2-447d-49af-b2ad-e8db230ef2f1 tempest-CreateVolumesFromImageTest-1468854996 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:56:04 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-895a29b2-447d-49af-b2ad-e8db230ef2f1 tempest-CreateVolumesFromImageTest-1468854996 None] Deleted volume successfully. Aug 10 12:56:04 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-895a29b2-447d-49af-b2ad-e8db230ef2f1 tempest-CreateVolumesFromImageTest-1468854996 None] Lock "cinder-5b079c0f-5f5c-420a-a415-4e88efa8666e-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:56:04 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.551s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:04 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:56:04 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager._thread_info {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 12:56:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread count: 28 {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 12:56:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread info: [<_MainThread(MainThread, started 130607683133568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Aug 10 12:56:04 devstack sudo[100775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0eb447c9-d737-4577-9474-3ffba8eb8fe6 Aug 10 12:56:04 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:04 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ce8ce6e8-d2bf-426a-93b5-a78537e772cb tempest-CreateVolumesFromImageTest-1468854996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0eb447c9-d737-4577-9474-3ffba8eb8fe6" returned: 0 in 0.691s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ce8ce6e8-d2bf-426a-93b5-a78537e772cb tempest-CreateVolumesFromImageTest-1468854996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0eb447c9-d737-4577-9474-3ffba8eb8fe6 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:04 devstack sudo[100784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0eb447c9-d737-4577-9474-3ffba8eb8fe6 Aug 10 12:56:04 devstack sudo[100784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:05 devstack sudo[100784]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ce8ce6e8-d2bf-426a-93b5-a78537e772cb tempest-CreateVolumesFromImageTest-1468854996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0eb447c9-d737-4577-9474-3ffba8eb8fe6" returned: 0 in 0.532s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:05 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ce8ce6e8-d2bf-426a-93b5-a78537e772cb tempest-CreateVolumesFromImageTest-1468854996 None] Lock "cinder-quobyte-0eb447c9-d737-4577-9474-3ffba8eb8fe6" released by "delete_volume" :: held 1.293s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:56:05 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-ce8ce6e8-d2bf-426a-93b5-a78537e772cb tempest-CreateVolumesFromImageTest-1468854996 None] Created reservations ['ea0b7333-501c-4899-8c2c-1225c3bd0cb1', '9911095a-4da4-4f02-89eb-7211196018bb', '50203f21-0270-42c0-94c5-a4de5ce79da6', '387501be-717f-472b-b8b5-4a8c728a3cd4'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:56:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ce8ce6e8-d2bf-426a-93b5-a78537e772cb tempest-CreateVolumesFromImageTest-1468854996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:56:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ce8ce6e8-d2bf-426a-93b5-a78537e772cb tempest-CreateVolumesFromImageTest-1468854996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:56:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ce8ce6e8-d2bf-426a-93b5-a78537e772cb tempest-CreateVolumesFromImageTest-1468854996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:56:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ce8ce6e8-d2bf-426a-93b5-a78537e772cb tempest-CreateVolumesFromImageTest-1468854996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:56:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ce8ce6e8-d2bf-426a-93b5-a78537e772cb tempest-CreateVolumesFromImageTest-1468854996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:56:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ce8ce6e8-d2bf-426a-93b5-a78537e772cb tempest-CreateVolumesFromImageTest-1468854996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:05 devstack sudo[100806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:56:05 devstack sudo[100806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:06 devstack sudo[100806]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ce8ce6e8-d2bf-426a-93b5-a78537e772cb tempest-CreateVolumesFromImageTest-1468854996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.403s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:06 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-ce8ce6e8-d2bf-426a-93b5-a78537e772cb tempest-CreateVolumesFromImageTest-1468854996 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:56:06 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-ce8ce6e8-d2bf-426a-93b5-a78537e772cb tempest-CreateVolumesFromImageTest-1468854996 None] Deleted volume successfully. Aug 10 12:56:06 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ce8ce6e8-d2bf-426a-93b5-a78537e772cb tempest-CreateVolumesFromImageTest-1468854996 None] Lock "cinder-0eb447c9-d737-4577-9474-3ffba8eb8fe6-delete_volume" released by "delete_volume" :: held 2.128s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:56:06 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-46433e47-5d27-44b2-ade4-12c1e2d8b244 tempest-VolumesSnapshotListTestJSON-1961581930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:56:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-46433e47-5d27-44b2-ade4-12c1e2d8b244 tempest-VolumesSnapshotListTestJSON-1961581930 None] Flow 'volume_create_manager' (47b946d0-229f-44dc-bd3c-c6460fedbbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:56:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-46433e47-5d27-44b2-ade4-12c1e2d8b244 tempest-VolumesSnapshotListTestJSON-1961581930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (345bd747-8b7a-49c2-958a-52faa964af39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:56:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-46433e47-5d27-44b2-ade4-12c1e2d8b244 tempest-VolumesSnapshotListTestJSON-1961581930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (345bd747-8b7a-49c2-958a-52faa964af39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1657087890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=082cf278-e5f8-4a9e-8fe8-9af57945e8fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e9c2e00d633400dbe365c6e689e67c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:56:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:56:07Z,use_quota=True,user_id='0e89bd0363784503947b962db9ce93c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:56:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-46433e47-5d27-44b2-ade4-12c1e2d8b244 tempest-VolumesSnapshotListTestJSON-1961581930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8faba183-bd09-425f-aeb2-1cf8be7a17dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:56:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-46433e47-5d27-44b2-ade4-12c1e2d8b244 tempest-VolumesSnapshotListTestJSON-1961581930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8faba183-bd09-425f-aeb2-1cf8be7a17dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:56:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-46433e47-5d27-44b2-ade4-12c1e2d8b244 tempest-VolumesSnapshotListTestJSON-1961581930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc352e42-4857-4e7d-9744-e82570832d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:56:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-46433e47-5d27-44b2-ade4-12c1e2d8b244 tempest-VolumesSnapshotListTestJSON-1961581930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc352e42-4857-4e7d-9744-e82570832d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '082cf278-e5f8-4a9e-8fe8-9af57945e8fd', 'volume_name': 'volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:56:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-46433e47-5d27-44b2-ade4-12c1e2d8b244 tempest-VolumesSnapshotListTestJSON-1961581930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c4f08f-cd56-4361-a238-5c018579b037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:56:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-46433e47-5d27-44b2-ade4-12c1e2d8b244 tempest-VolumesSnapshotListTestJSON-1961581930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c4f08f-cd56-4361-a238-5c018579b037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:56:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-46433e47-5d27-44b2-ade4-12c1e2d8b244 tempest-VolumesSnapshotListTestJSON-1961581930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d339517e-eb1b-49dc-b8fc-ff0803b519bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:56:06 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-46433e47-5d27-44b2-ade4-12c1e2d8b244 tempest-VolumesSnapshotListTestJSON-1961581930 None] Volume 082cf278-e5f8-4a9e-8fe8-9af57945e8fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd', 'volume_size': 1} Aug 10 12:56:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-46433e47-5d27-44b2-ade4-12c1e2d8b244 tempest-VolumesSnapshotListTestJSON-1961581930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:56:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-46433e47-5d27-44b2-ade4-12c1e2d8b244 tempest-VolumesSnapshotListTestJSON-1961581930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:56:06 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-46433e47-5d27-44b2-ade4-12c1e2d8b244 tempest-VolumesSnapshotListTestJSON-1961581930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1657087890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=082cf278-e5f8-4a9e-8fe8-9af57945e8fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e9c2e00d633400dbe365c6e689e67c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:56:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:56:07Z,use_quota=True,user_id='0e89bd0363784503947b962db9ce93c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:56:06 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-46433e47-5d27-44b2-ade4-12c1e2d8b244 tempest-VolumesSnapshotListTestJSON-1961581930 None] Creating volume 082cf278-e5f8-4a9e-8fe8-9af57945e8fd {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:56:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-46433e47-5d27-44b2-ade4-12c1e2d8b244 tempest-VolumesSnapshotListTestJSON-1961581930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:56:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-46433e47-5d27-44b2-ade4-12c1e2d8b244 tempest-VolumesSnapshotListTestJSON-1961581930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:56:07 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-46433e47-5d27-44b2-ade4-12c1e2d8b244 tempest-VolumesSnapshotListTestJSON-1961581930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:56:07 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-46433e47-5d27-44b2-ade4-12c1e2d8b244 tempest-VolumesSnapshotListTestJSON-1961581930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:56:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-46433e47-5d27-44b2-ade4-12c1e2d8b244 tempest-VolumesSnapshotListTestJSON-1961581930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:56:07 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-46433e47-5d27-44b2-ade4-12c1e2d8b244 tempest-VolumesSnapshotListTestJSON-1961581930 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:56:07 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-46433e47-5d27-44b2-ade4-12c1e2d8b244 tempest-VolumesSnapshotListTestJSON-1961581930 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:56:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-46433e47-5d27-44b2-ade4-12c1e2d8b244 tempest-VolumesSnapshotListTestJSON-1961581930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:07 devstack sudo[100818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd 1073741824 Aug 10 12:56:07 devstack sudo[100818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:07 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-72f2bb90-d411-4942-ab1e-202a289cb7bc req-16e5c4f0-216b-492a-948c-34ba435fe7fc tempest-ServerActionsTestOtherA-1564634914 None] Terminate volume connection completed successfully. Aug 10 12:56:07 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-72f2bb90-d411-4942-ab1e-202a289cb7bc req-16e5c4f0-216b-492a-948c-34ba435fe7fc tempest-ServerActionsTestOtherA-1564634914 None] Deleting attachment 2852c73e-f1f9-419f-992b-60e1be8a4b4a. {{(pid=89096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Aug 10 12:56:07 devstack cinder-volume[89096]: DEBUG cinder.coordination [req-72f2bb90-d411-4942-ab1e-202a289cb7bc req-0fdf7fe6-9d68-4a04-aa6d-cb8db32a1b14 tempest-ServerActionsTestOtherA-1564634914 None] Acquiring lock "cinder-310b3a52-d6fc-4f44-9cfa-9aa82d729784-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:56:07 devstack cinder-volume[89096]: DEBUG cinder.coordination [req-72f2bb90-d411-4942-ab1e-202a289cb7bc req-0fdf7fe6-9d68-4a04-aa6d-cb8db32a1b14 tempest-ServerActionsTestOtherA-1564634914 None] Lock "cinder-310b3a52-d6fc-4f44-9cfa-9aa82d729784-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:56:07 devstack sudo[100818]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-46433e47-5d27-44b2-ade4-12c1e2d8b244 tempest-VolumesSnapshotListTestJSON-1961581930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd 1073741824" returned: 0 in 0.646s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:07 devstack cinder-volume[89096]: DEBUG cinder.coordination [req-72f2bb90-d411-4942-ab1e-202a289cb7bc req-0fdf7fe6-9d68-4a04-aa6d-cb8db32a1b14 tempest-ServerActionsTestOtherA-1564634914 None] Acquiring lock "cinder-quobyte-310b3a52-d6fc-4f44-9cfa-9aa82d729784" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:56:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-46433e47-5d27-44b2-ade4-12c1e2d8b244 tempest-VolumesSnapshotListTestJSON-1961581930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:07 devstack cinder-volume[89096]: DEBUG cinder.coordination [req-72f2bb90-d411-4942-ab1e-202a289cb7bc req-0fdf7fe6-9d68-4a04-aa6d-cb8db32a1b14 tempest-ServerActionsTestOtherA-1564634914 None] Lock "cinder-quobyte-310b3a52-d6fc-4f44-9cfa-9aa82d729784" acquired by "delete_volume" :: waited 0.048s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:56:07 devstack sudo[100826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd Aug 10 12:56:07 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:07 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29beab6-7e9a-45df-abab-bb1051c618a9]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:56:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-72f2bb90-d411-4942-ab1e-202a289cb7bc req-0fdf7fe6-9d68-4a04-aa6d-cb8db32a1b14 tempest-ServerActionsTestOtherA-1564634914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-310b3a52-d6fc-4f44-9cfa-9aa82d729784 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:08 devstack sudo[100829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-310b3a52-d6fc-4f44-9cfa-9aa82d729784 Aug 10 12:56:08 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:08 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-46433e47-5d27-44b2-ade4-12c1e2d8b244 tempest-VolumesSnapshotListTestJSON-1961581930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd" returned: 0 in 0.365s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-46433e47-5d27-44b2-ade4-12c1e2d8b244 tempest-VolumesSnapshotListTestJSON-1961581930 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:56:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-46433e47-5d27-44b2-ade4-12c1e2d8b244 tempest-VolumesSnapshotListTestJSON-1961581930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:56:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-46433e47-5d27-44b2-ade4-12c1e2d8b244 tempest-VolumesSnapshotListTestJSON-1961581930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d339517e-eb1b-49dc-b8fc-ff0803b519bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:56:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-46433e47-5d27-44b2-ade4-12c1e2d8b244 tempest-VolumesSnapshotListTestJSON-1961581930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52bb8650-8f5a-4616-8fea-a06986570829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:56:08 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-46433e47-5d27-44b2-ade4-12c1e2d8b244 tempest-VolumesSnapshotListTestJSON-1961581930 None] Volume volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd (082cf278-e5f8-4a9e-8fe8-9af57945e8fd): created successfully Aug 10 12:56:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-46433e47-5d27-44b2-ade4-12c1e2d8b244 tempest-VolumesSnapshotListTestJSON-1961581930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52bb8650-8f5a-4616-8fea-a06986570829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:56:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-46433e47-5d27-44b2-ade4-12c1e2d8b244 tempest-VolumesSnapshotListTestJSON-1961581930 None] Flow 'volume_create_manager' (47b946d0-229f-44dc-bd3c-c6460fedbbcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:56:08 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-46433e47-5d27-44b2-ade4-12c1e2d8b244 tempest-VolumesSnapshotListTestJSON-1961581930 None] Created volume successfully. Aug 10 12:56:08 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-72f2bb90-d411-4942-ab1e-202a289cb7bc req-0fdf7fe6-9d68-4a04-aa6d-cb8db32a1b14 tempest-ServerActionsTestOtherA-1564634914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-310b3a52-d6fc-4f44-9cfa-9aa82d729784" returned: 0 in 0.664s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-72f2bb90-d411-4942-ab1e-202a289cb7bc req-0fdf7fe6-9d68-4a04-aa6d-cb8db32a1b14 tempest-ServerActionsTestOtherA-1564634914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-310b3a52-d6fc-4f44-9cfa-9aa82d729784 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:08 devstack sudo[100843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-310b3a52-d6fc-4f44-9cfa-9aa82d729784 Aug 10 12:56:08 devstack sudo[100843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:08 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-cb7cbff3-4d31-4908-a0d8-8e473f4e2f6d tempest-ServerActionsTestOtherA-1564634914 None] Acquiring lock "cinder-ad92b852-0a48-47c4-b10d-75132382bb76-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:56:08 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-cb7cbff3-4d31-4908-a0d8-8e473f4e2f6d tempest-ServerActionsTestOtherA-1564634914 None] Lock "cinder-ad92b852-0a48-47c4-b10d-75132382bb76-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:56:08 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-cb7cbff3-4d31-4908-a0d8-8e473f4e2f6d tempest-ServerActionsTestOtherA-1564634914 None] Acquiring lock "cinder-quobyte-ad92b852-0a48-47c4-b10d-75132382bb76" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:56:08 devstack sudo[100843]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:08 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-cb7cbff3-4d31-4908-a0d8-8e473f4e2f6d tempest-ServerActionsTestOtherA-1564634914 None] Lock "cinder-quobyte-ad92b852-0a48-47c4-b10d-75132382bb76" acquired by "delete_volume" :: waited 0.035s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:56:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-72f2bb90-d411-4942-ab1e-202a289cb7bc req-0fdf7fe6-9d68-4a04-aa6d-cb8db32a1b14 tempest-ServerActionsTestOtherA-1564634914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-310b3a52-d6fc-4f44-9cfa-9aa82d729784" returned: 0 in 0.434s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:08 devstack cinder-volume[89096]: DEBUG cinder.coordination [req-72f2bb90-d411-4942-ab1e-202a289cb7bc req-0fdf7fe6-9d68-4a04-aa6d-cb8db32a1b14 tempest-ServerActionsTestOtherA-1564634914 None] Lock "cinder-quobyte-310b3a52-d6fc-4f44-9cfa-9aa82d729784" released by "delete_volume" :: held 1.157s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:56:08 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[3241ab61-1441-4513-9035-127e37843b30]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:56:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-cb7cbff3-4d31-4908-a0d8-8e473f4e2f6d tempest-ServerActionsTestOtherA-1564634914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ad92b852-0a48-47c4-b10d-75132382bb76 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:09 devstack cinder-volume[89096]: DEBUG cinder.quota [req-72f2bb90-d411-4942-ab1e-202a289cb7bc req-0fdf7fe6-9d68-4a04-aa6d-cb8db32a1b14 tempest-ServerActionsTestOtherA-1564634914 None] Created reservations ['644f5a63-47f6-4427-839d-8cb95d3ece63', '20874bf9-c616-4ea6-891b-472227500f9a', 'f5ca6b28-265d-4cca-8a70-279966e1956d', '73009ade-b2d3-43bb-bf49-79ed27295b61'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:56:09 devstack sudo[100855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ad92b852-0a48-47c4-b10d-75132382bb76 Aug 10 12:56:09 devstack sudo[100855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-72f2bb90-d411-4942-ab1e-202a289cb7bc req-0fdf7fe6-9d68-4a04-aa6d-cb8db32a1b14 tempest-ServerActionsTestOtherA-1564634914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:56:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-72f2bb90-d411-4942-ab1e-202a289cb7bc req-0fdf7fe6-9d68-4a04-aa6d-cb8db32a1b14 tempest-ServerActionsTestOtherA-1564634914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:56:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [req-72f2bb90-d411-4942-ab1e-202a289cb7bc req-0fdf7fe6-9d68-4a04-aa6d-cb8db32a1b14 tempest-ServerActionsTestOtherA-1564634914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:56:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [req-72f2bb90-d411-4942-ab1e-202a289cb7bc req-0fdf7fe6-9d68-4a04-aa6d-cb8db32a1b14 tempest-ServerActionsTestOtherA-1564634914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:56:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-72f2bb90-d411-4942-ab1e-202a289cb7bc req-0fdf7fe6-9d68-4a04-aa6d-cb8db32a1b14 tempest-ServerActionsTestOtherA-1564634914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:56:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-72f2bb90-d411-4942-ab1e-202a289cb7bc req-0fdf7fe6-9d68-4a04-aa6d-cb8db32a1b14 tempest-ServerActionsTestOtherA-1564634914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:09 devstack sudo[100862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:56:09 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-de79fd6c-eead-483a-b482-a05ffb1ecb22 tempest-VolumesSnapshotListTestJSON-1961581930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:56:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-de79fd6c-eead-483a-b482-a05ffb1ecb22 tempest-VolumesSnapshotListTestJSON-1961581930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:56:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-de79fd6c-eead-483a-b482-a05ffb1ecb22 tempest-VolumesSnapshotListTestJSON-1961581930 None] Creating offline snapshot 174fe168-41f8-4d1d-9c2b-8526ed2a3161 of volume 082cf278-e5f8-4a9e-8fe8-9af57945e8fd {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 12:56:09 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[3685d751-5a84-4039-9ee4-500986605585]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:56:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-de79fd6c-eead-483a-b482-a05ffb1ecb22 tempest-VolumesSnapshotListTestJSON-1961581930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:09 devstack sudo[100855]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-cb7cbff3-4d31-4908-a0d8-8e473f4e2f6d tempest-ServerActionsTestOtherA-1564634914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ad92b852-0a48-47c4-b10d-75132382bb76" returned: 0 in 0.619s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-cb7cbff3-4d31-4908-a0d8-8e473f4e2f6d tempest-ServerActionsTestOtherA-1564634914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ad92b852-0a48-47c4-b10d-75132382bb76 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:09 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [req-72f2bb90-d411-4942-ab1e-202a289cb7bc req-0fdf7fe6-9d68-4a04-aa6d-cb8db32a1b14 tempest-ServerActionsTestOtherA-1564634914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.380s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:09 devstack cinder-volume[89096]: DEBUG cinder.manager [req-72f2bb90-d411-4942-ab1e-202a289cb7bc req-0fdf7fe6-9d68-4a04-aa6d-cb8db32a1b14 tempest-ServerActionsTestOtherA-1564634914 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:56:09 devstack sudo[100872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ad92b852-0a48-47c4-b10d-75132382bb76 Aug 10 12:56:09 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:09 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-72f2bb90-d411-4942-ab1e-202a289cb7bc req-0fdf7fe6-9d68-4a04-aa6d-cb8db32a1b14 tempest-ServerActionsTestOtherA-1564634914 None] Deleted volume successfully. Aug 10 12:56:09 devstack cinder-volume[89096]: DEBUG cinder.coordination [req-72f2bb90-d411-4942-ab1e-202a289cb7bc req-0fdf7fe6-9d68-4a04-aa6d-cb8db32a1b14 tempest-ServerActionsTestOtherA-1564634914 None] Lock "cinder-310b3a52-d6fc-4f44-9cfa-9aa82d729784-delete_volume" released by "delete_volume" :: held 1.996s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:56:09 devstack sudo[100870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd Aug 10 12:56:09 devstack sudo[100870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:09 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-cb7cbff3-4d31-4908-a0d8-8e473f4e2f6d tempest-ServerActionsTestOtherA-1564634914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ad92b852-0a48-47c4-b10d-75132382bb76" returned: 0 in 0.411s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-cb7cbff3-4d31-4908-a0d8-8e473f4e2f6d tempest-ServerActionsTestOtherA-1564634914 None] Lock "cinder-quobyte-ad92b852-0a48-47c4-b10d-75132382bb76" released by "delete_volume" :: held 1.097s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:56:10 devstack sudo[100870]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-de79fd6c-eead-483a-b482-a05ffb1ecb22 tempest-VolumesSnapshotListTestJSON-1961581930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd" returned: 0 in 0.502s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-de79fd6c-eead-483a-b482-a05ffb1ecb22 tempest-VolumesSnapshotListTestJSON-1961581930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.174fe168-41f8-4d1d-9c2b-8526ed2a3161 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:10 devstack sudo[100886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.174fe168-41f8-4d1d-9c2b-8526ed2a3161 1G Aug 10 12:56:10 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:10 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-cb7cbff3-4d31-4908-a0d8-8e473f4e2f6d tempest-ServerActionsTestOtherA-1564634914 None] Created reservations ['3de86c2b-f81c-4832-97ef-2b22b8e076c1', 'aa04c4be-55cf-431f-a9f5-8c1087f4fd12', '7d6f3b2c-83ba-4926-b590-3f29f0edb943', 'ad022e4d-eb2c-4521-9a87-ce4bedf99235'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:56:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-cb7cbff3-4d31-4908-a0d8-8e473f4e2f6d tempest-ServerActionsTestOtherA-1564634914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:56:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-cb7cbff3-4d31-4908-a0d8-8e473f4e2f6d tempest-ServerActionsTestOtherA-1564634914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:56:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-cb7cbff3-4d31-4908-a0d8-8e473f4e2f6d tempest-ServerActionsTestOtherA-1564634914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:56:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-cb7cbff3-4d31-4908-a0d8-8e473f4e2f6d tempest-ServerActionsTestOtherA-1564634914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:56:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-cb7cbff3-4d31-4908-a0d8-8e473f4e2f6d tempest-ServerActionsTestOtherA-1564634914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:56:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-cb7cbff3-4d31-4908-a0d8-8e473f4e2f6d tempest-ServerActionsTestOtherA-1564634914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:10 devstack sudo[100890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:56:10 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:10 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-cb7cbff3-4d31-4908-a0d8-8e473f4e2f6d tempest-ServerActionsTestOtherA-1564634914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.311s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:10 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-cb7cbff3-4d31-4908-a0d8-8e473f4e2f6d tempest-ServerActionsTestOtherA-1564634914 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:56:10 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-cb7cbff3-4d31-4908-a0d8-8e473f4e2f6d tempest-ServerActionsTestOtherA-1564634914 None] Deleted volume successfully. Aug 10 12:56:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-cb7cbff3-4d31-4908-a0d8-8e473f4e2f6d tempest-ServerActionsTestOtherA-1564634914 None] Lock "cinder-ad92b852-0a48-47c4-b10d-75132382bb76-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:56:10 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-de79fd6c-eead-483a-b482-a05ffb1ecb22 tempest-VolumesSnapshotListTestJSON-1961581930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.174fe168-41f8-4d1d-9c2b-8526ed2a3161 1G" returned: 0 in 0.548s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-de79fd6c-eead-483a-b482-a05ffb1ecb22 tempest-VolumesSnapshotListTestJSON-1961581930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.174fe168-41f8-4d1d-9c2b-8526ed2a3161 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:10 devstack sudo[100903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.174fe168-41f8-4d1d-9c2b-8526ed2a3161 Aug 10 12:56:10 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:10 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-de79fd6c-eead-483a-b482-a05ffb1ecb22 tempest-VolumesSnapshotListTestJSON-1961581930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.174fe168-41f8-4d1d-9c2b-8526ed2a3161" returned: 0 in 0.348s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:10 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-de79fd6c-eead-483a-b482-a05ffb1ecb22 tempest-VolumesSnapshotListTestJSON-1961581930 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.174fe168-41f8-4d1d-9c2b-8526ed2a3161 is being set with open permissions: ugo+rw Aug 10 12:56:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-de79fd6c-eead-483a-b482-a05ffb1ecb22 tempest-VolumesSnapshotListTestJSON-1961581930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.174fe168-41f8-4d1d-9c2b-8526ed2a3161 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:10 devstack sudo[100921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.174fe168-41f8-4d1d-9c2b-8526ed2a3161 Aug 10 12:56:10 devstack sudo[100921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:11 devstack sudo[100921]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-de79fd6c-eead-483a-b482-a05ffb1ecb22 tempest-VolumesSnapshotListTestJSON-1961581930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.174fe168-41f8-4d1d-9c2b-8526ed2a3161" returned: 0 in 0.463s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-de79fd6c-eead-483a-b482-a05ffb1ecb22 tempest-VolumesSnapshotListTestJSON-1961581930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:11 devstack sudo[100933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.info Aug 10 12:56:11 devstack sudo[100933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:11 devstack sudo[100933]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-de79fd6c-eead-483a-b482-a05ffb1ecb22 tempest-VolumesSnapshotListTestJSON-1961581930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.info" returned: 0 in 0.426s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:11 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-de79fd6c-eead-483a-b482-a05ffb1ecb22 tempest-VolumesSnapshotListTestJSON-1961581930 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.info is being set with open permissions: ugo+rw Aug 10 12:56:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-de79fd6c-eead-483a-b482-a05ffb1ecb22 tempest-VolumesSnapshotListTestJSON-1961581930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:12 devstack sudo[100950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.info Aug 10 12:56:12 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:12 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-de79fd6c-eead-483a-b482-a05ffb1ecb22 tempest-VolumesSnapshotListTestJSON-1961581930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.info" returned: 0 in 0.536s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-de79fd6c-eead-483a-b482-a05ffb1ecb22 tempest-VolumesSnapshotListTestJSON-1961581930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.162s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:56:12 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-de79fd6c-eead-483a-b482-a05ffb1ecb22 tempest-VolumesSnapshotListTestJSON-1961581930 None] Create snapshot completed successfully Aug 10 12:56:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2a346892-1ec6-47e7-b281-e43fb6cfb9db tempest-VolumesSnapshotListTestJSON-1961581930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:56:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2a346892-1ec6-47e7-b281-e43fb6cfb9db tempest-VolumesSnapshotListTestJSON-1961581930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:56:14 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-2a346892-1ec6-47e7-b281-e43fb6cfb9db tempest-VolumesSnapshotListTestJSON-1961581930 None] Creating offline snapshot f0b6fca2-b167-43a9-a3ac-555091409447 of volume 082cf278-e5f8-4a9e-8fe8-9af57945e8fd {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 12:56:14 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[379658bb-70e9-41f6-b62c-e04a01d6e2a3]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:56:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2a346892-1ec6-47e7-b281-e43fb6cfb9db tempest-VolumesSnapshotListTestJSON-1961581930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.174fe168-41f8-4d1d-9c2b-8526ed2a3161 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:14 devstack sudo[100967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.174fe168-41f8-4d1d-9c2b-8526ed2a3161 Aug 10 12:56:14 devstack sudo[100967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:14 devstack sudo[100967]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2a346892-1ec6-47e7-b281-e43fb6cfb9db tempest-VolumesSnapshotListTestJSON-1961581930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.174fe168-41f8-4d1d-9c2b-8526ed2a3161" returned: 0 in 0.473s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:14 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-2a346892-1ec6-47e7-b281-e43fb6cfb9db tempest-VolumesSnapshotListTestJSON-1961581930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 12:56:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2a346892-1ec6-47e7-b281-e43fb6cfb9db tempest-VolumesSnapshotListTestJSON-1961581930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.174fe168-41f8-4d1d-9c2b-8526ed2a3161,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.f0b6fca2-b167-43a9-a3ac-555091409447 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:14 devstack sudo[100972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.174fe168-41f8-4d1d-9c2b-8526ed2a3161,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.f0b6fca2-b167-43a9-a3ac-555091409447 1G Aug 10 12:56:14 devstack sudo[100972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:15 devstack sudo[100972]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2a346892-1ec6-47e7-b281-e43fb6cfb9db tempest-VolumesSnapshotListTestJSON-1961581930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.174fe168-41f8-4d1d-9c2b-8526ed2a3161,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.f0b6fca2-b167-43a9-a3ac-555091409447 1G" returned: 0 in 0.714s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2a346892-1ec6-47e7-b281-e43fb6cfb9db tempest-VolumesSnapshotListTestJSON-1961581930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.174fe168-41f8-4d1d-9c2b-8526ed2a3161 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.f0b6fca2-b167-43a9-a3ac-555091409447 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:15 devstack sudo[100977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.174fe168-41f8-4d1d-9c2b-8526ed2a3161 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.f0b6fca2-b167-43a9-a3ac-555091409447 Aug 10 12:56:15 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:15 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2a346892-1ec6-47e7-b281-e43fb6cfb9db tempest-VolumesSnapshotListTestJSON-1961581930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.174fe168-41f8-4d1d-9c2b-8526ed2a3161 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.f0b6fca2-b167-43a9-a3ac-555091409447" returned: 0 in 0.454s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:15 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-2a346892-1ec6-47e7-b281-e43fb6cfb9db tempest-VolumesSnapshotListTestJSON-1961581930 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.f0b6fca2-b167-43a9-a3ac-555091409447 is being set with open permissions: ugo+rw Aug 10 12:56:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2a346892-1ec6-47e7-b281-e43fb6cfb9db tempest-VolumesSnapshotListTestJSON-1961581930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.f0b6fca2-b167-43a9-a3ac-555091409447 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:15 devstack sudo[100982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.f0b6fca2-b167-43a9-a3ac-555091409447 Aug 10 12:56:15 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:16 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2a346892-1ec6-47e7-b281-e43fb6cfb9db tempest-VolumesSnapshotListTestJSON-1961581930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.f0b6fca2-b167-43a9-a3ac-555091409447" returned: 0 in 0.370s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2a346892-1ec6-47e7-b281-e43fb6cfb9db tempest-VolumesSnapshotListTestJSON-1961581930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.189s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:56:16 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-2a346892-1ec6-47e7-b281-e43fb6cfb9db tempest-VolumesSnapshotListTestJSON-1961581930 None] Create snapshot completed successfully Aug 10 12:56:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-bcee03a9-d499-4723-a2a3-1695ee83e46c tempest-VolumesSnapshotListTestJSON-1961581930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:56:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-bcee03a9-d499-4723-a2a3-1695ee83e46c tempest-VolumesSnapshotListTestJSON-1961581930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:56:17 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-bcee03a9-d499-4723-a2a3-1695ee83e46c tempest-VolumesSnapshotListTestJSON-1961581930 None] Creating offline snapshot 896a0c2c-1a0c-44c1-9e04-89e0a6aac7ef of volume 082cf278-e5f8-4a9e-8fe8-9af57945e8fd {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 12:56:17 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5854501-3a64-4f7a-8f81-814f90530aaf]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:56:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-bcee03a9-d499-4723-a2a3-1695ee83e46c tempest-VolumesSnapshotListTestJSON-1961581930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.f0b6fca2-b167-43a9-a3ac-555091409447 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:17 devstack sudo[100986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.f0b6fca2-b167-43a9-a3ac-555091409447 Aug 10 12:56:17 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:18 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-bcee03a9-d499-4723-a2a3-1695ee83e46c tempest-VolumesSnapshotListTestJSON-1961581930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.f0b6fca2-b167-43a9-a3ac-555091409447" returned: 0 in 0.421s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:18 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-bcee03a9-d499-4723-a2a3-1695ee83e46c tempest-VolumesSnapshotListTestJSON-1961581930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 12:56:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-bcee03a9-d499-4723-a2a3-1695ee83e46c tempest-VolumesSnapshotListTestJSON-1961581930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.f0b6fca2-b167-43a9-a3ac-555091409447,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.896a0c2c-1a0c-44c1-9e04-89e0a6aac7ef 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:18 devstack sudo[100992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.f0b6fca2-b167-43a9-a3ac-555091409447,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.896a0c2c-1a0c-44c1-9e04-89e0a6aac7ef 1G Aug 10 12:56:18 devstack sudo[100992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:18 devstack sudo[100992]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-bcee03a9-d499-4723-a2a3-1695ee83e46c tempest-VolumesSnapshotListTestJSON-1961581930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.f0b6fca2-b167-43a9-a3ac-555091409447,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.896a0c2c-1a0c-44c1-9e04-89e0a6aac7ef 1G" returned: 0 in 0.736s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-bcee03a9-d499-4723-a2a3-1695ee83e46c tempest-VolumesSnapshotListTestJSON-1961581930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.f0b6fca2-b167-43a9-a3ac-555091409447 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.896a0c2c-1a0c-44c1-9e04-89e0a6aac7ef {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:18 devstack sudo[100999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.f0b6fca2-b167-43a9-a3ac-555091409447 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.896a0c2c-1a0c-44c1-9e04-89e0a6aac7ef Aug 10 12:56:18 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:19 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-bcee03a9-d499-4723-a2a3-1695ee83e46c tempest-VolumesSnapshotListTestJSON-1961581930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.f0b6fca2-b167-43a9-a3ac-555091409447 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.896a0c2c-1a0c-44c1-9e04-89e0a6aac7ef" returned: 0 in 0.385s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:19 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-bcee03a9-d499-4723-a2a3-1695ee83e46c tempest-VolumesSnapshotListTestJSON-1961581930 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.896a0c2c-1a0c-44c1-9e04-89e0a6aac7ef is being set with open permissions: ugo+rw Aug 10 12:56:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-bcee03a9-d499-4723-a2a3-1695ee83e46c tempest-VolumesSnapshotListTestJSON-1961581930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.896a0c2c-1a0c-44c1-9e04-89e0a6aac7ef {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:19 devstack sudo[101004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.896a0c2c-1a0c-44c1-9e04-89e0a6aac7ef Aug 10 12:56:19 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:19 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-bcee03a9-d499-4723-a2a3-1695ee83e46c tempest-VolumesSnapshotListTestJSON-1961581930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.896a0c2c-1a0c-44c1-9e04-89e0a6aac7ef" returned: 0 in 0.428s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-bcee03a9-d499-4723-a2a3-1695ee83e46c tempest-VolumesSnapshotListTestJSON-1961581930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.089s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:56:19 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-bcee03a9-d499-4723-a2a3-1695ee83e46c tempest-VolumesSnapshotListTestJSON-1961581930 None] Create snapshot completed successfully Aug 10 12:56:21 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-cf2d7b29-c44b-45b2-9008-a2be00347c6e tempest-VolumesSnapshotListTestJSON-1961581930 None] Acquiring lock "cinder-896a0c2c-1a0c-44c1-9e04-89e0a6aac7ef-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:56:21 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-cf2d7b29-c44b-45b2-9008-a2be00347c6e tempest-VolumesSnapshotListTestJSON-1961581930 None] Lock "cinder-896a0c2c-1a0c-44c1-9e04-89e0a6aac7ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:56:21 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-cf2d7b29-c44b-45b2-9008-a2be00347c6e tempest-VolumesSnapshotListTestJSON-1961581930 None] Acquiring lock "cinder-quobyte-082cf278-e5f8-4a9e-8fe8-9af57945e8fd" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:56:21 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-cf2d7b29-c44b-45b2-9008-a2be00347c6e tempest-VolumesSnapshotListTestJSON-1961581930 None] Lock "cinder-quobyte-082cf278-e5f8-4a9e-8fe8-9af57945e8fd" acquired by "delete_snapshot" :: waited 0.040s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:56:22 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-cf2d7b29-c44b-45b2-9008-a2be00347c6e tempest-VolumesSnapshotListTestJSON-1961581930 None] Acquiring lock "cinder-quobyte-896a0c2c-1a0c-44c1-9e04-89e0a6aac7ef" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:56:22 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-cf2d7b29-c44b-45b2-9008-a2be00347c6e tempest-VolumesSnapshotListTestJSON-1961581930 None] Lock "cinder-quobyte-896a0c2c-1a0c-44c1-9e04-89e0a6aac7ef" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:56:22 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-cf2d7b29-c44b-45b2-9008-a2be00347c6e tempest-VolumesSnapshotListTestJSON-1961581930 None] Deleting offline snapshot 896a0c2c-1a0c-44c1-9e04-89e0a6aac7ef of volume 082cf278-e5f8-4a9e-8fe8-9af57945e8fd {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 12:56:22 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-cf2d7b29-c44b-45b2-9008-a2be00347c6e tempest-VolumesSnapshotListTestJSON-1961581930 None] snapshot_file for this snap is: volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.896a0c2c-1a0c-44c1-9e04-89e0a6aac7ef {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 12:56:22 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e81b23-1b46-47c0-adba-961b490f883c]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:56:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-cf2d7b29-c44b-45b2-9008-a2be00347c6e tempest-VolumesSnapshotListTestJSON-1961581930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.896a0c2c-1a0c-44c1-9e04-89e0a6aac7ef {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:22 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.896a0c2c-1a0c-44c1-9e04-89e0a6aac7ef Aug 10 12:56:22 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:22 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-cf2d7b29-c44b-45b2-9008-a2be00347c6e tempest-VolumesSnapshotListTestJSON-1961581930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.896a0c2c-1a0c-44c1-9e04-89e0a6aac7ef" returned: 0 in 0.610s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:22 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-cf2d7b29-c44b-45b2-9008-a2be00347c6e tempest-VolumesSnapshotListTestJSON-1961581930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 12:56:22 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[03adc817-99b4-439e-b422-7c22855f79f9]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:56:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-cf2d7b29-c44b-45b2-9008-a2be00347c6e tempest-VolumesSnapshotListTestJSON-1961581930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.f0b6fca2-b167-43a9-a3ac-555091409447 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:22 devstack sudo[101013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.f0b6fca2-b167-43a9-a3ac-555091409447 Aug 10 12:56:22 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:23 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-cf2d7b29-c44b-45b2-9008-a2be00347c6e tempest-VolumesSnapshotListTestJSON-1961581930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.f0b6fca2-b167-43a9-a3ac-555091409447" returned: 0 in 0.458s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:23 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-cf2d7b29-c44b-45b2-9008-a2be00347c6e tempest-VolumesSnapshotListTestJSON-1961581930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 12:56:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-cf2d7b29-c44b-45b2-9008-a2be00347c6e tempest-VolumesSnapshotListTestJSON-1961581930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.896a0c2c-1a0c-44c1-9e04-89e0a6aac7ef {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:23 devstack sudo[101018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.896a0c2c-1a0c-44c1-9e04-89e0a6aac7ef Aug 10 12:56:23 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:23 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-cf2d7b29-c44b-45b2-9008-a2be00347c6e tempest-VolumesSnapshotListTestJSON-1961581930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.896a0c2c-1a0c-44c1-9e04-89e0a6aac7ef" returned: 0 in 0.548s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-cf2d7b29-c44b-45b2-9008-a2be00347c6e tempest-VolumesSnapshotListTestJSON-1961581930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.896a0c2c-1a0c-44c1-9e04-89e0a6aac7ef {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:23 devstack sudo[101025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.896a0c2c-1a0c-44c1-9e04-89e0a6aac7ef Aug 10 12:56:23 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:24 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-cf2d7b29-c44b-45b2-9008-a2be00347c6e tempest-VolumesSnapshotListTestJSON-1961581930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.896a0c2c-1a0c-44c1-9e04-89e0a6aac7ef" returned: 0 in 0.354s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:24 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-cf2d7b29-c44b-45b2-9008-a2be00347c6e tempest-VolumesSnapshotListTestJSON-1961581930 None] Lock "cinder-quobyte-896a0c2c-1a0c-44c1-9e04-89e0a6aac7ef" released by "_delete_snapshot" :: held 2.130s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:56:24 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-cf2d7b29-c44b-45b2-9008-a2be00347c6e tempest-VolumesSnapshotListTestJSON-1961581930 None] Lock "cinder-quobyte-082cf278-e5f8-4a9e-8fe8-9af57945e8fd" released by "delete_snapshot" :: held 2.185s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:56:24 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-cf2d7b29-c44b-45b2-9008-a2be00347c6e tempest-VolumesSnapshotListTestJSON-1961581930 None] Created reservations ['479cd724-8e5b-4144-a716-7eef397bd2e0', 'c119c78a-7a3b-474d-b9be-87c8b720b3b3', 'b02c426c-894f-4a62-8250-c369ab52f054', '1642cca8-5b12-4263-8b59-f56b1f40ba1f'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:56:24 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-cf2d7b29-c44b-45b2-9008-a2be00347c6e tempest-VolumesSnapshotListTestJSON-1961581930 None] Delete snapshot completed successfully. Aug 10 12:56:24 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-cf2d7b29-c44b-45b2-9008-a2be00347c6e tempest-VolumesSnapshotListTestJSON-1961581930 None] Lock "cinder-896a0c2c-1a0c-44c1-9e04-89e0a6aac7ef-delete_snapshot" released by "delete_snapshot" :: held 2.374s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:56:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8ce962d4-9a61-427f-81d4-1cff97f960b9 tempest-VolumesSnapshotListTestJSON-1961581930 None] Acquiring lock "cinder-f0b6fca2-b167-43a9-a3ac-555091409447-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:56:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8ce962d4-9a61-427f-81d4-1cff97f960b9 tempest-VolumesSnapshotListTestJSON-1961581930 None] Lock "cinder-f0b6fca2-b167-43a9-a3ac-555091409447-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:56:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8ce962d4-9a61-427f-81d4-1cff97f960b9 tempest-VolumesSnapshotListTestJSON-1961581930 None] Acquiring lock "cinder-quobyte-082cf278-e5f8-4a9e-8fe8-9af57945e8fd" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:56:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8ce962d4-9a61-427f-81d4-1cff97f960b9 tempest-VolumesSnapshotListTestJSON-1961581930 None] Lock "cinder-quobyte-082cf278-e5f8-4a9e-8fe8-9af57945e8fd" acquired by "delete_snapshot" :: waited 0.028s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:56:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8ce962d4-9a61-427f-81d4-1cff97f960b9 tempest-VolumesSnapshotListTestJSON-1961581930 None] Acquiring lock "cinder-quobyte-f0b6fca2-b167-43a9-a3ac-555091409447" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:56:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8ce962d4-9a61-427f-81d4-1cff97f960b9 tempest-VolumesSnapshotListTestJSON-1961581930 None] Lock "cinder-quobyte-f0b6fca2-b167-43a9-a3ac-555091409447" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:56:25 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-8ce962d4-9a61-427f-81d4-1cff97f960b9 tempest-VolumesSnapshotListTestJSON-1961581930 None] Deleting offline snapshot f0b6fca2-b167-43a9-a3ac-555091409447 of volume 082cf278-e5f8-4a9e-8fe8-9af57945e8fd {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 12:56:25 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-8ce962d4-9a61-427f-81d4-1cff97f960b9 tempest-VolumesSnapshotListTestJSON-1961581930 None] snapshot_file for this snap is: volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.f0b6fca2-b167-43a9-a3ac-555091409447 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 12:56:25 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0eb964c-9a05-44da-ae98-7393222cecbe]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:56:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8ce962d4-9a61-427f-81d4-1cff97f960b9 tempest-VolumesSnapshotListTestJSON-1961581930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.f0b6fca2-b167-43a9-a3ac-555091409447 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:25 devstack sudo[101066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.f0b6fca2-b167-43a9-a3ac-555091409447 Aug 10 12:56:25 devstack sudo[101066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:25 devstack sudo[101066]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8ce962d4-9a61-427f-81d4-1cff97f960b9 tempest-VolumesSnapshotListTestJSON-1961581930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.f0b6fca2-b167-43a9-a3ac-555091409447" returned: 0 in 0.533s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:25 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-8ce962d4-9a61-427f-81d4-1cff97f960b9 tempest-VolumesSnapshotListTestJSON-1961581930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 12:56:26 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1a24ae-5303-480b-b157-1faf9e3219e5]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:56:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8ce962d4-9a61-427f-81d4-1cff97f960b9 tempest-VolumesSnapshotListTestJSON-1961581930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.174fe168-41f8-4d1d-9c2b-8526ed2a3161 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:26 devstack sudo[101072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.174fe168-41f8-4d1d-9c2b-8526ed2a3161 Aug 10 12:56:26 devstack sudo[101072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:26 devstack sudo[101072]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8ce962d4-9a61-427f-81d4-1cff97f960b9 tempest-VolumesSnapshotListTestJSON-1961581930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.174fe168-41f8-4d1d-9c2b-8526ed2a3161" returned: 0 in 0.443s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:26 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-8ce962d4-9a61-427f-81d4-1cff97f960b9 tempest-VolumesSnapshotListTestJSON-1961581930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 12:56:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8ce962d4-9a61-427f-81d4-1cff97f960b9 tempest-VolumesSnapshotListTestJSON-1961581930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.f0b6fca2-b167-43a9-a3ac-555091409447 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:26 devstack sudo[101077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.f0b6fca2-b167-43a9-a3ac-555091409447 Aug 10 12:56:26 devstack sudo[101077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:26 devstack sudo[101077]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8ce962d4-9a61-427f-81d4-1cff97f960b9 tempest-VolumesSnapshotListTestJSON-1961581930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.f0b6fca2-b167-43a9-a3ac-555091409447" returned: 0 in 0.397s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8ce962d4-9a61-427f-81d4-1cff97f960b9 tempest-VolumesSnapshotListTestJSON-1961581930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.f0b6fca2-b167-43a9-a3ac-555091409447 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:26 devstack sudo[101083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.f0b6fca2-b167-43a9-a3ac-555091409447 Aug 10 12:56:26 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:27 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8ce962d4-9a61-427f-81d4-1cff97f960b9 tempest-VolumesSnapshotListTestJSON-1961581930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.f0b6fca2-b167-43a9-a3ac-555091409447" returned: 0 in 0.255s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:27 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8ce962d4-9a61-427f-81d4-1cff97f960b9 tempest-VolumesSnapshotListTestJSON-1961581930 None] Lock "cinder-quobyte-f0b6fca2-b167-43a9-a3ac-555091409447" released by "_delete_snapshot" :: held 1.774s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:56:27 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8ce962d4-9a61-427f-81d4-1cff97f960b9 tempest-VolumesSnapshotListTestJSON-1961581930 None] Lock "cinder-quobyte-082cf278-e5f8-4a9e-8fe8-9af57945e8fd" released by "delete_snapshot" :: held 1.823s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:56:27 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-8ce962d4-9a61-427f-81d4-1cff97f960b9 tempest-VolumesSnapshotListTestJSON-1961581930 None] Created reservations ['b8b6bb5e-8224-4b79-b96f-38fefe7757a4', '0fb5ca65-faf3-4aaa-b4ed-97fa1dc41a4b', 'b804d506-4d93-47a3-9efa-afb90a4d01a5', '0ea8508b-f34f-445f-a75c-540134abb6f4'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:56:27 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-8ce962d4-9a61-427f-81d4-1cff97f960b9 tempest-VolumesSnapshotListTestJSON-1961581930 None] Delete snapshot completed successfully. Aug 10 12:56:27 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8ce962d4-9a61-427f-81d4-1cff97f960b9 tempest-VolumesSnapshotListTestJSON-1961581930 None] Lock "cinder-f0b6fca2-b167-43a9-a3ac-555091409447-delete_snapshot" released by "delete_snapshot" :: held 2.007s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:56:27 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b326030c-77e9-412b-a86c-ebff73b3efdb tempest-VolumesSnapshotListTestJSON-1961581930 None] Acquiring lock "cinder-174fe168-41f8-4d1d-9c2b-8526ed2a3161-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:56:27 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b326030c-77e9-412b-a86c-ebff73b3efdb tempest-VolumesSnapshotListTestJSON-1961581930 None] Lock "cinder-174fe168-41f8-4d1d-9c2b-8526ed2a3161-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:56:27 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b326030c-77e9-412b-a86c-ebff73b3efdb tempest-VolumesSnapshotListTestJSON-1961581930 None] Acquiring lock "cinder-quobyte-082cf278-e5f8-4a9e-8fe8-9af57945e8fd" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:56:27 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b326030c-77e9-412b-a86c-ebff73b3efdb tempest-VolumesSnapshotListTestJSON-1961581930 None] Lock "cinder-quobyte-082cf278-e5f8-4a9e-8fe8-9af57945e8fd" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:56:27 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b326030c-77e9-412b-a86c-ebff73b3efdb tempest-VolumesSnapshotListTestJSON-1961581930 None] Acquiring lock "cinder-quobyte-174fe168-41f8-4d1d-9c2b-8526ed2a3161" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:56:27 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b326030c-77e9-412b-a86c-ebff73b3efdb tempest-VolumesSnapshotListTestJSON-1961581930 None] Lock "cinder-quobyte-174fe168-41f8-4d1d-9c2b-8526ed2a3161" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:56:27 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-b326030c-77e9-412b-a86c-ebff73b3efdb tempest-VolumesSnapshotListTestJSON-1961581930 None] Deleting offline snapshot 174fe168-41f8-4d1d-9c2b-8526ed2a3161 of volume 082cf278-e5f8-4a9e-8fe8-9af57945e8fd {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 12:56:27 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-b326030c-77e9-412b-a86c-ebff73b3efdb tempest-VolumesSnapshotListTestJSON-1961581930 None] snapshot_file for this snap is: volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.174fe168-41f8-4d1d-9c2b-8526ed2a3161 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 12:56:27 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[16aa00b5-04ad-4f85-a749-c401efc46f66]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:56:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b326030c-77e9-412b-a86c-ebff73b3efdb tempest-VolumesSnapshotListTestJSON-1961581930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.174fe168-41f8-4d1d-9c2b-8526ed2a3161 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:27 devstack sudo[101086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.174fe168-41f8-4d1d-9c2b-8526ed2a3161 Aug 10 12:56:27 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:28 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b326030c-77e9-412b-a86c-ebff73b3efdb tempest-VolumesSnapshotListTestJSON-1961581930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.174fe168-41f8-4d1d-9c2b-8526ed2a3161" returned: 0 in 0.385s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:28 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-b326030c-77e9-412b-a86c-ebff73b3efdb tempest-VolumesSnapshotListTestJSON-1961581930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 12:56:28 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[dede7962-8f86-481e-8c40-7e5c6468fe19]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:56:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b326030c-77e9-412b-a86c-ebff73b3efdb tempest-VolumesSnapshotListTestJSON-1961581930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:28 devstack sudo[101091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd Aug 10 12:56:28 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:28 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b326030c-77e9-412b-a86c-ebff73b3efdb tempest-VolumesSnapshotListTestJSON-1961581930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd" returned: 0 in 0.414s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b326030c-77e9-412b-a86c-ebff73b3efdb tempest-VolumesSnapshotListTestJSON-1961581930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.174fe168-41f8-4d1d-9c2b-8526ed2a3161 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:28 devstack sudo[101097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.174fe168-41f8-4d1d-9c2b-8526ed2a3161 Aug 10 12:56:28 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:28 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b326030c-77e9-412b-a86c-ebff73b3efdb tempest-VolumesSnapshotListTestJSON-1961581930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.174fe168-41f8-4d1d-9c2b-8526ed2a3161" returned: 0 in 0.351s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b326030c-77e9-412b-a86c-ebff73b3efdb tempest-VolumesSnapshotListTestJSON-1961581930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.174fe168-41f8-4d1d-9c2b-8526ed2a3161 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:28 devstack sudo[101102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.174fe168-41f8-4d1d-9c2b-8526ed2a3161 Aug 10 12:56:28 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:29 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b326030c-77e9-412b-a86c-ebff73b3efdb tempest-VolumesSnapshotListTestJSON-1961581930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd.174fe168-41f8-4d1d-9c2b-8526ed2a3161" returned: 0 in 0.262s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:29 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b326030c-77e9-412b-a86c-ebff73b3efdb tempest-VolumesSnapshotListTestJSON-1961581930 None] Lock "cinder-quobyte-174fe168-41f8-4d1d-9c2b-8526ed2a3161" released by "_delete_snapshot" :: held 1.533s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:56:29 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b326030c-77e9-412b-a86c-ebff73b3efdb tempest-VolumesSnapshotListTestJSON-1961581930 None] Lock "cinder-quobyte-082cf278-e5f8-4a9e-8fe8-9af57945e8fd" released by "delete_snapshot" :: held 1.557s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:56:29 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-b326030c-77e9-412b-a86c-ebff73b3efdb tempest-VolumesSnapshotListTestJSON-1961581930 None] Created reservations ['1902a7fc-0702-41e4-8fc1-ee3472d8a3b0', '1ba2442a-2b7a-40b7-b725-84390ec89a91', '84b072c2-5d8e-42a5-88fc-c217e9334cfb', '44872077-c486-4cce-81b9-6e5de82939f7'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:56:29 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-b326030c-77e9-412b-a86c-ebff73b3efdb tempest-VolumesSnapshotListTestJSON-1961581930 None] Delete snapshot completed successfully. Aug 10 12:56:29 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b326030c-77e9-412b-a86c-ebff73b3efdb tempest-VolumesSnapshotListTestJSON-1961581930 None] Lock "cinder-174fe168-41f8-4d1d-9c2b-8526ed2a3161-delete_snapshot" released by "delete_snapshot" :: held 1.714s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:56:29 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b1a90a32-84cf-4209-b562-77106ceb6ad8 tempest-VolumesSnapshotListTestJSON-1961581930 None] Acquiring lock "cinder-082cf278-e5f8-4a9e-8fe8-9af57945e8fd-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:56:29 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b1a90a32-84cf-4209-b562-77106ceb6ad8 tempest-VolumesSnapshotListTestJSON-1961581930 None] Lock "cinder-082cf278-e5f8-4a9e-8fe8-9af57945e8fd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:56:29 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b1a90a32-84cf-4209-b562-77106ceb6ad8 tempest-VolumesSnapshotListTestJSON-1961581930 None] Acquiring lock "cinder-quobyte-082cf278-e5f8-4a9e-8fe8-9af57945e8fd" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:56:29 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b1a90a32-84cf-4209-b562-77106ceb6ad8 tempest-VolumesSnapshotListTestJSON-1961581930 None] Lock "cinder-quobyte-082cf278-e5f8-4a9e-8fe8-9af57945e8fd" acquired by "delete_volume" :: waited 0.018s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:56:29 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e9cbe2-853d-4aae-b9b7-c422c5add86f]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:56:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b1a90a32-84cf-4209-b562-77106ceb6ad8 tempest-VolumesSnapshotListTestJSON-1961581930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:30 devstack sudo[101105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd Aug 10 12:56:30 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:30 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b1a90a32-84cf-4209-b562-77106ceb6ad8 tempest-VolumesSnapshotListTestJSON-1961581930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd" returned: 0 in 0.430s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b1a90a32-84cf-4209-b562-77106ceb6ad8 tempest-VolumesSnapshotListTestJSON-1961581930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:30 devstack sudo[101111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd Aug 10 12:56:30 devstack sudo[101111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:30 devstack sudo[101111]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b1a90a32-84cf-4209-b562-77106ceb6ad8 tempest-VolumesSnapshotListTestJSON-1961581930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-082cf278-e5f8-4a9e-8fe8-9af57945e8fd" returned: 0 in 0.271s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:30 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b1a90a32-84cf-4209-b562-77106ceb6ad8 tempest-VolumesSnapshotListTestJSON-1961581930 None] Lock "cinder-quobyte-082cf278-e5f8-4a9e-8fe8-9af57945e8fd" released by "delete_volume" :: held 0.768s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:56:30 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-b1a90a32-84cf-4209-b562-77106ceb6ad8 tempest-VolumesSnapshotListTestJSON-1961581930 None] Created reservations ['39857ea0-9513-4e73-a17a-7bef073b1159', '019dac0c-69d7-44be-b27f-01b67bc872b1', 'ab9c17c2-99e9-44d3-a98b-c3d3241dd68a', '378b9642-1dde-4d99-942e-ea31971de73c'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:56:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b1a90a32-84cf-4209-b562-77106ceb6ad8 tempest-VolumesSnapshotListTestJSON-1961581930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:56:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b1a90a32-84cf-4209-b562-77106ceb6ad8 tempest-VolumesSnapshotListTestJSON-1961581930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:56:30 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b1a90a32-84cf-4209-b562-77106ceb6ad8 tempest-VolumesSnapshotListTestJSON-1961581930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:56:30 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b1a90a32-84cf-4209-b562-77106ceb6ad8 tempest-VolumesSnapshotListTestJSON-1961581930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:56:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b1a90a32-84cf-4209-b562-77106ceb6ad8 tempest-VolumesSnapshotListTestJSON-1961581930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:56:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b1a90a32-84cf-4209-b562-77106ceb6ad8 tempest-VolumesSnapshotListTestJSON-1961581930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:30 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:56:30 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:31 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b1a90a32-84cf-4209-b562-77106ceb6ad8 tempest-VolumesSnapshotListTestJSON-1961581930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.300s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:31 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-b1a90a32-84cf-4209-b562-77106ceb6ad8 tempest-VolumesSnapshotListTestJSON-1961581930 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:56:31 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-b1a90a32-84cf-4209-b562-77106ceb6ad8 tempest-VolumesSnapshotListTestJSON-1961581930 None] Deleted volume successfully. Aug 10 12:56:31 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b1a90a32-84cf-4209-b562-77106ceb6ad8 tempest-VolumesSnapshotListTestJSON-1961581930 None] Lock "cinder-082cf278-e5f8-4a9e-8fe8-9af57945e8fd-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:56:40 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-a605e6aa-3b12-44b2-8720-96e1e78bd728 req-8807bb0b-8845-4a4f-8812-3bcc9a37c486 tempest-TestMinimumBasicScenario-252509828 None] Terminate volume connection completed successfully. Aug 10 12:56:40 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-a605e6aa-3b12-44b2-8720-96e1e78bd728 req-8807bb0b-8845-4a4f-8812-3bcc9a37c486 tempest-TestMinimumBasicScenario-252509828 None] Deleting attachment 8fec807d-0ab8-4143-af97-9379e9e503c4. {{(pid=89096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Aug 10 12:56:40 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-1cb6ccc4-3037-4a41-a462-cd088cb910f4 tempest-TestMinimumBasicScenario-252509828 None] Acquiring lock "cinder-c8f3ce0e-bd03-41e1-afd1-176245b32e79-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:56:40 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-1cb6ccc4-3037-4a41-a462-cd088cb910f4 tempest-TestMinimumBasicScenario-252509828 None] Lock "cinder-c8f3ce0e-bd03-41e1-afd1-176245b32e79-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:56:40 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-1cb6ccc4-3037-4a41-a462-cd088cb910f4 tempest-TestMinimumBasicScenario-252509828 None] Acquiring lock "cinder-quobyte-c8f3ce0e-bd03-41e1-afd1-176245b32e79" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:56:40 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-1cb6ccc4-3037-4a41-a462-cd088cb910f4 tempest-TestMinimumBasicScenario-252509828 None] Lock "cinder-quobyte-c8f3ce0e-bd03-41e1-afd1-176245b32e79" acquired by "delete_volume" :: waited 0.018s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:56:40 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[f044458b-4365-4912-bc7b-7ba08f1c03f6]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:56:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1cb6ccc4-3037-4a41-a462-cd088cb910f4 tempest-TestMinimumBasicScenario-252509828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c8f3ce0e-bd03-41e1-afd1-176245b32e79 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:41 devstack sudo[101136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c8f3ce0e-bd03-41e1-afd1-176245b32e79 Aug 10 12:56:41 devstack sudo[101136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:41 devstack sudo[101136]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1cb6ccc4-3037-4a41-a462-cd088cb910f4 tempest-TestMinimumBasicScenario-252509828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c8f3ce0e-bd03-41e1-afd1-176245b32e79" returned: 0 in 0.539s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1cb6ccc4-3037-4a41-a462-cd088cb910f4 tempest-TestMinimumBasicScenario-252509828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c8f3ce0e-bd03-41e1-afd1-176245b32e79 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:41 devstack sudo[101142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c8f3ce0e-bd03-41e1-afd1-176245b32e79 Aug 10 12:56:41 devstack sudo[101142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:41 devstack sudo[101142]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1cb6ccc4-3037-4a41-a462-cd088cb910f4 tempest-TestMinimumBasicScenario-252509828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c8f3ce0e-bd03-41e1-afd1-176245b32e79" returned: 0 in 0.308s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:41 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-1cb6ccc4-3037-4a41-a462-cd088cb910f4 tempest-TestMinimumBasicScenario-252509828 None] Lock "cinder-quobyte-c8f3ce0e-bd03-41e1-afd1-176245b32e79" released by "delete_volume" :: held 0.918s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:56:41 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-1cb6ccc4-3037-4a41-a462-cd088cb910f4 tempest-TestMinimumBasicScenario-252509828 None] Created reservations ['a03e6308-1253-4579-b867-5b68fdba7747', 'b9c27f4b-26f5-4e7d-bf2b-9857ae7a9745', '55263415-d4be-4dbd-a035-2c641638228f', '14157414-b0cd-460a-bb8c-c2a29e656ff7'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:56:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1cb6ccc4-3037-4a41-a462-cd088cb910f4 tempest-TestMinimumBasicScenario-252509828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:56:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1cb6ccc4-3037-4a41-a462-cd088cb910f4 tempest-TestMinimumBasicScenario-252509828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:56:41 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1cb6ccc4-3037-4a41-a462-cd088cb910f4 tempest-TestMinimumBasicScenario-252509828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:56:41 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1cb6ccc4-3037-4a41-a462-cd088cb910f4 tempest-TestMinimumBasicScenario-252509828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:56:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1cb6ccc4-3037-4a41-a462-cd088cb910f4 tempest-TestMinimumBasicScenario-252509828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:56:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1cb6ccc4-3037-4a41-a462-cd088cb910f4 tempest-TestMinimumBasicScenario-252509828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:42 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:56:42 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:42 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1cb6ccc4-3037-4a41-a462-cd088cb910f4 tempest-TestMinimumBasicScenario-252509828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.502s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:42 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-1cb6ccc4-3037-4a41-a462-cd088cb910f4 tempest-TestMinimumBasicScenario-252509828 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:56:42 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-1cb6ccc4-3037-4a41-a462-cd088cb910f4 tempest-TestMinimumBasicScenario-252509828 None] Deleted volume successfully. Aug 10 12:56:42 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-1cb6ccc4-3037-4a41-a462-cd088cb910f4 tempest-TestMinimumBasicScenario-252509828 None] Lock "cinder-c8f3ce0e-bd03-41e1-afd1-176245b32e79-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:56:51 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=109,cinder:UPDATE=150,cinder:INSERT=36,cinder:DELETE=13 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:56:52 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=116,cinder:UPDATE=143,cinder:INSERT=37,cinder:DELETE=10 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:56:59 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-3819c9f3-9009-4c20-9fda-7362461bc7e3 tempest-TestImageHashVerification-1161664480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:56:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3819c9f3-9009-4c20-9fda-7362461bc7e3 tempest-TestImageHashVerification-1161664480 None] Flow 'volume_create_manager' (dceaa88f-f35c-4e24-9161-95a148ac8676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:56:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3819c9f3-9009-4c20-9fda-7362461bc7e3 tempest-TestImageHashVerification-1161664480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7bd0eed-c448-4c1b-8d44-d38e45651f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:56:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3819c9f3-9009-4c20-9fda-7362461bc7e3 tempest-TestImageHashVerification-1161664480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7bd0eed-c448-4c1b-8d44-d38e45651f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1119027823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d27fdeb-5c96-40dd-871d-782541e47616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52e20abe3e2d426d90827c4e6f3d2b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:56:59Z,use_quota=True,user_id='2db24ad87af544bb8033b9a8c7bccfa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:56:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3819c9f3-9009-4c20-9fda-7362461bc7e3 tempest-TestImageHashVerification-1161664480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (829c6b3d-2d88-44e9-88f8-d1a2f184b2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:56:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3819c9f3-9009-4c20-9fda-7362461bc7e3 tempest-TestImageHashVerification-1161664480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (829c6b3d-2d88-44e9-88f8-d1a2f184b2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:56:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3819c9f3-9009-4c20-9fda-7362461bc7e3 tempest-TestImageHashVerification-1161664480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a7eb8a-9283-4798-872c-81a1c8ab9b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:56:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3819c9f3-9009-4c20-9fda-7362461bc7e3 tempest-TestImageHashVerification-1161664480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a7eb8a-9283-4798-872c-81a1c8ab9b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d27fdeb-5c96-40dd-871d-782541e47616', 'volume_name': 'volume-9d27fdeb-5c96-40dd-871d-782541e47616', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:56:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3819c9f3-9009-4c20-9fda-7362461bc7e3 tempest-TestImageHashVerification-1161664480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18c5d818-69c6-4605-872e-5bc556deb3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:56:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3819c9f3-9009-4c20-9fda-7362461bc7e3 tempest-TestImageHashVerification-1161664480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18c5d818-69c6-4605-872e-5bc556deb3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:56:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3819c9f3-9009-4c20-9fda-7362461bc7e3 tempest-TestImageHashVerification-1161664480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4daff18b-2d24-4b0a-ae03-3eaf855b16c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:56:59 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-3819c9f3-9009-4c20-9fda-7362461bc7e3 tempest-TestImageHashVerification-1161664480 None] Volume 9d27fdeb-5c96-40dd-871d-782541e47616: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d27fdeb-5c96-40dd-871d-782541e47616', 'volume_size': 1} Aug 10 12:56:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3819c9f3-9009-4c20-9fda-7362461bc7e3 tempest-TestImageHashVerification-1161664480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:56:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3819c9f3-9009-4c20-9fda-7362461bc7e3 tempest-TestImageHashVerification-1161664480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:56:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3819c9f3-9009-4c20-9fda-7362461bc7e3 tempest-TestImageHashVerification-1161664480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1119027823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d27fdeb-5c96-40dd-871d-782541e47616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52e20abe3e2d426d90827c4e6f3d2b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:56:59Z,use_quota=True,user_id='2db24ad87af544bb8033b9a8c7bccfa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:56:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-3819c9f3-9009-4c20-9fda-7362461bc7e3 tempest-TestImageHashVerification-1161664480 None] Creating volume 9d27fdeb-5c96-40dd-871d-782541e47616 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:56:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3819c9f3-9009-4c20-9fda-7362461bc7e3 tempest-TestImageHashVerification-1161664480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:56:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3819c9f3-9009-4c20-9fda-7362461bc7e3 tempest-TestImageHashVerification-1161664480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:56:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3819c9f3-9009-4c20-9fda-7362461bc7e3 tempest-TestImageHashVerification-1161664480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:56:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3819c9f3-9009-4c20-9fda-7362461bc7e3 tempest-TestImageHashVerification-1161664480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:56:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3819c9f3-9009-4c20-9fda-7362461bc7e3 tempest-TestImageHashVerification-1161664480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:56:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3819c9f3-9009-4c20-9fda-7362461bc7e3 tempest-TestImageHashVerification-1161664480 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:56:59 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-3819c9f3-9009-4c20-9fda-7362461bc7e3 tempest-TestImageHashVerification-1161664480 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:56:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3819c9f3-9009-4c20-9fda-7362461bc7e3 tempest-TestImageHashVerification-1161664480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9d27fdeb-5c96-40dd-871d-782541e47616 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:59 devstack sudo[101288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9d27fdeb-5c96-40dd-871d-782541e47616 1073741824 Aug 10 12:56:59 devstack sudo[101288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:56:59 devstack sudo[101288]: pam_unix(sudo:session): session closed for user root Aug 10 12:56:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3819c9f3-9009-4c20-9fda-7362461bc7e3 tempest-TestImageHashVerification-1161664480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9d27fdeb-5c96-40dd-871d-782541e47616 1073741824" returned: 0 in 0.702s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:56:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3819c9f3-9009-4c20-9fda-7362461bc7e3 tempest-TestImageHashVerification-1161664480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9d27fdeb-5c96-40dd-871d-782541e47616 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:56:59 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9d27fdeb-5c96-40dd-871d-782541e47616 Aug 10 12:56:59 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:57:00 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Aug 10 12:57:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3819c9f3-9009-4c20-9fda-7362461bc7e3 tempest-TestImageHashVerification-1161664480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9d27fdeb-5c96-40dd-871d-782541e47616" returned: 0 in 0.356s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:57:00 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3819c9f3-9009-4c20-9fda-7362461bc7e3 tempest-TestImageHashVerification-1161664480 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:57:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3819c9f3-9009-4c20-9fda-7362461bc7e3 tempest-TestImageHashVerification-1161664480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:57:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3819c9f3-9009-4c20-9fda-7362461bc7e3 tempest-TestImageHashVerification-1161664480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4daff18b-2d24-4b0a-ae03-3eaf855b16c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d27fdeb-5c96-40dd-871d-782541e47616', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:57:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3819c9f3-9009-4c20-9fda-7362461bc7e3 tempest-TestImageHashVerification-1161664480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11fe7c51-b21d-49d5-a86e-3d569f9c7b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:57:00 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-3819c9f3-9009-4c20-9fda-7362461bc7e3 tempest-TestImageHashVerification-1161664480 None] Volume volume-9d27fdeb-5c96-40dd-871d-782541e47616 (9d27fdeb-5c96-40dd-871d-782541e47616): created successfully Aug 10 12:57:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3819c9f3-9009-4c20-9fda-7362461bc7e3 tempest-TestImageHashVerification-1161664480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11fe7c51-b21d-49d5-a86e-3d569f9c7b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:57:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3819c9f3-9009-4c20-9fda-7362461bc7e3 tempest-TestImageHashVerification-1161664480 None] Flow 'volume_create_manager' (dceaa88f-f35c-4e24-9161-95a148ac8676) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:57:00 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-3819c9f3-9009-4c20-9fda-7362461bc7e3 tempest-TestImageHashVerification-1161664480 None] Created volume successfully. Aug 10 12:57:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2cd503d3-9aca-4240-b809-3f8b5e81a200 tempest-TestImageHashVerification-1161664480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:57:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2cd503d3-9aca-4240-b809-3f8b5e81a200 tempest-TestImageHashVerification-1161664480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:57:02 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5b65a1-618c-4c61-b8f3-51f0a1af3b11]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:57:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cd503d3-9aca-4240-b809-3f8b5e81a200 tempest-TestImageHashVerification-1161664480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9d27fdeb-5c96-40dd-871d-782541e47616 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:57:02 devstack sudo[101316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9d27fdeb-5c96-40dd-871d-782541e47616 Aug 10 12:57:02 devstack sudo[101316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:57:02 devstack sudo[101316]: pam_unix(sudo:session): session closed for user root Aug 10 12:57:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cd503d3-9aca-4240-b809-3f8b5e81a200 tempest-TestImageHashVerification-1161664480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9d27fdeb-5c96-40dd-871d-782541e47616" returned: 0 in 0.435s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:57:02 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb150fa-44fe-4154-8154-5994f57a8a53]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:57:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cd503d3-9aca-4240-b809-3f8b5e81a200 tempest-TestImageHashVerification-1161664480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9d27fdeb-5c96-40dd-871d-782541e47616 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:57:02 devstack sudo[101322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9d27fdeb-5c96-40dd-871d-782541e47616 Aug 10 12:57:02 devstack sudo[101322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:57:02 devstack sudo[101322]: pam_unix(sudo:session): session closed for user root Aug 10 12:57:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cd503d3-9aca-4240-b809-3f8b5e81a200 tempest-TestImageHashVerification-1161664480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9d27fdeb-5c96-40dd-871d-782541e47616" returned: 0 in 0.382s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:57:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cd503d3-9aca-4240-b809-3f8b5e81a200 tempest-TestImageHashVerification-1161664480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9d27fdeb-5c96-40dd-871d-782541e47616 /opt/stack/data/cinder/conversion/9d27fdeb-5c96-40dd-871d-782541e47616.temp_image.bf451217-66f6-406c-b6c1-1d02a05fb8daj4sdc854.img {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:57:02 devstack sudo[101327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9d27fdeb-5c96-40dd-871d-782541e47616 /opt/stack/data/cinder/conversion/9d27fdeb-5c96-40dd-871d-782541e47616.temp_image.bf451217-66f6-406c-b6c1-1d02a05fb8daj4sdc854.img Aug 10 12:57:02 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:57:03 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 12:57:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:57:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:57:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:57:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:57:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:57:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:57:03 devstack sudo[101339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:57:03 devstack sudo[101339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:57:04 devstack sudo[101339]: pam_unix(sudo:session): session closed for user root Aug 10 12:57:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.711s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:57:04 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:57:04 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager._thread_info {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 12:57:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread count: 28 {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 12:57:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread info: [<_MainThread(MainThread, started 130607683133568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Aug 10 12:57:07 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root Aug 10 12:57:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cd503d3-9aca-4240-b809-3f8b5e81a200 tempest-TestImageHashVerification-1161664480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9d27fdeb-5c96-40dd-871d-782541e47616 /opt/stack/data/cinder/conversion/9d27fdeb-5c96-40dd-871d-782541e47616.temp_image.bf451217-66f6-406c-b6c1-1d02a05fb8daj4sdc854.img" returned: 0 in 4.455s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:57:07 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[888c8bbd-be58-4bd6-930b-37257e12c627]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:57:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cd503d3-9aca-4240-b809-3f8b5e81a200 tempest-TestImageHashVerification-1161664480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9d27fdeb-5c96-40dd-871d-782541e47616 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:57:07 devstack sudo[101342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9d27fdeb-5c96-40dd-871d-782541e47616 Aug 10 12:57:07 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:57:07 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root Aug 10 12:57:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cd503d3-9aca-4240-b809-3f8b5e81a200 tempest-TestImageHashVerification-1161664480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9d27fdeb-5c96-40dd-871d-782541e47616" returned: 0 in 0.527s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:57:07 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-2cd503d3-9aca-4240-b809-3f8b5e81a200 tempest-TestImageHashVerification-1161664480 None] Image conversion details: src /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9d27fdeb-5c96-40dd-871d-782541e47616, size 1024.00 MB, duration 4.46 sec, destination /opt/stack/data/cinder/conversion/9d27fdeb-5c96-40dd-871d-782541e47616.temp_image.bf451217-66f6-406c-b6c1-1d02a05fb8daj4sdc854.img {{(pid=89096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 12:57:07 devstack cinder-volume[89096]: INFO cinder.image.image_utils [None req-2cd503d3-9aca-4240-b809-3f8b5e81a200 tempest-TestImageHashVerification-1161664480 None] Converted 1024.00 MB image at 229.81 MB/s Aug 10 12:57:07 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-2cd503d3-9aca-4240-b809-3f8b5e81a200 tempest-TestImageHashVerification-1161664480 None] bf451217-66f6-406c-b6c1-1d02a05fb8da was raw, no need to convert to raw {{(pid=89096) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 10 12:57:12 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-84ccdc03-0998-4784-a2f5-b897770a4906 tempest-AttachVolumeShelveTestJSON-1053675500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:57:12 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-84ccdc03-0998-4784-a2f5-b897770a4906 tempest-AttachVolumeShelveTestJSON-1053675500 None] Flow 'volume_create_manager' (a988a431-c630-434e-a69e-994163cb47f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:57:12 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-84ccdc03-0998-4784-a2f5-b897770a4906 tempest-AttachVolumeShelveTestJSON-1053675500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f0438a7-2595-40a4-9fdf-7fe13da37fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:57:12 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-84ccdc03-0998-4784-a2f5-b897770a4906 tempest-AttachVolumeShelveTestJSON-1053675500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f0438a7-2595-40a4-9fdf-7fe13da37fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-132535687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae23635f-d36a-4933-ba8c-d4ba9f33bb3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b33723355424605bcb325dad41222df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:57:12Z,use_quota=True,user_id='7b8fc3cbb5fa4acf8faae914aa24c47b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:57:12 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-84ccdc03-0998-4784-a2f5-b897770a4906 tempest-AttachVolumeShelveTestJSON-1053675500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4581cbac-fe2c-47cf-8a49-452a4c41e4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:57:12 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-84ccdc03-0998-4784-a2f5-b897770a4906 tempest-AttachVolumeShelveTestJSON-1053675500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4581cbac-fe2c-47cf-8a49-452a4c41e4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:57:12 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-84ccdc03-0998-4784-a2f5-b897770a4906 tempest-AttachVolumeShelveTestJSON-1053675500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fff4d5e2-840a-49c1-8252-0de2d00d63d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:57:12 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-84ccdc03-0998-4784-a2f5-b897770a4906 tempest-AttachVolumeShelveTestJSON-1053675500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fff4d5e2-840a-49c1-8252-0de2d00d63d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae23635f-d36a-4933-ba8c-d4ba9f33bb3a', 'volume_name': 'volume-ae23635f-d36a-4933-ba8c-d4ba9f33bb3a', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:57:12 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-84ccdc03-0998-4784-a2f5-b897770a4906 tempest-AttachVolumeShelveTestJSON-1053675500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8473211b-2459-4c2e-b513-3117907b118c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:57:12 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-84ccdc03-0998-4784-a2f5-b897770a4906 tempest-AttachVolumeShelveTestJSON-1053675500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8473211b-2459-4c2e-b513-3117907b118c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:57:12 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-84ccdc03-0998-4784-a2f5-b897770a4906 tempest-AttachVolumeShelveTestJSON-1053675500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1991679-325c-4cf2-b6ed-c0d64bc5da16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:57:12 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-84ccdc03-0998-4784-a2f5-b897770a4906 tempest-AttachVolumeShelveTestJSON-1053675500 None] Volume ae23635f-d36a-4933-ba8c-d4ba9f33bb3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae23635f-d36a-4933-ba8c-d4ba9f33bb3a', 'volume_size': 1} Aug 10 12:57:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-84ccdc03-0998-4784-a2f5-b897770a4906 tempest-AttachVolumeShelveTestJSON-1053675500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:57:22 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:UPDATE=4,cinder:SELECT=5,cinder:DELETE=1 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:57:22 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=5,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:57:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2cd503d3-9aca-4240-b809-3f8b5e81a200 tempest-TestImageHashVerification-1161664480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.667s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:57:29 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-2cd503d3-9aca-4240-b809-3f8b5e81a200 tempest-TestImageHashVerification-1161664480 None] Uploaded volume to glance image-id: bf451217-66f6-406c-b6c1-1d02a05fb8da. {{(pid=89096) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 10 12:57:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-84ccdc03-0998-4784-a2f5-b897770a4906 tempest-AttachVolumeShelveTestJSON-1053675500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.273s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:57:29 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-84ccdc03-0998-4784-a2f5-b897770a4906 tempest-AttachVolumeShelveTestJSON-1053675500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-132535687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae23635f-d36a-4933-ba8c-d4ba9f33bb3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b33723355424605bcb325dad41222df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:57:12Z,use_quota=True,user_id='7b8fc3cbb5fa4acf8faae914aa24c47b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:57:29 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-84ccdc03-0998-4784-a2f5-b897770a4906 tempest-AttachVolumeShelveTestJSON-1053675500 None] Creating volume ae23635f-d36a-4933-ba8c-d4ba9f33bb3a {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:57:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-84ccdc03-0998-4784-a2f5-b897770a4906 tempest-AttachVolumeShelveTestJSON-1053675500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:57:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-84ccdc03-0998-4784-a2f5-b897770a4906 tempest-AttachVolumeShelveTestJSON-1053675500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:57:29 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-84ccdc03-0998-4784-a2f5-b897770a4906 tempest-AttachVolumeShelveTestJSON-1053675500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:57:29 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-84ccdc03-0998-4784-a2f5-b897770a4906 tempest-AttachVolumeShelveTestJSON-1053675500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:57:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-84ccdc03-0998-4784-a2f5-b897770a4906 tempest-AttachVolumeShelveTestJSON-1053675500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:57:29 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-84ccdc03-0998-4784-a2f5-b897770a4906 tempest-AttachVolumeShelveTestJSON-1053675500 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:57:29 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-84ccdc03-0998-4784-a2f5-b897770a4906 tempest-AttachVolumeShelveTestJSON-1053675500 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:57:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-84ccdc03-0998-4784-a2f5-b897770a4906 tempest-AttachVolumeShelveTestJSON-1053675500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ae23635f-d36a-4933-ba8c-d4ba9f33bb3a 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:57:29 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ae23635f-d36a-4933-ba8c-d4ba9f33bb3a 1073741824 Aug 10 12:57:29 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:57:29 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-2cd503d3-9aca-4240-b809-3f8b5e81a200 tempest-TestImageHashVerification-1161664480 None] Copy volume to image completed successfully. Aug 10 12:57:30 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-84ccdc03-0998-4784-a2f5-b897770a4906 tempest-AttachVolumeShelveTestJSON-1053675500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ae23635f-d36a-4933-ba8c-d4ba9f33bb3a 1073741824" returned: 0 in 0.509s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-84ccdc03-0998-4784-a2f5-b897770a4906 tempest-AttachVolumeShelveTestJSON-1053675500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ae23635f-d36a-4933-ba8c-d4ba9f33bb3a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:57:30 devstack sudo[101403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ae23635f-d36a-4933-ba8c-d4ba9f33bb3a Aug 10 12:57:30 devstack sudo[101403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-9be613ff-6226-463d-94ed-2bdba80a1e71 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9be613ff-6226-463d-94ed-2bdba80a1e71 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Flow 'volume_create_manager' (fb557220-1c14-4536-9682-e533478c631e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9be613ff-6226-463d-94ed-2bdba80a1e71 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cfc65dd-ff31-49b8-9a04-6012dad7bbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9be613ff-6226-463d-94ed-2bdba80a1e71 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cfc65dd-ff31-49b8-9a04-6012dad7bbc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1630140142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acde9d7d-1148-4b52-a8ea-3735c4a5963a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4b81affeabe4fdebb99808e5d278376',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:57:30Z,use_quota=True,user_id='37f72f3a9d1c4fb7b5b0fc54bb873222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9be613ff-6226-463d-94ed-2bdba80a1e71 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c6cd134-a66a-4ee5-aea4-a96206087832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9be613ff-6226-463d-94ed-2bdba80a1e71 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c6cd134-a66a-4ee5-aea4-a96206087832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9be613ff-6226-463d-94ed-2bdba80a1e71 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9c92cfa-ec47-4866-8269-42f066dd6ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9be613ff-6226-463d-94ed-2bdba80a1e71 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9c92cfa-ec47-4866-8269-42f066dd6ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acde9d7d-1148-4b52-a8ea-3735c4a5963a', 'volume_name': 'volume-acde9d7d-1148-4b52-a8ea-3735c4a5963a', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9be613ff-6226-463d-94ed-2bdba80a1e71 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc383a0f-7542-4a6f-9a50-6eebe798b774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9be613ff-6226-463d-94ed-2bdba80a1e71 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc383a0f-7542-4a6f-9a50-6eebe798b774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9be613ff-6226-463d-94ed-2bdba80a1e71 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f8c4e98-a8bb-4789-9c40-745a1f567cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:57:30 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-9be613ff-6226-463d-94ed-2bdba80a1e71 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Volume acde9d7d-1148-4b52-a8ea-3735c4a5963a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acde9d7d-1148-4b52-a8ea-3735c4a5963a', 'volume_size': 1} Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9be613ff-6226-463d-94ed-2bdba80a1e71 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:57:30 devstack sudo[101403]: pam_unix(sudo:session): session closed for user root Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-84ccdc03-0998-4784-a2f5-b897770a4906 tempest-AttachVolumeShelveTestJSON-1053675500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ae23635f-d36a-4933-ba8c-d4ba9f33bb3a" returned: 0 in 0.327s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-84ccdc03-0998-4784-a2f5-b897770a4906 tempest-AttachVolumeShelveTestJSON-1053675500 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-84ccdc03-0998-4784-a2f5-b897770a4906 tempest-AttachVolumeShelveTestJSON-1053675500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9be613ff-6226-463d-94ed-2bdba80a1e71 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.126s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9be613ff-6226-463d-94ed-2bdba80a1e71 tempest-TestServerVolumeAttachmentScenario-1828392993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1630140142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acde9d7d-1148-4b52-a8ea-3735c4a5963a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4b81affeabe4fdebb99808e5d278376',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:57:30Z,use_quota=True,user_id='37f72f3a9d1c4fb7b5b0fc54bb873222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-9be613ff-6226-463d-94ed-2bdba80a1e71 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Creating volume acde9d7d-1148-4b52-a8ea-3735c4a5963a {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9be613ff-6226-463d-94ed-2bdba80a1e71 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9be613ff-6226-463d-94ed-2bdba80a1e71 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9be613ff-6226-463d-94ed-2bdba80a1e71 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9be613ff-6226-463d-94ed-2bdba80a1e71 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9be613ff-6226-463d-94ed-2bdba80a1e71 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9be613ff-6226-463d-94ed-2bdba80a1e71 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:57:30 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-9be613ff-6226-463d-94ed-2bdba80a1e71 tempest-TestServerVolumeAttachmentScenario-1828392993 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9be613ff-6226-463d-94ed-2bdba80a1e71 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-acde9d7d-1148-4b52-a8ea-3735c4a5963a 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:57:30 devstack sudo[101406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-acde9d7d-1148-4b52-a8ea-3735c4a5963a 1073741824 Aug 10 12:57:30 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-84ccdc03-0998-4784-a2f5-b897770a4906 tempest-AttachVolumeShelveTestJSON-1053675500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1991679-325c-4cf2-b6ed-c0d64bc5da16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae23635f-d36a-4933-ba8c-d4ba9f33bb3a', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-84ccdc03-0998-4784-a2f5-b897770a4906 tempest-AttachVolumeShelveTestJSON-1053675500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86de1135-d3ec-4709-a95e-4ef790a42024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:57:30 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-84ccdc03-0998-4784-a2f5-b897770a4906 tempest-AttachVolumeShelveTestJSON-1053675500 None] Volume volume-ae23635f-d36a-4933-ba8c-d4ba9f33bb3a (ae23635f-d36a-4933-ba8c-d4ba9f33bb3a): created successfully Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-84ccdc03-0998-4784-a2f5-b897770a4906 tempest-AttachVolumeShelveTestJSON-1053675500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86de1135-d3ec-4709-a95e-4ef790a42024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-84ccdc03-0998-4784-a2f5-b897770a4906 tempest-AttachVolumeShelveTestJSON-1053675500 None] Flow 'volume_create_manager' (a988a431-c630-434e-a69e-994163cb47f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:57:30 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-84ccdc03-0998-4784-a2f5-b897770a4906 tempest-AttachVolumeShelveTestJSON-1053675500 None] Created volume successfully. Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-782a08c9-e997-4482-95b1-26c3d1d116e6 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-782a08c9-e997-4482-95b1-26c3d1d116e6 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Flow 'volume_create_manager' (d3805846-9e63-4421-87fc-7dc58c7a009f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-782a08c9-e997-4482-95b1-26c3d1d116e6 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0015d9c5-ceca-40cd-8b8d-6edd914e904c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-782a08c9-e997-4482-95b1-26c3d1d116e6 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0015d9c5-ceca-40cd-8b8d-6edd914e904c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1787596834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba6ad7d2-9b2c-41da-835f-84e5a48a2ced,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4b81affeabe4fdebb99808e5d278376',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:57:31Z,use_quota=True,user_id='37f72f3a9d1c4fb7b5b0fc54bb873222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-782a08c9-e997-4482-95b1-26c3d1d116e6 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44e8a401-f5d7-4ac5-ac5e-735c32e1f3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-782a08c9-e997-4482-95b1-26c3d1d116e6 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44e8a401-f5d7-4ac5-ac5e-735c32e1f3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-782a08c9-e997-4482-95b1-26c3d1d116e6 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e675f9b-a94d-4308-9898-4cb2a670e5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-782a08c9-e997-4482-95b1-26c3d1d116e6 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e675f9b-a94d-4308-9898-4cb2a670e5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba6ad7d2-9b2c-41da-835f-84e5a48a2ced', 'volume_name': 'volume-ba6ad7d2-9b2c-41da-835f-84e5a48a2ced', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-782a08c9-e997-4482-95b1-26c3d1d116e6 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75e3b16c-9973-4b90-a600-a3d9f5d0e039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-782a08c9-e997-4482-95b1-26c3d1d116e6 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75e3b16c-9973-4b90-a600-a3d9f5d0e039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-782a08c9-e997-4482-95b1-26c3d1d116e6 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ae65422-e946-4f00-8916-5336339a88de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:57:30 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-782a08c9-e997-4482-95b1-26c3d1d116e6 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Volume ba6ad7d2-9b2c-41da-835f-84e5a48a2ced: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba6ad7d2-9b2c-41da-835f-84e5a48a2ced', 'volume_size': 1} Aug 10 12:57:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-782a08c9-e997-4482-95b1-26c3d1d116e6 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:57:31 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-6a992617-a410-4322-9d81-9caad9e0df39 tempest-TestImageHashVerification-1161664480 None] Acquiring lock "cinder-9d27fdeb-5c96-40dd-871d-782541e47616-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:57:31 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-6a992617-a410-4322-9d81-9caad9e0df39 tempest-TestImageHashVerification-1161664480 None] Lock "cinder-9d27fdeb-5c96-40dd-871d-782541e47616-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:57:31 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root Aug 10 12:57:31 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-6a992617-a410-4322-9d81-9caad9e0df39 tempest-TestImageHashVerification-1161664480 None] Acquiring lock "cinder-quobyte-9d27fdeb-5c96-40dd-871d-782541e47616" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:57:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9be613ff-6226-463d-94ed-2bdba80a1e71 tempest-TestServerVolumeAttachmentScenario-1828392993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-acde9d7d-1148-4b52-a8ea-3735c4a5963a 1073741824" returned: 0 in 0.614s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:57:31 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-6a992617-a410-4322-9d81-9caad9e0df39 tempest-TestImageHashVerification-1161664480 None] Lock "cinder-quobyte-9d27fdeb-5c96-40dd-871d-782541e47616" acquired by "delete_volume" :: waited 0.040s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:57:31 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1dd86d-822d-464a-a777-557cbeef3c9f]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:57:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6a992617-a410-4322-9d81-9caad9e0df39 tempest-TestImageHashVerification-1161664480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9d27fdeb-5c96-40dd-871d-782541e47616 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:57:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9be613ff-6226-463d-94ed-2bdba80a1e71 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-acde9d7d-1148-4b52-a8ea-3735c4a5963a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:57:31 devstack sudo[101418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-acde9d7d-1148-4b52-a8ea-3735c4a5963a Aug 10 12:57:31 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:57:31 devstack sudo[101417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9d27fdeb-5c96-40dd-871d-782541e47616 Aug 10 12:57:31 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:57:31 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root Aug 10 12:57:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9be613ff-6226-463d-94ed-2bdba80a1e71 tempest-TestServerVolumeAttachmentScenario-1828392993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-acde9d7d-1148-4b52-a8ea-3735c4a5963a" returned: 0 in 0.353s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:57:31 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9be613ff-6226-463d-94ed-2bdba80a1e71 tempest-TestServerVolumeAttachmentScenario-1828392993 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:57:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9be613ff-6226-463d-94ed-2bdba80a1e71 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:57:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-782a08c9-e997-4482-95b1-26c3d1d116e6 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.802s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:57:31 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-782a08c9-e997-4482-95b1-26c3d1d116e6 tempest-TestServerVolumeAttachmentScenario-1828392993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1787596834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba6ad7d2-9b2c-41da-835f-84e5a48a2ced,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4b81affeabe4fdebb99808e5d278376',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:57:31Z,use_quota=True,user_id='37f72f3a9d1c4fb7b5b0fc54bb873222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:57:31 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-782a08c9-e997-4482-95b1-26c3d1d116e6 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Creating volume ba6ad7d2-9b2c-41da-835f-84e5a48a2ced {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:57:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-782a08c9-e997-4482-95b1-26c3d1d116e6 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:57:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-782a08c9-e997-4482-95b1-26c3d1d116e6 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:57:31 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-782a08c9-e997-4482-95b1-26c3d1d116e6 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:57:31 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-782a08c9-e997-4482-95b1-26c3d1d116e6 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:57:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-782a08c9-e997-4482-95b1-26c3d1d116e6 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:57:31 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-782a08c9-e997-4482-95b1-26c3d1d116e6 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:57:31 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-782a08c9-e997-4482-95b1-26c3d1d116e6 tempest-TestServerVolumeAttachmentScenario-1828392993 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:57:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-782a08c9-e997-4482-95b1-26c3d1d116e6 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ba6ad7d2-9b2c-41da-835f-84e5a48a2ced 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:57:31 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9be613ff-6226-463d-94ed-2bdba80a1e71 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f8c4e98-a8bb-4789-9c40-745a1f567cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acde9d7d-1148-4b52-a8ea-3735c4a5963a', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:57:31 devstack sudo[101424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ba6ad7d2-9b2c-41da-835f-84e5a48a2ced 1073741824 Aug 10 12:57:31 devstack sudo[101424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:57:31 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9be613ff-6226-463d-94ed-2bdba80a1e71 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1950f11-fde4-44c8-a1fe-c8fcbfa290f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:57:31 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-9be613ff-6226-463d-94ed-2bdba80a1e71 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Volume volume-acde9d7d-1148-4b52-a8ea-3735c4a5963a (acde9d7d-1148-4b52-a8ea-3735c4a5963a): created successfully Aug 10 12:57:31 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root Aug 10 12:57:31 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9be613ff-6226-463d-94ed-2bdba80a1e71 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1950f11-fde4-44c8-a1fe-c8fcbfa290f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:57:31 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9be613ff-6226-463d-94ed-2bdba80a1e71 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Flow 'volume_create_manager' (fb557220-1c14-4536-9682-e533478c631e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:57:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6a992617-a410-4322-9d81-9caad9e0df39 tempest-TestImageHashVerification-1161664480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9d27fdeb-5c96-40dd-871d-782541e47616" returned: 0 in 0.512s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:57:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6a992617-a410-4322-9d81-9caad9e0df39 tempest-TestImageHashVerification-1161664480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9d27fdeb-5c96-40dd-871d-782541e47616 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:57:31 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-9be613ff-6226-463d-94ed-2bdba80a1e71 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Created volume successfully. Aug 10 12:57:31 devstack sudo[101427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9d27fdeb-5c96-40dd-871d-782541e47616 Aug 10 12:57:31 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:57:32 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root Aug 10 12:57:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6a992617-a410-4322-9d81-9caad9e0df39 tempest-TestImageHashVerification-1161664480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9d27fdeb-5c96-40dd-871d-782541e47616" returned: 0 in 0.363s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:57:32 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-6a992617-a410-4322-9d81-9caad9e0df39 tempest-TestImageHashVerification-1161664480 None] Lock "cinder-quobyte-9d27fdeb-5c96-40dd-871d-782541e47616" released by "delete_volume" :: held 0.941s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:57:32 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-6a992617-a410-4322-9d81-9caad9e0df39 tempest-TestImageHashVerification-1161664480 None] Created reservations ['042111c7-1d87-4cdd-8bc1-15eb65b538d7', '30a5a1c8-e4de-487c-9554-ce43d4e046a1', 'bad7a934-9901-43d7-9550-901825929ad8', 'a8bf11f9-a6a0-47e5-9780-c1c1c3adea7b'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:57:32 devstack sudo[101424]: pam_unix(sudo:session): session closed for user root Aug 10 12:57:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-782a08c9-e997-4482-95b1-26c3d1d116e6 tempest-TestServerVolumeAttachmentScenario-1828392993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ba6ad7d2-9b2c-41da-835f-84e5a48a2ced 1073741824" returned: 0 in 0.561s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:57:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-782a08c9-e997-4482-95b1-26c3d1d116e6 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ba6ad7d2-9b2c-41da-835f-84e5a48a2ced {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:57:32 devstack sudo[101434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ba6ad7d2-9b2c-41da-835f-84e5a48a2ced Aug 10 12:57:32 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:57:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6a992617-a410-4322-9d81-9caad9e0df39 tempest-TestImageHashVerification-1161664480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:57:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6a992617-a410-4322-9d81-9caad9e0df39 tempest-TestImageHashVerification-1161664480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:57:32 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6a992617-a410-4322-9d81-9caad9e0df39 tempest-TestImageHashVerification-1161664480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:57:32 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6a992617-a410-4322-9d81-9caad9e0df39 tempest-TestImageHashVerification-1161664480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:57:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6a992617-a410-4322-9d81-9caad9e0df39 tempest-TestImageHashVerification-1161664480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:57:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6a992617-a410-4322-9d81-9caad9e0df39 tempest-TestImageHashVerification-1161664480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:57:32 devstack sudo[101436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:57:32 devstack sudo[101436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:57:32 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root Aug 10 12:57:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-782a08c9-e997-4482-95b1-26c3d1d116e6 tempest-TestServerVolumeAttachmentScenario-1828392993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ba6ad7d2-9b2c-41da-835f-84e5a48a2ced" returned: 0 in 0.433s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:57:32 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-782a08c9-e997-4482-95b1-26c3d1d116e6 tempest-TestServerVolumeAttachmentScenario-1828392993 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:57:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-782a08c9-e997-4482-95b1-26c3d1d116e6 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:57:32 devstack sudo[101436]: pam_unix(sudo:session): session closed for user root Aug 10 12:57:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6a992617-a410-4322-9d81-9caad9e0df39 tempest-TestImageHashVerification-1161664480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.359s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:57:32 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-6a992617-a410-4322-9d81-9caad9e0df39 tempest-TestImageHashVerification-1161664480 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:57:32 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-782a08c9-e997-4482-95b1-26c3d1d116e6 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ae65422-e946-4f00-8916-5336339a88de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba6ad7d2-9b2c-41da-835f-84e5a48a2ced', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:57:32 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-782a08c9-e997-4482-95b1-26c3d1d116e6 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a917b36a-84d5-4108-8514-05b2df0a8a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:57:32 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-6a992617-a410-4322-9d81-9caad9e0df39 tempest-TestImageHashVerification-1161664480 None] Deleted volume successfully. Aug 10 12:57:32 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-782a08c9-e997-4482-95b1-26c3d1d116e6 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Volume volume-ba6ad7d2-9b2c-41da-835f-84e5a48a2ced (ba6ad7d2-9b2c-41da-835f-84e5a48a2ced): created successfully Aug 10 12:57:32 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-782a08c9-e997-4482-95b1-26c3d1d116e6 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a917b36a-84d5-4108-8514-05b2df0a8a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:57:32 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-782a08c9-e997-4482-95b1-26c3d1d116e6 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Flow 'volume_create_manager' (d3805846-9e63-4421-87fc-7dc58c7a009f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:57:32 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-782a08c9-e997-4482-95b1-26c3d1d116e6 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Created volume successfully. Aug 10 12:57:32 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-6a992617-a410-4322-9d81-9caad9e0df39 tempest-TestImageHashVerification-1161664480 None] Lock "cinder-9d27fdeb-5c96-40dd-871d-782541e47616-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:57:42 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:UPDATE=16,cinder:SELECT=12,cinder:INSERT=3,cinder:DELETE=1 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:57:42 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=9,cinder:UPDATE=18,cinder:DELETE=3,cinder:INSERT=4 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:57:43 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-9724109f-6d5a-4130-9986-905f506f244f req-b2af8bb8-2dc1-4aa5-8f54-c923d65b417b tempest-AttachVolumeShelveTestJSON-1053675500 None] No connector for attachment 43e2d8ac-ef19-4133-bc8b-1d5756d68c91; skipping storage backend terminate_connection call. {{(pid=89096) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5011}} Aug 10 12:57:43 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-9724109f-6d5a-4130-9986-905f506f244f req-b2af8bb8-2dc1-4aa5-8f54-c923d65b417b tempest-AttachVolumeShelveTestJSON-1053675500 None] Deleting attachment 43e2d8ac-ef19-4133-bc8b-1d5756d68c91. {{(pid=89096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Aug 10 12:57:53 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=1 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:57:53 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=1 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:58:03 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 12:58:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:58:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:58:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:58:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:58:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:58:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:58:03 devstack sudo[101745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:58:03 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:58:04 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root Aug 10 12:58:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.386s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:58:04 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:58:04 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager._thread_info {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 12:58:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread count: 28 {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 12:58:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread info: [<_MainThread(MainThread, started 130607683133568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Aug 10 12:58:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-672252a5-ebac-42ac-bac4-2de5500339fd req-ee5e8842-4ff9-41a4-a1e9-87fc0890e13f tempest-TestServerVolumeAttachmentScenario-1828392993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:58:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-672252a5-ebac-42ac-bac4-2de5500339fd req-ee5e8842-4ff9-41a4-a1e9-87fc0890e13f tempest-TestServerVolumeAttachmentScenario-1828392993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:58:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-672252a5-ebac-42ac-bac4-2de5500339fd req-ee5e8842-4ff9-41a4-a1e9-87fc0890e13f tempest-TestServerVolumeAttachmentScenario-1828392993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:58:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-672252a5-ebac-42ac-bac4-2de5500339fd req-ee5e8842-4ff9-41a4-a1e9-87fc0890e13f tempest-TestServerVolumeAttachmentScenario-1828392993 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d', 'name': 'volume-acde9d7d-1148-4b52-a8ea-3735c4a5963a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '380ce640-cb9c-42d6-8dcf-786a62382e7b', 'enforce_multipath': True} {{(pid=89096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Aug 10 12:58:08 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-672252a5-ebac-42ac-bac4-2de5500339fd req-ee5e8842-4ff9-41a4-a1e9-87fc0890e13f tempest-TestServerVolumeAttachmentScenario-1828392993 None] attachment_update completed successfully. Aug 10 12:58:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-d35c71d9-166f-48b9-9223-a8b534ef30dd req-0453b7b9-b725-4fa3-9850-4e2398570b89 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:58:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-d35c71d9-166f-48b9-9223-a8b534ef30dd req-0453b7b9-b725-4fa3-9850-4e2398570b89 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:58:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-d35c71d9-166f-48b9-9223-a8b534ef30dd req-0453b7b9-b725-4fa3-9850-4e2398570b89 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:58:14 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-d35c71d9-166f-48b9-9223-a8b534ef30dd req-0453b7b9-b725-4fa3-9850-4e2398570b89 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d', 'name': 'volume-ba6ad7d2-9b2c-41da-835f-84e5a48a2ced', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a3ac098b-82c6-4e4d-9830-19daf587cb80', 'enforce_multipath': True} {{(pid=89096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Aug 10 12:58:14 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-d35c71d9-166f-48b9-9223-a8b534ef30dd req-0453b7b9-b725-4fa3-9850-4e2398570b89 tempest-TestServerVolumeAttachmentScenario-1828392993 None] attachment_update completed successfully. Aug 10 12:58:14 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-09956c4f-7868-4981-a252-af1065c978b0 tempest-TestStampPattern-1500701631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:58:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-09956c4f-7868-4981-a252-af1065c978b0 tempest-TestStampPattern-1500701631 None] Flow 'volume_create_manager' (e7c4e813-0b76-4004-aba1-c633f78ae82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:58:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-09956c4f-7868-4981-a252-af1065c978b0 tempest-TestStampPattern-1500701631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53808729-634c-481e-b7ef-9a46c946454a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:58:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-09956c4f-7868-4981-a252-af1065c978b0 tempest-TestStampPattern-1500701631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53808729-634c-481e-b7ef-9a46c946454a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-295468538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b21c97ed-d738-4d79-aa6e-0ef6b9826c63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99f932b332c24313baf50ff92b837d78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:58:15Z,use_quota=True,user_id='da9d7d3a1db546afbc7a4542fa9b13b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:58:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-09956c4f-7868-4981-a252-af1065c978b0 tempest-TestStampPattern-1500701631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d2c5b9d-f26b-4ad4-a025-25a38a9a158f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:58:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-09956c4f-7868-4981-a252-af1065c978b0 tempest-TestStampPattern-1500701631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d2c5b9d-f26b-4ad4-a025-25a38a9a158f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:58:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-09956c4f-7868-4981-a252-af1065c978b0 tempest-TestStampPattern-1500701631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (181ad6a8-7e95-4224-ae42-1625b7c96bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:58:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-09956c4f-7868-4981-a252-af1065c978b0 tempest-TestStampPattern-1500701631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (181ad6a8-7e95-4224-ae42-1625b7c96bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b21c97ed-d738-4d79-aa6e-0ef6b9826c63', 'volume_name': 'volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:58:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-09956c4f-7868-4981-a252-af1065c978b0 tempest-TestStampPattern-1500701631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca83c413-9a87-4fa2-a265-a2095322dff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:58:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-09956c4f-7868-4981-a252-af1065c978b0 tempest-TestStampPattern-1500701631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca83c413-9a87-4fa2-a265-a2095322dff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:58:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-09956c4f-7868-4981-a252-af1065c978b0 tempest-TestStampPattern-1500701631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ff5d286-48b2-49ae-8569-220714e3b98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:58:15 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-09956c4f-7868-4981-a252-af1065c978b0 tempest-TestStampPattern-1500701631 None] Volume b21c97ed-d738-4d79-aa6e-0ef6b9826c63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63', 'volume_size': 1} Aug 10 12:58:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-09956c4f-7868-4981-a252-af1065c978b0 tempest-TestStampPattern-1500701631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:58:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-09956c4f-7868-4981-a252-af1065c978b0 tempest-TestStampPattern-1500701631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:58:15 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-09956c4f-7868-4981-a252-af1065c978b0 tempest-TestStampPattern-1500701631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-295468538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b21c97ed-d738-4d79-aa6e-0ef6b9826c63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99f932b332c24313baf50ff92b837d78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:58:15Z,use_quota=True,user_id='da9d7d3a1db546afbc7a4542fa9b13b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:58:15 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-09956c4f-7868-4981-a252-af1065c978b0 tempest-TestStampPattern-1500701631 None] Creating volume b21c97ed-d738-4d79-aa6e-0ef6b9826c63 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:58:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-09956c4f-7868-4981-a252-af1065c978b0 tempest-TestStampPattern-1500701631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:58:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-09956c4f-7868-4981-a252-af1065c978b0 tempest-TestStampPattern-1500701631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:58:15 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-09956c4f-7868-4981-a252-af1065c978b0 tempest-TestStampPattern-1500701631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:58:15 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-09956c4f-7868-4981-a252-af1065c978b0 tempest-TestStampPattern-1500701631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:58:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-09956c4f-7868-4981-a252-af1065c978b0 tempest-TestStampPattern-1500701631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:58:15 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-09956c4f-7868-4981-a252-af1065c978b0 tempest-TestStampPattern-1500701631 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:58:15 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-09956c4f-7868-4981-a252-af1065c978b0 tempest-TestStampPattern-1500701631 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:58:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-09956c4f-7868-4981-a252-af1065c978b0 tempest-TestStampPattern-1500701631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:58:15 devstack sudo[102183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63 1073741824 Aug 10 12:58:15 devstack sudo[102183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:58:15 devstack sudo[102183]: pam_unix(sudo:session): session closed for user root Aug 10 12:58:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-09956c4f-7868-4981-a252-af1065c978b0 tempest-TestStampPattern-1500701631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63 1073741824" returned: 0 in 0.471s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:58:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-09956c4f-7868-4981-a252-af1065c978b0 tempest-TestStampPattern-1500701631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:58:15 devstack sudo[102189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63 Aug 10 12:58:15 devstack sudo[102189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:58:15 devstack sudo[102189]: pam_unix(sudo:session): session closed for user root Aug 10 12:58:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-09956c4f-7868-4981-a252-af1065c978b0 tempest-TestStampPattern-1500701631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63" returned: 0 in 0.292s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:58:15 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-09956c4f-7868-4981-a252-af1065c978b0 tempest-TestStampPattern-1500701631 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:58:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-09956c4f-7868-4981-a252-af1065c978b0 tempest-TestStampPattern-1500701631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:58:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-09956c4f-7868-4981-a252-af1065c978b0 tempest-TestStampPattern-1500701631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ff5d286-48b2-49ae-8569-220714e3b98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:58:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-09956c4f-7868-4981-a252-af1065c978b0 tempest-TestStampPattern-1500701631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4bafc22-ccc3-49c3-b981-ebb11a66ad47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:58:15 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-09956c4f-7868-4981-a252-af1065c978b0 tempest-TestStampPattern-1500701631 None] Volume volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63 (b21c97ed-d738-4d79-aa6e-0ef6b9826c63): created successfully Aug 10 12:58:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-09956c4f-7868-4981-a252-af1065c978b0 tempest-TestStampPattern-1500701631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4bafc22-ccc3-49c3-b981-ebb11a66ad47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:58:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-09956c4f-7868-4981-a252-af1065c978b0 tempest-TestStampPattern-1500701631 None] Flow 'volume_create_manager' (e7c4e813-0b76-4004-aba1-c633f78ae82b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:58:15 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-09956c4f-7868-4981-a252-af1065c978b0 tempest-TestStampPattern-1500701631 None] Created volume successfully. Aug 10 12:58:17 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-026ca714-848d-4adb-833b-2c067a0110a1 req-324722de-3e29-420e-b1f5-cca870178281 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Terminate volume connection completed successfully. Aug 10 12:58:17 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-026ca714-848d-4adb-833b-2c067a0110a1 req-324722de-3e29-420e-b1f5-cca870178281 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Deleting attachment a3ac098b-82c6-4e4d-9830-19daf587cb80. {{(pid=89096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Aug 10 12:58:19 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-09cec0a8-a5e4-460a-b3fc-cb352035ee6d req-055f2387-76cc-48c1-bbea-720a6f5f2312 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Terminate volume connection completed successfully. Aug 10 12:58:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-09cec0a8-a5e4-460a-b3fc-cb352035ee6d req-055f2387-76cc-48c1-bbea-720a6f5f2312 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Deleting attachment 380ce640-cb9c-42d6-8dcf-786a62382e7b. {{(pid=89096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Aug 10 12:58:23 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e53f6fa4-449e-4e00-bcda-b70aead05c5b tempest-AttachVolumeShelveTestJSON-1053675500 None] Acquiring lock "cinder-ae23635f-d36a-4933-ba8c-d4ba9f33bb3a-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:58:23 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e53f6fa4-449e-4e00-bcda-b70aead05c5b tempest-AttachVolumeShelveTestJSON-1053675500 None] Lock "cinder-ae23635f-d36a-4933-ba8c-d4ba9f33bb3a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:58:23 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e53f6fa4-449e-4e00-bcda-b70aead05c5b tempest-AttachVolumeShelveTestJSON-1053675500 None] Acquiring lock "cinder-quobyte-ae23635f-d36a-4933-ba8c-d4ba9f33bb3a" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:58:23 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e53f6fa4-449e-4e00-bcda-b70aead05c5b tempest-AttachVolumeShelveTestJSON-1053675500 None] Lock "cinder-quobyte-ae23635f-d36a-4933-ba8c-d4ba9f33bb3a" acquired by "delete_volume" :: waited 0.028s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:58:23 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31af35a-7d42-4929-8c5a-c9974fd85d16]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:58:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e53f6fa4-449e-4e00-bcda-b70aead05c5b tempest-AttachVolumeShelveTestJSON-1053675500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ae23635f-d36a-4933-ba8c-d4ba9f33bb3a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:58:23 devstack sudo[102380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ae23635f-d36a-4933-ba8c-d4ba9f33bb3a Aug 10 12:58:23 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:58:23 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root Aug 10 12:58:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e53f6fa4-449e-4e00-bcda-b70aead05c5b tempest-AttachVolumeShelveTestJSON-1053675500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ae23635f-d36a-4933-ba8c-d4ba9f33bb3a" returned: 0 in 0.533s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:58:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e53f6fa4-449e-4e00-bcda-b70aead05c5b tempest-AttachVolumeShelveTestJSON-1053675500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ae23635f-d36a-4933-ba8c-d4ba9f33bb3a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:58:23 devstack sudo[102386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ae23635f-d36a-4933-ba8c-d4ba9f33bb3a Aug 10 12:58:23 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:58:24 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root Aug 10 12:58:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e53f6fa4-449e-4e00-bcda-b70aead05c5b tempest-AttachVolumeShelveTestJSON-1053675500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ae23635f-d36a-4933-ba8c-d4ba9f33bb3a" returned: 0 in 0.267s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:58:24 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e53f6fa4-449e-4e00-bcda-b70aead05c5b tempest-AttachVolumeShelveTestJSON-1053675500 None] Lock "cinder-quobyte-ae23635f-d36a-4933-ba8c-d4ba9f33bb3a" released by "delete_volume" :: held 0.899s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:58:24 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-e53f6fa4-449e-4e00-bcda-b70aead05c5b tempest-AttachVolumeShelveTestJSON-1053675500 None] Created reservations ['28f1a4bd-d5c2-4186-b7ae-afbaff04d21f', '3e7ad883-1d39-4206-a080-c0e50a45d9a6', 'e62b3f69-aa27-4874-b683-16e94fa4baf6', 'be7b81db-63e7-4fa3-8f05-2dec518e5d1a'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:58:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e53f6fa4-449e-4e00-bcda-b70aead05c5b tempest-AttachVolumeShelveTestJSON-1053675500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:58:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e53f6fa4-449e-4e00-bcda-b70aead05c5b tempest-AttachVolumeShelveTestJSON-1053675500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:58:24 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e53f6fa4-449e-4e00-bcda-b70aead05c5b tempest-AttachVolumeShelveTestJSON-1053675500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:58:24 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e53f6fa4-449e-4e00-bcda-b70aead05c5b tempest-AttachVolumeShelveTestJSON-1053675500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:58:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e53f6fa4-449e-4e00-bcda-b70aead05c5b tempest-AttachVolumeShelveTestJSON-1053675500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:58:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e53f6fa4-449e-4e00-bcda-b70aead05c5b tempest-AttachVolumeShelveTestJSON-1053675500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:58:24 devstack sudo[102391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:58:24 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:58:24 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root Aug 10 12:58:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e53f6fa4-449e-4e00-bcda-b70aead05c5b tempest-AttachVolumeShelveTestJSON-1053675500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.538s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:58:24 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-e53f6fa4-449e-4e00-bcda-b70aead05c5b tempest-AttachVolumeShelveTestJSON-1053675500 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:58:24 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-e53f6fa4-449e-4e00-bcda-b70aead05c5b tempest-AttachVolumeShelveTestJSON-1053675500 None] Deleted volume successfully. Aug 10 12:58:24 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e53f6fa4-449e-4e00-bcda-b70aead05c5b tempest-AttachVolumeShelveTestJSON-1053675500 None] Lock "cinder-ae23635f-d36a-4933-ba8c-d4ba9f33bb3a-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:58:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2955ad65-2cb0-4638-a2fb-0c0f00a4180c tempest-TestServerVolumeAttachmentScenario-1828392993 None] Acquiring lock "cinder-ba6ad7d2-9b2c-41da-835f-84e5a48a2ced-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:58:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2955ad65-2cb0-4638-a2fb-0c0f00a4180c tempest-TestServerVolumeAttachmentScenario-1828392993 None] Lock "cinder-ba6ad7d2-9b2c-41da-835f-84e5a48a2ced-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:58:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2955ad65-2cb0-4638-a2fb-0c0f00a4180c tempest-TestServerVolumeAttachmentScenario-1828392993 None] Acquiring lock "cinder-quobyte-ba6ad7d2-9b2c-41da-835f-84e5a48a2ced" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:58:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2955ad65-2cb0-4638-a2fb-0c0f00a4180c tempest-TestServerVolumeAttachmentScenario-1828392993 None] Lock "cinder-quobyte-ba6ad7d2-9b2c-41da-835f-84e5a48a2ced" acquired by "delete_volume" :: waited 0.019s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:58:25 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[997c30be-06e3-4126-a4f8-7e9d31abf4bc]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:58:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2955ad65-2cb0-4638-a2fb-0c0f00a4180c tempest-TestServerVolumeAttachmentScenario-1828392993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ba6ad7d2-9b2c-41da-835f-84e5a48a2ced {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:58:25 devstack sudo[102394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ba6ad7d2-9b2c-41da-835f-84e5a48a2ced Aug 10 12:58:25 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:58:25 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root Aug 10 12:58:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2955ad65-2cb0-4638-a2fb-0c0f00a4180c tempest-TestServerVolumeAttachmentScenario-1828392993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ba6ad7d2-9b2c-41da-835f-84e5a48a2ced" returned: 0 in 0.443s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:58:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2955ad65-2cb0-4638-a2fb-0c0f00a4180c tempest-TestServerVolumeAttachmentScenario-1828392993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ba6ad7d2-9b2c-41da-835f-84e5a48a2ced {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:58:26 devstack sudo[102399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ba6ad7d2-9b2c-41da-835f-84e5a48a2ced Aug 10 12:58:26 devstack sudo[102399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:58:26 devstack sudo[102399]: pam_unix(sudo:session): session closed for user root Aug 10 12:58:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2955ad65-2cb0-4638-a2fb-0c0f00a4180c tempest-TestServerVolumeAttachmentScenario-1828392993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ba6ad7d2-9b2c-41da-835f-84e5a48a2ced" returned: 0 in 0.412s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:58:26 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2955ad65-2cb0-4638-a2fb-0c0f00a4180c tempest-TestServerVolumeAttachmentScenario-1828392993 None] Lock "cinder-quobyte-ba6ad7d2-9b2c-41da-835f-84e5a48a2ced" released by "delete_volume" :: held 0.921s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:58:26 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-2955ad65-2cb0-4638-a2fb-0c0f00a4180c tempest-TestServerVolumeAttachmentScenario-1828392993 None] Created reservations ['d9be9a74-a4c4-4994-9baa-a94f161ebcb7', '1842f8ab-3f51-47a9-9563-dbd5eb05fa99', '8986175b-f95e-40f2-acdc-f6b02329e183', 'feb38e67-dc20-4f90-845b-bb6044e55f62'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:58:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2955ad65-2cb0-4638-a2fb-0c0f00a4180c tempest-TestServerVolumeAttachmentScenario-1828392993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:58:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2955ad65-2cb0-4638-a2fb-0c0f00a4180c tempest-TestServerVolumeAttachmentScenario-1828392993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:58:26 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-2955ad65-2cb0-4638-a2fb-0c0f00a4180c tempest-TestServerVolumeAttachmentScenario-1828392993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:58:26 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-2955ad65-2cb0-4638-a2fb-0c0f00a4180c tempest-TestServerVolumeAttachmentScenario-1828392993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:58:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2955ad65-2cb0-4638-a2fb-0c0f00a4180c tempest-TestServerVolumeAttachmentScenario-1828392993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:58:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2955ad65-2cb0-4638-a2fb-0c0f00a4180c tempest-TestServerVolumeAttachmentScenario-1828392993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:58:26 devstack sudo[102416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:58:26 devstack sudo[102416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:58:26 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2bb1ecd7-51fa-43e0-9b7e-28fb8bf4a683 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Acquiring lock "cinder-acde9d7d-1148-4b52-a8ea-3735c4a5963a-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:58:26 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2bb1ecd7-51fa-43e0-9b7e-28fb8bf4a683 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Lock "cinder-acde9d7d-1148-4b52-a8ea-3735c4a5963a-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:58:26 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2bb1ecd7-51fa-43e0-9b7e-28fb8bf4a683 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Acquiring lock "cinder-quobyte-acde9d7d-1148-4b52-a8ea-3735c4a5963a" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:58:26 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2bb1ecd7-51fa-43e0-9b7e-28fb8bf4a683 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Lock "cinder-quobyte-acde9d7d-1148-4b52-a8ea-3735c4a5963a" acquired by "delete_volume" :: waited 0.036s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:58:27 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8adb099-f486-48d6-8751-9f5d3ba99291]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:58:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2bb1ecd7-51fa-43e0-9b7e-28fb8bf4a683 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-acde9d7d-1148-4b52-a8ea-3735c4a5963a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:58:27 devstack sudo[102416]: pam_unix(sudo:session): session closed for user root Aug 10 12:58:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2955ad65-2cb0-4638-a2fb-0c0f00a4180c tempest-TestServerVolumeAttachmentScenario-1828392993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.466s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:58:27 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-2955ad65-2cb0-4638-a2fb-0c0f00a4180c tempest-TestServerVolumeAttachmentScenario-1828392993 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:58:27 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-2955ad65-2cb0-4638-a2fb-0c0f00a4180c tempest-TestServerVolumeAttachmentScenario-1828392993 None] Deleted volume successfully. Aug 10 12:58:27 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2955ad65-2cb0-4638-a2fb-0c0f00a4180c tempest-TestServerVolumeAttachmentScenario-1828392993 None] Lock "cinder-ba6ad7d2-9b2c-41da-835f-84e5a48a2ced-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:58:27 devstack sudo[102439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-acde9d7d-1148-4b52-a8ea-3735c4a5963a Aug 10 12:58:27 devstack sudo[102439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:58:27 devstack sudo[102439]: pam_unix(sudo:session): session closed for user root Aug 10 12:58:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2bb1ecd7-51fa-43e0-9b7e-28fb8bf4a683 tempest-TestServerVolumeAttachmentScenario-1828392993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-acde9d7d-1148-4b52-a8ea-3735c4a5963a" returned: 0 in 0.649s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:58:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2bb1ecd7-51fa-43e0-9b7e-28fb8bf4a683 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-acde9d7d-1148-4b52-a8ea-3735c4a5963a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:58:27 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-acde9d7d-1148-4b52-a8ea-3735c4a5963a Aug 10 12:58:27 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:58:28 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Aug 10 12:58:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2bb1ecd7-51fa-43e0-9b7e-28fb8bf4a683 tempest-TestServerVolumeAttachmentScenario-1828392993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-acde9d7d-1148-4b52-a8ea-3735c4a5963a" returned: 0 in 0.390s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:58:28 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2bb1ecd7-51fa-43e0-9b7e-28fb8bf4a683 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Lock "cinder-quobyte-acde9d7d-1148-4b52-a8ea-3735c4a5963a" released by "delete_volume" :: held 1.112s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:58:28 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-2bb1ecd7-51fa-43e0-9b7e-28fb8bf4a683 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Created reservations ['177c2500-8cef-41b9-a8ea-9dbb5a93ac92', '3bbe8c61-5f99-43ec-ba75-a0bcf737ddd9', '1ef337a7-2af3-41e9-9f23-9c31a4b4229e', '1d1b6ce5-5a2e-4fea-91d9-ed644bb1a605'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:58:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2bb1ecd7-51fa-43e0-9b7e-28fb8bf4a683 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:58:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2bb1ecd7-51fa-43e0-9b7e-28fb8bf4a683 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:58:28 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-2bb1ecd7-51fa-43e0-9b7e-28fb8bf4a683 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:58:28 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-2bb1ecd7-51fa-43e0-9b7e-28fb8bf4a683 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:58:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2bb1ecd7-51fa-43e0-9b7e-28fb8bf4a683 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:58:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2bb1ecd7-51fa-43e0-9b7e-28fb8bf4a683 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:58:28 devstack sudo[102450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:58:28 devstack sudo[102450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:58:28 devstack sudo[102450]: pam_unix(sudo:session): session closed for user root Aug 10 12:58:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2bb1ecd7-51fa-43e0-9b7e-28fb8bf4a683 tempest-TestServerVolumeAttachmentScenario-1828392993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.314s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:58:28 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-2bb1ecd7-51fa-43e0-9b7e-28fb8bf4a683 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:58:28 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-2bb1ecd7-51fa-43e0-9b7e-28fb8bf4a683 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Deleted volume successfully. Aug 10 12:58:28 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2bb1ecd7-51fa-43e0-9b7e-28fb8bf4a683 tempest-TestServerVolumeAttachmentScenario-1828392993 None] Lock "cinder-acde9d7d-1148-4b52-a8ea-3735c4a5963a-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:58:38 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=29,cinder:UPDATE=29,cinder:INSERT=8,cinder:DELETE=3 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:58:38 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=35,cinder:UPDATE=31,cinder:INSERT=5,cinder:DELETE=1 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:58:46 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:58:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Flow 'volume_create_manager' (440fe7c2-4703-4753-adf6-ca1375c650b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:58:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8692b5fa-be7b-4ca3-bdbb-362b9f05109d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:58:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8692b5fa-be7b-4ca3-bdbb-362b9f05109d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97f5e6b7-9541-48dc-a08c-0b0c5823a93e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf6a358fd12147cfa0aee408dcea0176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:58:47Z,use_quota=True,user_id='15d402c740ac49f28d7c806f3bb73774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e8d6ebf-16d0-4b2e-a023-058bc6312e17),volume_type_id=3e8d6ebf-16d0-4b2e-a023-058bc6312e17)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:58:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b5f5018-68dd-4706-ad95-659bf5e035b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:58:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b5f5018-68dd-4706-ad95-659bf5e035b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:58:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45db3306-4f6a-4320-ace1-709478a3eeb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:58:46 devstack cinder-volume[89096]: DEBUG cinder.image.glance [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Creating Keystone auth plugin from conf {{(pid=89096) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 10 12:58:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45db3306-4f6a-4320-ace1-709478a3eeb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '97f5e6b7-9541-48dc-a08c-0b0c5823a93e', 'volume_name': 'volume-97f5e6b7-9541-48dc-a08c-0b0c5823a93e', 'volume_size': 1, 'image_id': 'cb4900a1-bb25-498a-bc82-bc84a15c4273', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb4900a1-bb25-498a-bc82-bc84a15c4273', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd379274dad0f4b412beb4314ef9e5623', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cf6a358fd12147cfa0aee408dcea0176', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '074f73dc707c520cf28c7563460b4c6ef730809421d0b6a467be6d87c490cfd18ec7650da00de459175f6d78bab7eb3777a629762be57febdd147562e6bed67b', 'id': 'cb4900a1-bb25-498a-bc82-bc84a15c4273', 'created_at': datetime.datetime(2026, 8, 10, 10, 58, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 10, 58, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb4900a1-bb25-498a-bc82-bc84a15c4273/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:58:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (842372fb-c2c8-47e3-9cbb-63f45cfaef54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:58:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (842372fb-c2c8-47e3-9cbb-63f45cfaef54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:58:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37c4ea2b-037e-4bf8-87f6-b0fb29628416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:58:47 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Volume 97f5e6b7-9541-48dc-a08c-0b0c5823a93e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-97f5e6b7-9541-48dc-a08c-0b0c5823a93e', 'volume_size': 1, 'image_id': 'cb4900a1-bb25-498a-bc82-bc84a15c4273', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb4900a1-bb25-498a-bc82-bc84a15c4273', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd379274dad0f4b412beb4314ef9e5623', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cf6a358fd12147cfa0aee408dcea0176', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '074f73dc707c520cf28c7563460b4c6ef730809421d0b6a467be6d87c490cfd18ec7650da00de459175f6d78bab7eb3777a629762be57febdd147562e6bed67b', 'id': 'cb4900a1-bb25-498a-bc82-bc84a15c4273', 'created_at': datetime.datetime(2026, 8, 10, 10, 58, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 10, 58, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb4900a1-bb25-498a-bc82-bc84a15c4273/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 10 12:58:47 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Trying to clone 97f5e6b7-9541-48dc-a08c-0b0c5823a93e from image cb4900a1-bb25-498a-bc82-bc84a15c4273 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cb4900a1-bb25-498a-bc82-bc84a15c4273', 'metadata': {}}]). {{(pid=89096) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 10 12:58:47 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cb4900a1-bb25-498a-bc82-bc84a15c4273_3wrhzsrvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89096) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 10 12:58:47 devstack cinder-volume[89096]: INFO cinder.image.image_utils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Image download 0.00 MB at 0.00 MB/s Aug 10 12:58:47 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[86559d46-98ae-438a-a58c-02320d3ef6c3]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:58:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb4900a1-bb25-498a-bc82-bc84a15c4273_3wrhzsrvdevstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:58:47 devstack sudo[102492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb4900a1-bb25-498a-bc82-bc84a15c4273_3wrhzsrvdevstack@QuobyteHD Aug 10 12:58:47 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:58:47 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root Aug 10 12:58:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb4900a1-bb25-498a-bc82-bc84a15c4273_3wrhzsrvdevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:58:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb4900a1-bb25-498a-bc82-bc84a15c4273_3wrhzsrvdevstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:58:47 devstack sudo[102496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb4900a1-bb25-498a-bc82-bc84a15c4273_3wrhzsrvdevstack@QuobyteHD Aug 10 12:58:47 devstack sudo[102496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:58:48 devstack sudo[102496]: pam_unix(sudo:session): session closed for user root Aug 10 12:58:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb4900a1-bb25-498a-bc82-bc84a15c4273_3wrhzsrvdevstack@QuobyteHD" returned: 1 in 0.346s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:58:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb4900a1-bb25-498a-bc82-bc84a15c4273_3wrhzsrvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 12:58:48 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Temporary image cb4900a1-bb25-498a-bc82-bc84a15c4273 is fetched for user 15d402c740ac49f28d7c806f3bb73774. {{(pid=89096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 10 12:58:48 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[677fa8a9-5569-4bb9-817b-cdd88b528ebc]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:58:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb4900a1-bb25-498a-bc82-bc84a15c4273_3wrhzsrvdevstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:58:48 devstack sudo[102504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb4900a1-bb25-498a-bc82-bc84a15c4273_3wrhzsrvdevstack@QuobyteHD Aug 10 12:58:48 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:58:48 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root Aug 10 12:58:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb4900a1-bb25-498a-bc82-bc84a15c4273_3wrhzsrvdevstack@QuobyteHD" returned: 0 in 0.361s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:58:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb4900a1-bb25-498a-bc82-bc84a15c4273_3wrhzsrvdevstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:58:48 devstack sudo[102509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb4900a1-bb25-498a-bc82-bc84a15c4273_3wrhzsrvdevstack@QuobyteHD Aug 10 12:58:48 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:58:48 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root Aug 10 12:58:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb4900a1-bb25-498a-bc82-bc84a15c4273_3wrhzsrvdevstack@QuobyteHD" returned: 1 in 0.340s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:58:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb4900a1-bb25-498a-bc82-bc84a15c4273_3wrhzsrvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 12:58:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:58:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:58:48 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97f5e6b7-9541-48dc-a08c-0b0c5823a93e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf6a358fd12147cfa0aee408dcea0176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:58:47Z,use_quota=True,user_id='15d402c740ac49f28d7c806f3bb73774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e8d6ebf-16d0-4b2e-a023-058bc6312e17),volume_type_id=3e8d6ebf-16d0-4b2e-a023-058bc6312e17)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:58:48 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Creating volume 97f5e6b7-9541-48dc-a08c-0b0c5823a93e {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:58:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:58:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:58:48 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:58:48 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:58:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:58:48 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:58:48 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:58:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-97f5e6b7-9541-48dc-a08c-0b0c5823a93e 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:58:48 devstack sudo[102514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-97f5e6b7-9541-48dc-a08c-0b0c5823a93e 1073741824 Aug 10 12:58:48 devstack sudo[102514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:58:49 devstack sudo[102514]: pam_unix(sudo:session): session closed for user root Aug 10 12:58:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-97f5e6b7-9541-48dc-a08c-0b0c5823a93e 1073741824" returned: 0 in 0.645s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:58:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-97f5e6b7-9541-48dc-a08c-0b0c5823a93e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:58:49 devstack sudo[102529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-97f5e6b7-9541-48dc-a08c-0b0c5823a93e Aug 10 12:58:49 devstack sudo[102529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:58:49 devstack sudo[102529]: pam_unix(sudo:session): session closed for user root Aug 10 12:58:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-97f5e6b7-9541-48dc-a08c-0b0c5823a93e" returned: 0 in 0.326s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:58:49 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:58:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:58:50 devstack cinder-volume[89096]: DEBUG cinder.volume.volume_utils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Attempting download of cb4900a1-bb25-498a-bc82-bc84a15c4273 ((None, [{'url': 'file:///opt/stack/data/glance/images/cb4900a1-bb25-498a-bc82-bc84a15c4273', 'metadata': {}}])) to volume 97f5e6b7-9541-48dc-a08c-0b0c5823a93e. {{(pid=89096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 10 12:58:50 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[2885ba42-215f-4160-9729-4efb22fa718d]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:58:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb4900a1-bb25-498a-bc82-bc84a15c4273_1qab5hmf {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:58:50 devstack sudo[102543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb4900a1-bb25-498a-bc82-bc84a15c4273_1qab5hmf Aug 10 12:58:50 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:58:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-dcea0256-9dcb-4f3f-82fc-d63819fb56b8 req-e9ce91d3-1285-4a7a-bbc0-8ed1dfbd6cab tempest-TestStampPattern-1500701631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:58:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-dcea0256-9dcb-4f3f-82fc-d63819fb56b8 req-e9ce91d3-1285-4a7a-bbc0-8ed1dfbd6cab tempest-TestStampPattern-1500701631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:58:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-dcea0256-9dcb-4f3f-82fc-d63819fb56b8 req-e9ce91d3-1285-4a7a-bbc0-8ed1dfbd6cab tempest-TestStampPattern-1500701631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:58:50 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root Aug 10 12:58:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb4900a1-bb25-498a-bc82-bc84a15c4273_1qab5hmf" returned: 0 in 0.435s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:58:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb4900a1-bb25-498a-bc82-bc84a15c4273_1qab5hmf {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:58:50 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-dcea0256-9dcb-4f3f-82fc-d63819fb56b8 req-e9ce91d3-1285-4a7a-bbc0-8ed1dfbd6cab tempest-TestStampPattern-1500701631 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d', 'name': 'volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd89d030c-344b-44c0-b2ad-61d565aae32e', 'enforce_multipath': True} {{(pid=89096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Aug 10 12:58:50 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-dcea0256-9dcb-4f3f-82fc-d63819fb56b8 req-e9ce91d3-1285-4a7a-bbc0-8ed1dfbd6cab tempest-TestStampPattern-1500701631 None] attachment_update completed successfully. Aug 10 12:58:50 devstack sudo[102558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb4900a1-bb25-498a-bc82-bc84a15c4273_1qab5hmf Aug 10 12:58:50 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:58:50 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root Aug 10 12:58:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb4900a1-bb25-498a-bc82-bc84a15c4273_1qab5hmf" returned: 1 in 0.382s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:58:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb4900a1-bb25-498a-bc82-bc84a15c4273_1qab5hmf' failed. Not Retrying. {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 12:58:50 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ac020f-79de-4938-8c6a-7af34d4c3ee4]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:58:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb4900a1-bb25-498a-bc82-bc84a15c4273_3wrhzsrvdevstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:58:51 devstack sudo[102933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb4900a1-bb25-498a-bc82-bc84a15c4273_3wrhzsrvdevstack@QuobyteHD Aug 10 12:58:51 devstack sudo[102933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:58:51 devstack sudo[102933]: pam_unix(sudo:session): session closed for user root Aug 10 12:58:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb4900a1-bb25-498a-bc82-bc84a15c4273_3wrhzsrvdevstack@QuobyteHD" returned: 0 in 0.409s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:58:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb4900a1-bb25-498a-bc82-bc84a15c4273_3wrhzsrvdevstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:58:51 devstack sudo[102952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb4900a1-bb25-498a-bc82-bc84a15c4273_3wrhzsrvdevstack@QuobyteHD Aug 10 12:58:51 devstack sudo[102952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:58:51 devstack sudo[102952]: pam_unix(sudo:session): session closed for user root Aug 10 12:58:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb4900a1-bb25-498a-bc82-bc84a15c4273_3wrhzsrvdevstack@QuobyteHD" returned: 1 in 0.423s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:58:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb4900a1-bb25-498a-bc82-bc84a15c4273_3wrhzsrvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 12:58:51 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] cb4900a1-bb25-498a-bc82-bc84a15c4273 was raw, converting to qcow2 {{(pid=89096) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 10 12:58:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cb4900a1-bb25-498a-bc82-bc84a15c4273_3wrhzsrvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-97f5e6b7-9541-48dc-a08c-0b0c5823a93e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:58:51 devstack sudo[102957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cb4900a1-bb25-498a-bc82-bc84a15c4273_3wrhzsrvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-97f5e6b7-9541-48dc-a08c-0b0c5823a93e Aug 10 12:58:51 devstack sudo[102957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:58:52 devstack sudo[102957]: pam_unix(sudo:session): session closed for user root Aug 10 12:58:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cb4900a1-bb25-498a-bc82-bc84a15c4273_3wrhzsrvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-97f5e6b7-9541-48dc-a08c-0b0c5823a93e" returned: 0 in 0.467s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:58:52 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cb4900a1-bb25-498a-bc82-bc84a15c4273_3wrhzsrvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-97f5e6b7-9541-48dc-a08c-0b0c5823a93e {{(pid=89096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 12:58:52 devstack cinder-volume[89096]: INFO cinder.image.image_utils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Converted 0.00 MB image at 0.00 MB/s Aug 10 12:58:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-97f5e6b7-9541-48dc-a08c-0b0c5823a93e 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:58:52 devstack sudo[102962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-97f5e6b7-9541-48dc-a08c-0b0c5823a93e 1G Aug 10 12:58:52 devstack sudo[102962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:58:52 devstack sudo[102962]: pam_unix(sudo:session): session closed for user root Aug 10 12:58:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-97f5e6b7-9541-48dc-a08c-0b0c5823a93e 1G" returned: 0 in 0.351s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:58:52 devstack cinder-volume[89096]: DEBUG cinder.volume.volume_utils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Downloaded image cb4900a1-bb25-498a-bc82-bc84a15c4273 ((None, [{'url': 'file:///opt/stack/data/glance/images/cb4900a1-bb25-498a-bc82-bc84a15c4273', 'metadata': {}}])) to volume 97f5e6b7-9541-48dc-a08c-0b0c5823a93e successfully. {{(pid=89096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 10 12:58:52 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Temporary image cb4900a1-bb25-498a-bc82-bc84a15c4273 for user 15d402c740ac49f28d7c806f3bb73774 is deleted. {{(pid=89096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 10 12:58:52 devstack cinder-volume[89096]: DEBUG cinder.volume.volume_utils [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Marking volume 97f5e6b7-9541-48dc-a08c-0b0c5823a93e as bootable. {{(pid=89096) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 10 12:58:52 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Copying metadata from image cb4900a1-bb25-498a-bc82-bc84a15c4273 to 97f5e6b7-9541-48dc-a08c-0b0c5823a93e. {{(pid=89096) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 10 12:58:52 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Creating volume glance metadata for volume 97f5e6b7-9541-48dc-a08c-0b0c5823a93e backed by image cb4900a1-bb25-498a-bc82-bc84a15c4273 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'cb4900a1-bb25-498a-bc82-bc84a15c4273', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd379274dad0f4b412beb4314ef9e5623', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89096) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 10 12:58:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37c4ea2b-037e-4bf8-87f6-b0fb29628416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97f5e6b7-9541-48dc-a08c-0b0c5823a93e', 'volume_size': 1, 'image_id': 'cb4900a1-bb25-498a-bc82-bc84a15c4273', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb4900a1-bb25-498a-bc82-bc84a15c4273', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd379274dad0f4b412beb4314ef9e5623', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cf6a358fd12147cfa0aee408dcea0176', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '074f73dc707c520cf28c7563460b4c6ef730809421d0b6a467be6d87c490cfd18ec7650da00de459175f6d78bab7eb3777a629762be57febdd147562e6bed67b', 'id': 'cb4900a1-bb25-498a-bc82-bc84a15c4273', 'created_at': datetime.datetime(2026, 8, 10, 10, 58, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 10, 58, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb4900a1-bb25-498a-bc82-bc84a15c4273/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:58:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32074322-acab-4837-828d-113e0c49a5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:58:52 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Volume volume-97f5e6b7-9541-48dc-a08c-0b0c5823a93e (97f5e6b7-9541-48dc-a08c-0b0c5823a93e): created successfully Aug 10 12:58:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32074322-acab-4837-828d-113e0c49a5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:58:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Flow 'volume_create_manager' (440fe7c2-4703-4753-adf6-ca1375c650b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:58:52 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-2cd85388-8b35-41cb-bef1-5fdde69e42d7 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Created volume successfully. Aug 10 12:58:53 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-13804e31-1467-4aa3-b71b-2ddde632ce82 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Acquiring lock "cinder-97f5e6b7-9541-48dc-a08c-0b0c5823a93e-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:58:53 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-13804e31-1467-4aa3-b71b-2ddde632ce82 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Lock "cinder-97f5e6b7-9541-48dc-a08c-0b0c5823a93e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:58:53 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-13804e31-1467-4aa3-b71b-2ddde632ce82 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Acquiring lock "cinder-quobyte-97f5e6b7-9541-48dc-a08c-0b0c5823a93e" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:58:53 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-13804e31-1467-4aa3-b71b-2ddde632ce82 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Lock "cinder-quobyte-97f5e6b7-9541-48dc-a08c-0b0c5823a93e" acquired by "delete_volume" :: waited 0.037s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:58:53 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83e5395-6ed5-411c-b0eb-02820c611d4a]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:58:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-13804e31-1467-4aa3-b71b-2ddde632ce82 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-97f5e6b7-9541-48dc-a08c-0b0c5823a93e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:58:53 devstack sudo[103018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-97f5e6b7-9541-48dc-a08c-0b0c5823a93e Aug 10 12:58:53 devstack sudo[103018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:58:54 devstack sudo[103018]: pam_unix(sudo:session): session closed for user root Aug 10 12:58:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-13804e31-1467-4aa3-b71b-2ddde632ce82 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-97f5e6b7-9541-48dc-a08c-0b0c5823a93e" returned: 0 in 0.586s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:58:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-13804e31-1467-4aa3-b71b-2ddde632ce82 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-97f5e6b7-9541-48dc-a08c-0b0c5823a93e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:58:54 devstack sudo[103047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-97f5e6b7-9541-48dc-a08c-0b0c5823a93e Aug 10 12:58:54 devstack sudo[103047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:58:54 devstack sudo[103047]: pam_unix(sudo:session): session closed for user root Aug 10 12:58:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-13804e31-1467-4aa3-b71b-2ddde632ce82 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-97f5e6b7-9541-48dc-a08c-0b0c5823a93e" returned: 0 in 0.336s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:58:54 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-13804e31-1467-4aa3-b71b-2ddde632ce82 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Lock "cinder-quobyte-97f5e6b7-9541-48dc-a08c-0b0c5823a93e" released by "delete_volume" :: held 1.000s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:58:54 devstack cinder-volume[89096]: WARNING cinder.quota [None req-13804e31-1467-4aa3-b71b-2ddde632ce82 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 10 12:58:54 devstack cinder-volume[89096]: WARNING cinder.quota [None req-13804e31-1467-4aa3-b71b-2ddde632ce82 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 10 12:58:54 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-13804e31-1467-4aa3-b71b-2ddde632ce82 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Created reservations ['b6280471-5826-485e-b7d9-8fa569130d2f', '9b3e1b95-5b3f-4f7c-8c3f-0179e7fb532b', 'b5b1eba5-5064-4219-892f-85b24430e56c', '9b6a4854-8474-4c73-85ff-ee876e728e51'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:58:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-13804e31-1467-4aa3-b71b-2ddde632ce82 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:58:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-13804e31-1467-4aa3-b71b-2ddde632ce82 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:58:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-13804e31-1467-4aa3-b71b-2ddde632ce82 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:58:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-13804e31-1467-4aa3-b71b-2ddde632ce82 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:58:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-13804e31-1467-4aa3-b71b-2ddde632ce82 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:58:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-13804e31-1467-4aa3-b71b-2ddde632ce82 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:58:54 devstack sudo[103066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:58:54 devstack sudo[103066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:58:55 devstack sudo[103066]: pam_unix(sudo:session): session closed for user root Aug 10 12:58:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-13804e31-1467-4aa3-b71b-2ddde632ce82 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.270s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:58:55 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-13804e31-1467-4aa3-b71b-2ddde632ce82 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:58:55 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-13804e31-1467-4aa3-b71b-2ddde632ce82 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Deleted volume successfully. Aug 10 12:58:55 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-13804e31-1467-4aa3-b71b-2ddde632ce82 tempest-VolumeAndVolumeTypeFromImageTest-928636211 None] Lock "cinder-97f5e6b7-9541-48dc-a08c-0b0c5823a93e-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:58:56 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-8f144065-953b-44c9-b298-5f60015b15da req-a225a7a6-6cbb-477d-986f-4e6be38e7b4b tempest-TestStampPattern-1500701631 None] Terminate volume connection completed successfully. Aug 10 12:58:56 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-8f144065-953b-44c9-b298-5f60015b15da req-a225a7a6-6cbb-477d-986f-4e6be38e7b4b tempest-TestStampPattern-1500701631 None] Deleting attachment d89d030c-344b-44c0-b2ad-61d565aae32e. {{(pid=89096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Aug 10 12:58:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-102a564e-05af-4b0a-8a88-5dd701810e76 tempest-TestStampPattern-1500701631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:58:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-102a564e-05af-4b0a-8a88-5dd701810e76 tempest-TestStampPattern-1500701631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:58:57 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-102a564e-05af-4b0a-8a88-5dd701810e76 tempest-TestStampPattern-1500701631 None] Creating offline snapshot 17c77a8c-61b2-43bf-b709-6ef0e076f747 of volume b21c97ed-d738-4d79-aa6e-0ef6b9826c63 {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 12:58:57 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c31c9d4-85fb-40c4-a771-1073da18705a]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:58:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-102a564e-05af-4b0a-8a88-5dd701810e76 tempest-TestStampPattern-1500701631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:58:58 devstack sudo[103111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63 Aug 10 12:58:58 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:58:58 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root Aug 10 12:58:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-102a564e-05af-4b0a-8a88-5dd701810e76 tempest-TestStampPattern-1500701631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63" returned: 0 in 0.483s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:58:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-102a564e-05af-4b0a-8a88-5dd701810e76 tempest-TestStampPattern-1500701631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63.17c77a8c-61b2-43bf-b709-6ef0e076f747 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:58:58 devstack sudo[103117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63.17c77a8c-61b2-43bf-b709-6ef0e076f747 1G Aug 10 12:58:58 devstack sudo[103117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:58:58 devstack sudo[103117]: pam_unix(sudo:session): session closed for user root Aug 10 12:58:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-102a564e-05af-4b0a-8a88-5dd701810e76 tempest-TestStampPattern-1500701631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63.17c77a8c-61b2-43bf-b709-6ef0e076f747 1G" returned: 0 in 0.522s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:58:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-102a564e-05af-4b0a-8a88-5dd701810e76 tempest-TestStampPattern-1500701631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63.17c77a8c-61b2-43bf-b709-6ef0e076f747 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:58:58 devstack sudo[103124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63.17c77a8c-61b2-43bf-b709-6ef0e076f747 Aug 10 12:58:58 devstack sudo[103124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:58:59 devstack sudo[103124]: pam_unix(sudo:session): session closed for user root Aug 10 12:58:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-102a564e-05af-4b0a-8a88-5dd701810e76 tempest-TestStampPattern-1500701631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63.17c77a8c-61b2-43bf-b709-6ef0e076f747" returned: 0 in 0.330s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:58:59 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-102a564e-05af-4b0a-8a88-5dd701810e76 tempest-TestStampPattern-1500701631 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63.17c77a8c-61b2-43bf-b709-6ef0e076f747 is being set with open permissions: ugo+rw Aug 10 12:58:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-102a564e-05af-4b0a-8a88-5dd701810e76 tempest-TestStampPattern-1500701631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63.17c77a8c-61b2-43bf-b709-6ef0e076f747 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:58:59 devstack sudo[103131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63.17c77a8c-61b2-43bf-b709-6ef0e076f747 Aug 10 12:58:59 devstack sudo[103131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:58:59 devstack sudo[103131]: pam_unix(sudo:session): session closed for user root Aug 10 12:58:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-102a564e-05af-4b0a-8a88-5dd701810e76 tempest-TestStampPattern-1500701631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63.17c77a8c-61b2-43bf-b709-6ef0e076f747" returned: 0 in 0.380s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:58:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-102a564e-05af-4b0a-8a88-5dd701810e76 tempest-TestStampPattern-1500701631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:58:59 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63.info Aug 10 12:58:59 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:00 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-102a564e-05af-4b0a-8a88-5dd701810e76 tempest-TestStampPattern-1500701631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63.info" returned: 0 in 0.393s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:00 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-102a564e-05af-4b0a-8a88-5dd701810e76 tempest-TestStampPattern-1500701631 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63.info is being set with open permissions: ugo+rw Aug 10 12:59:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-102a564e-05af-4b0a-8a88-5dd701810e76 tempest-TestStampPattern-1500701631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:00 devstack sudo[103138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63.info Aug 10 12:59:00 devstack sudo[103138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:00 devstack sudo[103138]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-102a564e-05af-4b0a-8a88-5dd701810e76 tempest-TestStampPattern-1500701631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63.info" returned: 0 in 0.401s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-102a564e-05af-4b0a-8a88-5dd701810e76 tempest-TestStampPattern-1500701631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.640s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:00 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-102a564e-05af-4b0a-8a88-5dd701810e76 tempest-TestStampPattern-1500701631 None] Create snapshot completed successfully Aug 10 12:59:01 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2f1eb43-8b64-4b79-a464-1373aab29778 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:59:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a2f1eb43-8b64-4b79-a464-1373aab29778 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Flow 'volume_create_manager' (e3b20c00-7e78-4925-adbe-fc07e1225bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:59:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a2f1eb43-8b64-4b79-a464-1373aab29778 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99c75b21-48d7-4da2-be40-09f74e967358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a2f1eb43-8b64-4b79-a464-1373aab29778 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99c75b21-48d7-4da2-be40-09f74e967358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2135499882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c78f2b73-87d4-4dea-b7db-3f36562a8bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e12982d8c97b476d9864cd6cc4ee5314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:59:02Z,use_quota=True,user_id='49c6a3a9642949448f855764c4c4b885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a2f1eb43-8b64-4b79-a464-1373aab29778 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f90079e-ff2c-4500-bf44-9cf5739949a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a2f1eb43-8b64-4b79-a464-1373aab29778 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f90079e-ff2c-4500-bf44-9cf5739949a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a2f1eb43-8b64-4b79-a464-1373aab29778 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63e26216-3101-46cd-a300-0e1a0e19ce8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a2f1eb43-8b64-4b79-a464-1373aab29778 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63e26216-3101-46cd-a300-0e1a0e19ce8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c78f2b73-87d4-4dea-b7db-3f36562a8bd8', 'volume_name': 'volume-c78f2b73-87d4-4dea-b7db-3f36562a8bd8', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a2f1eb43-8b64-4b79-a464-1373aab29778 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1aad7f2-ee6c-4dc9-8037-b4c35d2cd49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a2f1eb43-8b64-4b79-a464-1373aab29778 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1aad7f2-ee6c-4dc9-8037-b4c35d2cd49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a2f1eb43-8b64-4b79-a464-1373aab29778 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44a74fde-21a9-48af-a46d-9ef9cdada5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:01 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-a2f1eb43-8b64-4b79-a464-1373aab29778 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Volume c78f2b73-87d4-4dea-b7db-3f36562a8bd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c78f2b73-87d4-4dea-b7db-3f36562a8bd8', 'volume_size': 1} Aug 10 12:59:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a2f1eb43-8b64-4b79-a464-1373aab29778 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a2f1eb43-8b64-4b79-a464-1373aab29778 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:01 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a2f1eb43-8b64-4b79-a464-1373aab29778 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2135499882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c78f2b73-87d4-4dea-b7db-3f36562a8bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e12982d8c97b476d9864cd6cc4ee5314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:59:02Z,use_quota=True,user_id='49c6a3a9642949448f855764c4c4b885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:59:01 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-a2f1eb43-8b64-4b79-a464-1373aab29778 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Creating volume c78f2b73-87d4-4dea-b7db-3f36562a8bd8 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:59:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a2f1eb43-8b64-4b79-a464-1373aab29778 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a2f1eb43-8b64-4b79-a464-1373aab29778 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:01 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a2f1eb43-8b64-4b79-a464-1373aab29778 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:59:01 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a2f1eb43-8b64-4b79-a464-1373aab29778 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:59:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a2f1eb43-8b64-4b79-a464-1373aab29778 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:01 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a2f1eb43-8b64-4b79-a464-1373aab29778 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:59:01 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-a2f1eb43-8b64-4b79-a464-1373aab29778 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:59:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a2f1eb43-8b64-4b79-a464-1373aab29778 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c78f2b73-87d4-4dea-b7db-3f36562a8bd8 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:01 devstack sudo[103144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c78f2b73-87d4-4dea-b7db-3f36562a8bd8 1073741824 Aug 10 12:59:01 devstack sudo[103144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:02 devstack sudo[103144]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a2f1eb43-8b64-4b79-a464-1373aab29778 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c78f2b73-87d4-4dea-b7db-3f36562a8bd8 1073741824" returned: 0 in 0.581s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a2f1eb43-8b64-4b79-a464-1373aab29778 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c78f2b73-87d4-4dea-b7db-3f36562a8bd8 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:02 devstack sudo[103150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c78f2b73-87d4-4dea-b7db-3f36562a8bd8 Aug 10 12:59:02 devstack sudo[103150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:02 devstack sudo[103150]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a2f1eb43-8b64-4b79-a464-1373aab29778 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c78f2b73-87d4-4dea-b7db-3f36562a8bd8" returned: 0 in 0.318s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a2f1eb43-8b64-4b79-a464-1373aab29778 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:59:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a2f1eb43-8b64-4b79-a464-1373aab29778 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a2f1eb43-8b64-4b79-a464-1373aab29778 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44a74fde-21a9-48af-a46d-9ef9cdada5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c78f2b73-87d4-4dea-b7db-3f36562a8bd8', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a2f1eb43-8b64-4b79-a464-1373aab29778 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (506fe59b-08e2-4473-b2ef-4440d78491bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:02 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-a2f1eb43-8b64-4b79-a464-1373aab29778 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Volume volume-c78f2b73-87d4-4dea-b7db-3f36562a8bd8 (c78f2b73-87d4-4dea-b7db-3f36562a8bd8): created successfully Aug 10 12:59:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a2f1eb43-8b64-4b79-a464-1373aab29778 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (506fe59b-08e2-4473-b2ef-4440d78491bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a2f1eb43-8b64-4b79-a464-1373aab29778 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Flow 'volume_create_manager' (e3b20c00-7e78-4925-adbe-fc07e1225bd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:59:02 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-a2f1eb43-8b64-4b79-a464-1373aab29778 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Created volume successfully. Aug 10 12:59:03 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 12:59:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:59:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:59:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:03 devstack sudo[103175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:59:03 devstack sudo[103175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:04 devstack sudo[103175]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.329s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:04 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:59:04 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager._thread_info {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 12:59:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread count: 28 {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 12:59:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread info: [<_MainThread(MainThread, started 130607683133568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Aug 10 12:59:04 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-9faf802b-f6aa-45ad-8374-c88364b372c1 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:59:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9faf802b-f6aa-45ad-8374-c88364b372c1 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Flow 'volume_create_manager' (2ea02ad9-6df4-4f09-9935-a535a42bd38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:59:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9faf802b-f6aa-45ad-8374-c88364b372c1 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80082b11-b664-443c-b1f4-200f59b81aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9faf802b-f6aa-45ad-8374-c88364b372c1 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80082b11-b664-443c-b1f4-200f59b81aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1597792009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aac351b-bb18-4e33-baa7-6b1ca5e30f0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e12982d8c97b476d9864cd6cc4ee5314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:59:04Z,use_quota=True,user_id='49c6a3a9642949448f855764c4c4b885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9faf802b-f6aa-45ad-8374-c88364b372c1 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28dce1d3-1907-48dd-b6ba-101dc782f7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9faf802b-f6aa-45ad-8374-c88364b372c1 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28dce1d3-1907-48dd-b6ba-101dc782f7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9faf802b-f6aa-45ad-8374-c88364b372c1 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d315e4c1-19ae-45ac-963e-dea28c6f11a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9faf802b-f6aa-45ad-8374-c88364b372c1 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d315e4c1-19ae-45ac-963e-dea28c6f11a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7aac351b-bb18-4e33-baa7-6b1ca5e30f0a', 'volume_name': 'volume-7aac351b-bb18-4e33-baa7-6b1ca5e30f0a', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9faf802b-f6aa-45ad-8374-c88364b372c1 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a31f67c3-1455-4bd5-814f-6e40b68d360d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9faf802b-f6aa-45ad-8374-c88364b372c1 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a31f67c3-1455-4bd5-814f-6e40b68d360d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9faf802b-f6aa-45ad-8374-c88364b372c1 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d15ed67d-fa68-403c-b2df-26dcceb092e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:04 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-9faf802b-f6aa-45ad-8374-c88364b372c1 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Volume 7aac351b-bb18-4e33-baa7-6b1ca5e30f0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7aac351b-bb18-4e33-baa7-6b1ca5e30f0a', 'volume_size': 1} Aug 10 12:59:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9faf802b-f6aa-45ad-8374-c88364b372c1 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9faf802b-f6aa-45ad-8374-c88364b372c1 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9faf802b-f6aa-45ad-8374-c88364b372c1 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1597792009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aac351b-bb18-4e33-baa7-6b1ca5e30f0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e12982d8c97b476d9864cd6cc4ee5314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:59:04Z,use_quota=True,user_id='49c6a3a9642949448f855764c4c4b885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:59:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-9faf802b-f6aa-45ad-8374-c88364b372c1 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Creating volume 7aac351b-bb18-4e33-baa7-6b1ca5e30f0a {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:59:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9faf802b-f6aa-45ad-8374-c88364b372c1 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9faf802b-f6aa-45ad-8374-c88364b372c1 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9faf802b-f6aa-45ad-8374-c88364b372c1 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:59:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9faf802b-f6aa-45ad-8374-c88364b372c1 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:59:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9faf802b-f6aa-45ad-8374-c88364b372c1 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9faf802b-f6aa-45ad-8374-c88364b372c1 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:59:04 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-9faf802b-f6aa-45ad-8374-c88364b372c1 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:59:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9faf802b-f6aa-45ad-8374-c88364b372c1 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-7aac351b-bb18-4e33-baa7-6b1ca5e30f0a 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:04 devstack sudo[103186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-7aac351b-bb18-4e33-baa7-6b1ca5e30f0a 1073741824 Aug 10 12:59:04 devstack sudo[103186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3c9e962-0baf-4b91-8741-c7c999f312ac tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a3c9e962-0baf-4b91-8741-c7c999f312ac tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Flow 'volume_create_manager' (9b47597e-5998-43e7-9240-2936820de15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a3c9e962-0baf-4b91-8741-c7c999f312ac tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da1d537b-6057-481a-893f-05c583dd0e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a3c9e962-0baf-4b91-8741-c7c999f312ac tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da1d537b-6057-481a-893f-05c583dd0e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-978469825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f179909-4c52-4d6d-abae-1ae58b86a341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e12982d8c97b476d9864cd6cc4ee5314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:59:05Z,use_quota=True,user_id='49c6a3a9642949448f855764c4c4b885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a3c9e962-0baf-4b91-8741-c7c999f312ac tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d096ecff-54fd-4b49-92b0-2eb4ed450ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a3c9e962-0baf-4b91-8741-c7c999f312ac tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d096ecff-54fd-4b49-92b0-2eb4ed450ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a3c9e962-0baf-4b91-8741-c7c999f312ac tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6920725-cd35-49a3-a2be-43371a8aa6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a3c9e962-0baf-4b91-8741-c7c999f312ac tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6920725-cd35-49a3-a2be-43371a8aa6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f179909-4c52-4d6d-abae-1ae58b86a341', 'volume_name': 'volume-3f179909-4c52-4d6d-abae-1ae58b86a341', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a3c9e962-0baf-4b91-8741-c7c999f312ac tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6106ad24-2d18-4639-8931-d2e8d0ef9492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a3c9e962-0baf-4b91-8741-c7c999f312ac tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6106ad24-2d18-4639-8931-d2e8d0ef9492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a3c9e962-0baf-4b91-8741-c7c999f312ac tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2749ac79-17d0-4144-a5ad-9c515a4f70c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:05 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-a3c9e962-0baf-4b91-8741-c7c999f312ac tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Volume 3f179909-4c52-4d6d-abae-1ae58b86a341: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f179909-4c52-4d6d-abae-1ae58b86a341', 'volume_size': 1} Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a3c9e962-0baf-4b91-8741-c7c999f312ac tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:05 devstack sudo[103186]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9faf802b-f6aa-45ad-8374-c88364b372c1 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-7aac351b-bb18-4e33-baa7-6b1ca5e30f0a 1073741824" returned: 0 in 0.697s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9faf802b-f6aa-45ad-8374-c88364b372c1 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-7aac351b-bb18-4e33-baa7-6b1ca5e30f0a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:05 devstack sudo[103192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-7aac351b-bb18-4e33-baa7-6b1ca5e30f0a Aug 10 12:59:05 devstack sudo[103192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ba8b1ef-3bf8-46e2-a142-026d74fc91d5 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8ba8b1ef-3bf8-46e2-a142-026d74fc91d5 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Flow 'volume_create_manager' (3547346e-4643-4491-a3ad-7f493936a039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8ba8b1ef-3bf8-46e2-a142-026d74fc91d5 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc23dc4-5870-4be4-b284-b52b36245404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8ba8b1ef-3bf8-46e2-a142-026d74fc91d5 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc23dc4-5870-4be4-b284-b52b36245404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1901480976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82598b61-054b-4892-bcad-6fe063c66948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e12982d8c97b476d9864cd6cc4ee5314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:59:06Z,use_quota=True,user_id='49c6a3a9642949448f855764c4c4b885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:05 devstack sudo[103192]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8ba8b1ef-3bf8-46e2-a142-026d74fc91d5 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd7b3507-4966-483c-a357-8443439906b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8ba8b1ef-3bf8-46e2-a142-026d74fc91d5 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd7b3507-4966-483c-a357-8443439906b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8ba8b1ef-3bf8-46e2-a142-026d74fc91d5 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70071e32-aa7c-4d13-8fdf-4c7aa5494cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8ba8b1ef-3bf8-46e2-a142-026d74fc91d5 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70071e32-aa7c-4d13-8fdf-4c7aa5494cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82598b61-054b-4892-bcad-6fe063c66948', 'volume_name': 'volume-82598b61-054b-4892-bcad-6fe063c66948', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8ba8b1ef-3bf8-46e2-a142-026d74fc91d5 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b952905f-fa0a-472a-8991-d0a36bd48e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8ba8b1ef-3bf8-46e2-a142-026d74fc91d5 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b952905f-fa0a-472a-8991-d0a36bd48e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8ba8b1ef-3bf8-46e2-a142-026d74fc91d5 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ac8255-571b-4cae-84dc-4e1d079170fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:05 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-8ba8b1ef-3bf8-46e2-a142-026d74fc91d5 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Volume 82598b61-054b-4892-bcad-6fe063c66948: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82598b61-054b-4892-bcad-6fe063c66948', 'volume_size': 1} Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8ba8b1ef-3bf8-46e2-a142-026d74fc91d5 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9faf802b-f6aa-45ad-8374-c88364b372c1 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-7aac351b-bb18-4e33-baa7-6b1ca5e30f0a" returned: 0 in 0.578s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9faf802b-f6aa-45ad-8374-c88364b372c1 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9faf802b-f6aa-45ad-8374-c88364b372c1 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a3c9e962-0baf-4b91-8741-c7c999f312ac tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.637s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a3c9e962-0baf-4b91-8741-c7c999f312ac tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-978469825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f179909-4c52-4d6d-abae-1ae58b86a341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e12982d8c97b476d9864cd6cc4ee5314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:59:05Z,use_quota=True,user_id='49c6a3a9642949448f855764c4c4b885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-a3c9e962-0baf-4b91-8741-c7c999f312ac tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Creating volume 3f179909-4c52-4d6d-abae-1ae58b86a341 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a3c9e962-0baf-4b91-8741-c7c999f312ac tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a3c9e962-0baf-4b91-8741-c7c999f312ac tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a3c9e962-0baf-4b91-8741-c7c999f312ac tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a3c9e962-0baf-4b91-8741-c7c999f312ac tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a3c9e962-0baf-4b91-8741-c7c999f312ac tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a3c9e962-0baf-4b91-8741-c7c999f312ac tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:59:05 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-a3c9e962-0baf-4b91-8741-c7c999f312ac tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a3c9e962-0baf-4b91-8741-c7c999f312ac tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3f179909-4c52-4d6d-abae-1ae58b86a341 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:05 devstack sudo[103195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3f179909-4c52-4d6d-abae-1ae58b86a341 1073741824 Aug 10 12:59:05 devstack sudo[103195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9faf802b-f6aa-45ad-8374-c88364b372c1 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d15ed67d-fa68-403c-b2df-26dcceb092e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7aac351b-bb18-4e33-baa7-6b1ca5e30f0a', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9faf802b-f6aa-45ad-8374-c88364b372c1 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89f6360d-0454-415b-953b-a2d122e177b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:05 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-9faf802b-f6aa-45ad-8374-c88364b372c1 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Volume volume-7aac351b-bb18-4e33-baa7-6b1ca5e30f0a (7aac351b-bb18-4e33-baa7-6b1ca5e30f0a): created successfully Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9faf802b-f6aa-45ad-8374-c88364b372c1 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89f6360d-0454-415b-953b-a2d122e177b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9faf802b-f6aa-45ad-8374-c88364b372c1 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Flow 'volume_create_manager' (2ea02ad9-6df4-4f09-9935-a535a42bd38a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:59:06 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-9faf802b-f6aa-45ad-8374-c88364b372c1 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Created volume successfully. Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-08c85a7a-15cb-4450-8a39-a92e84a7b337 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-08c85a7a-15cb-4450-8a39-a92e84a7b337 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Flow 'volume_create_manager' (cca1cca9-eb5e-4496-bf07-5af6db27842e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-08c85a7a-15cb-4450-8a39-a92e84a7b337 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e131d8ec-0398-42d7-8f2f-bb77fc7bbf5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-08c85a7a-15cb-4450-8a39-a92e84a7b337 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e131d8ec-0398-42d7-8f2f-bb77fc7bbf5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-887643659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f1e05c0-ac72-4f26-a073-6626b3fdd4ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e12982d8c97b476d9864cd6cc4ee5314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:59:06Z,use_quota=True,user_id='49c6a3a9642949448f855764c4c4b885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-08c85a7a-15cb-4450-8a39-a92e84a7b337 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36407fc9-c93f-479e-85ba-18fdbf9eb7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-08c85a7a-15cb-4450-8a39-a92e84a7b337 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36407fc9-c93f-479e-85ba-18fdbf9eb7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-08c85a7a-15cb-4450-8a39-a92e84a7b337 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaad2e7b-f491-4f2e-b462-646533352d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-08c85a7a-15cb-4450-8a39-a92e84a7b337 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaad2e7b-f491-4f2e-b462-646533352d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f1e05c0-ac72-4f26-a073-6626b3fdd4ca', 'volume_name': 'volume-5f1e05c0-ac72-4f26-a073-6626b3fdd4ca', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-08c85a7a-15cb-4450-8a39-a92e84a7b337 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0f6961-6b28-4c85-a377-fd6326a28def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-08c85a7a-15cb-4450-8a39-a92e84a7b337 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0f6961-6b28-4c85-a377-fd6326a28def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-08c85a7a-15cb-4450-8a39-a92e84a7b337 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90e03fb9-e3ab-467f-a378-eddead442ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:06 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-08c85a7a-15cb-4450-8a39-a92e84a7b337 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Volume 5f1e05c0-ac72-4f26-a073-6626b3fdd4ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f1e05c0-ac72-4f26-a073-6626b3fdd4ca', 'volume_size': 1} Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-08c85a7a-15cb-4450-8a39-a92e84a7b337 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:06 devstack sudo[103195]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a3c9e962-0baf-4b91-8741-c7c999f312ac tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3f179909-4c52-4d6d-abae-1ae58b86a341 1073741824" returned: 0 in 0.687s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a3c9e962-0baf-4b91-8741-c7c999f312ac tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3f179909-4c52-4d6d-abae-1ae58b86a341 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd748c26-abba-40c7-bfd3-3f77f87ebd14 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:59:06 devstack sudo[103201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3f179909-4c52-4d6d-abae-1ae58b86a341 Aug 10 12:59:06 devstack sudo[103201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-fd748c26-abba-40c7-bfd3-3f77f87ebd14 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Flow 'volume_create_manager' (0fa4e3ee-d1e1-4e13-821b-9a8bdc2f1595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-fd748c26-abba-40c7-bfd3-3f77f87ebd14 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (968fc319-cec3-4544-a1ca-c3c714f3d1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-fd748c26-abba-40c7-bfd3-3f77f87ebd14 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (968fc319-cec3-4544-a1ca-c3c714f3d1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-501139509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8932515a-4ad2-4d92-9721-1497fe680110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e12982d8c97b476d9864cd6cc4ee5314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:59:07Z,use_quota=True,user_id='49c6a3a9642949448f855764c4c4b885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-fd748c26-abba-40c7-bfd3-3f77f87ebd14 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b0cebaf-7448-4a4a-881e-4c2e51680e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-fd748c26-abba-40c7-bfd3-3f77f87ebd14 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b0cebaf-7448-4a4a-881e-4c2e51680e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-fd748c26-abba-40c7-bfd3-3f77f87ebd14 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c58f8683-0299-48da-8d17-5cab16d4aea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-fd748c26-abba-40c7-bfd3-3f77f87ebd14 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c58f8683-0299-48da-8d17-5cab16d4aea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8932515a-4ad2-4d92-9721-1497fe680110', 'volume_name': 'volume-8932515a-4ad2-4d92-9721-1497fe680110', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-fd748c26-abba-40c7-bfd3-3f77f87ebd14 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3bb9551-12e8-46dc-8ee3-023836eb0ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-fd748c26-abba-40c7-bfd3-3f77f87ebd14 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3bb9551-12e8-46dc-8ee3-023836eb0ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-fd748c26-abba-40c7-bfd3-3f77f87ebd14 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa821db3-306d-4f27-af3d-ee38bc91ab02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:06 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-fd748c26-abba-40c7-bfd3-3f77f87ebd14 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Volume 8932515a-4ad2-4d92-9721-1497fe680110: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8932515a-4ad2-4d92-9721-1497fe680110', 'volume_size': 1} Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-fd748c26-abba-40c7-bfd3-3f77f87ebd14 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:06 devstack sudo[103201]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a3c9e962-0baf-4b91-8741-c7c999f312ac tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3f179909-4c52-4d6d-abae-1ae58b86a341" returned: 0 in 0.335s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a3c9e962-0baf-4b91-8741-c7c999f312ac tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a3c9e962-0baf-4b91-8741-c7c999f312ac tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8ba8b1ef-3bf8-46e2-a142-026d74fc91d5 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.120s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8ba8b1ef-3bf8-46e2-a142-026d74fc91d5 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1901480976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82598b61-054b-4892-bcad-6fe063c66948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e12982d8c97b476d9864cd6cc4ee5314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:59:06Z,use_quota=True,user_id='49c6a3a9642949448f855764c4c4b885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-8ba8b1ef-3bf8-46e2-a142-026d74fc91d5 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Creating volume 82598b61-054b-4892-bcad-6fe063c66948 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8ba8b1ef-3bf8-46e2-a142-026d74fc91d5 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8ba8b1ef-3bf8-46e2-a142-026d74fc91d5 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8ba8b1ef-3bf8-46e2-a142-026d74fc91d5 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8ba8b1ef-3bf8-46e2-a142-026d74fc91d5 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8ba8b1ef-3bf8-46e2-a142-026d74fc91d5 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8ba8b1ef-3bf8-46e2-a142-026d74fc91d5 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:59:06 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-8ba8b1ef-3bf8-46e2-a142-026d74fc91d5 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8ba8b1ef-3bf8-46e2-a142-026d74fc91d5 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-82598b61-054b-4892-bcad-6fe063c66948 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a3c9e962-0baf-4b91-8741-c7c999f312ac tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2749ac79-17d0-4144-a5ad-9c515a4f70c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f179909-4c52-4d6d-abae-1ae58b86a341', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a3c9e962-0baf-4b91-8741-c7c999f312ac tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (350d121a-fd68-4ebc-bc2e-3401441d7054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:06 devstack sudo[103204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-82598b61-054b-4892-bcad-6fe063c66948 1073741824 Aug 10 12:59:06 devstack sudo[103204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:07 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-a3c9e962-0baf-4b91-8741-c7c999f312ac tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Volume volume-3f179909-4c52-4d6d-abae-1ae58b86a341 (3f179909-4c52-4d6d-abae-1ae58b86a341): created successfully Aug 10 12:59:07 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a3c9e962-0baf-4b91-8741-c7c999f312ac tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (350d121a-fd68-4ebc-bc2e-3401441d7054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:07 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a3c9e962-0baf-4b91-8741-c7c999f312ac tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Flow 'volume_create_manager' (9b47597e-5998-43e7-9240-2936820de15b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:59:07 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-a3c9e962-0baf-4b91-8741-c7c999f312ac tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Created volume successfully. Aug 10 12:59:07 devstack sudo[103204]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8ba8b1ef-3bf8-46e2-a142-026d74fc91d5 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-82598b61-054b-4892-bcad-6fe063c66948 1073741824" returned: 0 in 0.638s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8ba8b1ef-3bf8-46e2-a142-026d74fc91d5 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-82598b61-054b-4892-bcad-6fe063c66948 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:07 devstack sudo[103210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-82598b61-054b-4892-bcad-6fe063c66948 Aug 10 12:59:07 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:07 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8ba8b1ef-3bf8-46e2-a142-026d74fc91d5 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-82598b61-054b-4892-bcad-6fe063c66948" returned: 0 in 0.290s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:07 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8ba8b1ef-3bf8-46e2-a142-026d74fc91d5 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:59:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8ba8b1ef-3bf8-46e2-a142-026d74fc91d5 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-08c85a7a-15cb-4450-8a39-a92e84a7b337 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.618s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:07 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-08c85a7a-15cb-4450-8a39-a92e84a7b337 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-887643659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f1e05c0-ac72-4f26-a073-6626b3fdd4ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e12982d8c97b476d9864cd6cc4ee5314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:59:06Z,use_quota=True,user_id='49c6a3a9642949448f855764c4c4b885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:59:07 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-08c85a7a-15cb-4450-8a39-a92e84a7b337 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Creating volume 5f1e05c0-ac72-4f26-a073-6626b3fdd4ca {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:59:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-08c85a7a-15cb-4450-8a39-a92e84a7b337 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-08c85a7a-15cb-4450-8a39-a92e84a7b337 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:07 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-08c85a7a-15cb-4450-8a39-a92e84a7b337 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:59:07 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-08c85a7a-15cb-4450-8a39-a92e84a7b337 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:59:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-08c85a7a-15cb-4450-8a39-a92e84a7b337 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:07 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-08c85a7a-15cb-4450-8a39-a92e84a7b337 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:59:07 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-08c85a7a-15cb-4450-8a39-a92e84a7b337 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:59:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-08c85a7a-15cb-4450-8a39-a92e84a7b337 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5f1e05c0-ac72-4f26-a073-6626b3fdd4ca 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:07 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8ba8b1ef-3bf8-46e2-a142-026d74fc91d5 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ac8255-571b-4cae-84dc-4e1d079170fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82598b61-054b-4892-bcad-6fe063c66948', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:07 devstack sudo[103213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5f1e05c0-ac72-4f26-a073-6626b3fdd4ca 1073741824 Aug 10 12:59:07 devstack sudo[103213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:07 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8ba8b1ef-3bf8-46e2-a142-026d74fc91d5 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5434f2e0-2825-48f4-895a-a3d23ffb5ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:08 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-8ba8b1ef-3bf8-46e2-a142-026d74fc91d5 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Volume volume-82598b61-054b-4892-bcad-6fe063c66948 (82598b61-054b-4892-bcad-6fe063c66948): created successfully Aug 10 12:59:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8ba8b1ef-3bf8-46e2-a142-026d74fc91d5 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5434f2e0-2825-48f4-895a-a3d23ffb5ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8ba8b1ef-3bf8-46e2-a142-026d74fc91d5 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Flow 'volume_create_manager' (3547346e-4643-4491-a3ad-7f493936a039) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:59:08 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-8ba8b1ef-3bf8-46e2-a142-026d74fc91d5 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Created volume successfully. Aug 10 12:59:08 devstack sudo[103213]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-08c85a7a-15cb-4450-8a39-a92e84a7b337 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5f1e05c0-ac72-4f26-a073-6626b3fdd4ca 1073741824" returned: 0 in 0.625s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-08c85a7a-15cb-4450-8a39-a92e84a7b337 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5f1e05c0-ac72-4f26-a073-6626b3fdd4ca {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:08 devstack sudo[103239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5f1e05c0-ac72-4f26-a073-6626b3fdd4ca Aug 10 12:59:08 devstack sudo[103239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:08 devstack sudo[103239]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-08c85a7a-15cb-4450-8a39-a92e84a7b337 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5f1e05c0-ac72-4f26-a073-6626b3fdd4ca" returned: 0 in 0.277s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-08c85a7a-15cb-4450-8a39-a92e84a7b337 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:59:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-08c85a7a-15cb-4450-8a39-a92e84a7b337 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-fd748c26-abba-40c7-bfd3-3f77f87ebd14 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.147s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-fd748c26-abba-40c7-bfd3-3f77f87ebd14 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-501139509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8932515a-4ad2-4d92-9721-1497fe680110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e12982d8c97b476d9864cd6cc4ee5314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:59:07Z,use_quota=True,user_id='49c6a3a9642949448f855764c4c4b885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:59:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-fd748c26-abba-40c7-bfd3-3f77f87ebd14 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Creating volume 8932515a-4ad2-4d92-9721-1497fe680110 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:59:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-fd748c26-abba-40c7-bfd3-3f77f87ebd14 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-fd748c26-abba-40c7-bfd3-3f77f87ebd14 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-fd748c26-abba-40c7-bfd3-3f77f87ebd14 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:59:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-fd748c26-abba-40c7-bfd3-3f77f87ebd14 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:59:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-fd748c26-abba-40c7-bfd3-3f77f87ebd14 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-fd748c26-abba-40c7-bfd3-3f77f87ebd14 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:59:08 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-fd748c26-abba-40c7-bfd3-3f77f87ebd14 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:59:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fd748c26-abba-40c7-bfd3-3f77f87ebd14 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8932515a-4ad2-4d92-9721-1497fe680110 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-08c85a7a-15cb-4450-8a39-a92e84a7b337 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90e03fb9-e3ab-467f-a378-eddead442ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f1e05c0-ac72-4f26-a073-6626b3fdd4ca', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-08c85a7a-15cb-4450-8a39-a92e84a7b337 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9010ff1d-0f3b-4045-a034-ad809761a47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:08 devstack sudo[103242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8932515a-4ad2-4d92-9721-1497fe680110 1073741824 Aug 10 12:59:08 devstack sudo[103242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:08 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-08c85a7a-15cb-4450-8a39-a92e84a7b337 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Volume volume-5f1e05c0-ac72-4f26-a073-6626b3fdd4ca (5f1e05c0-ac72-4f26-a073-6626b3fdd4ca): created successfully Aug 10 12:59:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-08c85a7a-15cb-4450-8a39-a92e84a7b337 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9010ff1d-0f3b-4045-a034-ad809761a47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-08c85a7a-15cb-4450-8a39-a92e84a7b337 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Flow 'volume_create_manager' (cca1cca9-eb5e-4496-bf07-5af6db27842e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:59:08 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-08c85a7a-15cb-4450-8a39-a92e84a7b337 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Created volume successfully. Aug 10 12:59:09 devstack sudo[103242]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fd748c26-abba-40c7-bfd3-3f77f87ebd14 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8932515a-4ad2-4d92-9721-1497fe680110 1073741824" returned: 0 in 0.414s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fd748c26-abba-40c7-bfd3-3f77f87ebd14 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8932515a-4ad2-4d92-9721-1497fe680110 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:09 devstack sudo[103247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8932515a-4ad2-4d92-9721-1497fe680110 Aug 10 12:59:09 devstack sudo[103247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:09 devstack sudo[103247]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fd748c26-abba-40c7-bfd3-3f77f87ebd14 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8932515a-4ad2-4d92-9721-1497fe680110" returned: 0 in 0.243s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-fd748c26-abba-40c7-bfd3-3f77f87ebd14 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:59:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-fd748c26-abba-40c7-bfd3-3f77f87ebd14 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-fd748c26-abba-40c7-bfd3-3f77f87ebd14 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa821db3-306d-4f27-af3d-ee38bc91ab02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8932515a-4ad2-4d92-9721-1497fe680110', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-fd748c26-abba-40c7-bfd3-3f77f87ebd14 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cf49b83-0c85-4ab8-816e-67ca6ccfb128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:09 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-fd748c26-abba-40c7-bfd3-3f77f87ebd14 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Volume volume-8932515a-4ad2-4d92-9721-1497fe680110 (8932515a-4ad2-4d92-9721-1497fe680110): created successfully Aug 10 12:59:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-fd748c26-abba-40c7-bfd3-3f77f87ebd14 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cf49b83-0c85-4ab8-816e-67ca6ccfb128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-fd748c26-abba-40c7-bfd3-3f77f87ebd14 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Flow 'volume_create_manager' (0fa4e3ee-d1e1-4e13-821b-9a8bdc2f1595) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:59:09 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-fd748c26-abba-40c7-bfd3-3f77f87ebd14 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Created volume successfully. Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d4c8cb4c-683e-4710-bc9e-ebf085cb11a0 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Acquiring lock "cinder-8932515a-4ad2-4d92-9721-1497fe680110-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d4c8cb4c-683e-4710-bc9e-ebf085cb11a0 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "cinder-8932515a-4ad2-4d92-9721-1497fe680110-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d4c8cb4c-683e-4710-bc9e-ebf085cb11a0 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Acquiring lock "cinder-quobyte-8932515a-4ad2-4d92-9721-1497fe680110" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d4c8cb4c-683e-4710-bc9e-ebf085cb11a0 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "cinder-quobyte-8932515a-4ad2-4d92-9721-1497fe680110" acquired by "delete_volume" :: waited 0.027s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c5b92f-6f91-456b-96bc-0ff461ea48a0]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d4c8cb4c-683e-4710-bc9e-ebf085cb11a0 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8932515a-4ad2-4d92-9721-1497fe680110 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Flow 'volume_create_manager' (aa3b43fa-d902-431f-bfff-92352a199acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec3f0cdf-b621-4f59-a6d3-88b611dcc60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec3f0cdf-b621-4f59-a6d3-88b611dcc60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1480112546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b14e86d-5868-485c-bb11-4487eb77ebf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99f932b332c24313baf50ff92b837d78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=17c77a8c-61b2-43bf-b709-6ef0e076f747,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:59:10Z,use_quota=True,user_id='da9d7d3a1db546afbc7a4542fa9b13b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1faed836-9756-4f79-b07d-c17a93f09059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1faed836-9756-4f79-b07d-c17a93f09059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b5b7459-372b-4e38-97b0-e61c0ec4e46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b5b7459-372b-4e38-97b0-e61c0ec4e46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2b14e86d-5868-485c-bb11-4487eb77ebf3', 'volume_name': 'volume-2b14e86d-5868-485c-bb11-4487eb77ebf3', 'volume_size': 1, 'snapshot_id': '17c77a8c-61b2-43bf-b709-6ef0e076f747'}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb3d6584-136f-4f96-b611-aa4464080b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb3d6584-136f-4f96-b611-aa4464080b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (771cf74e-5a3a-4e78-8443-8728b3aece48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:10 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Volume 2b14e86d-5868-485c-bb11-4487eb77ebf3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2b14e86d-5868-485c-bb11-4487eb77ebf3', 'volume_size': 1, 'snapshot_id': '17c77a8c-61b2-43bf-b709-6ef0e076f747'} Aug 10 12:59:10 devstack sudo[103250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8932515a-4ad2-4d92-9721-1497fe680110 Aug 10 12:59:10 devstack sudo[103250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Acquiring lock "cinder-quobyte-17c77a8c-61b2-43bf-b709-6ef0e076f747-2b14e86d-5868-485c-bb11-4487eb77ebf3" by "_create_volume_from_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Lock "cinder-quobyte-17c77a8c-61b2-43bf-b709-6ef0e076f747-2b14e86d-5868-485c-bb11-4487eb77ebf3" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Creating volume 2b14e86d-5868-485c-bb11-4487eb77ebf3 from snapshot 17c77a8c-61b2-43bf-b709-6ef0e076f747 {{(pid=89096) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Acquiring lock "cinder-quobyte-2b14e86d-5868-485c-bb11-4487eb77ebf3" by "_copy_volume_from_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Lock "cinder-quobyte-2b14e86d-5868-485c-bb11-4487eb77ebf3" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] snapshot: 17c77a8c-61b2-43bf-b709-6ef0e076f747, volume: 2b14e86d-5868-485c-bb11-4487eb77ebf3, {{(pid=89096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec34635-33ed-497a-9959-16da874678c2]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63.17c77a8c-61b2-43bf-b709-6ef0e076f747 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:10 devstack sudo[103252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63.17c77a8c-61b2-43bf-b709-6ef0e076f747 Aug 10 12:59:10 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:10 devstack sudo[103250]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d4c8cb4c-683e-4710-bc9e-ebf085cb11a0 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8932515a-4ad2-4d92-9721-1497fe680110" returned: 0 in 0.429s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d4c8cb4c-683e-4710-bc9e-ebf085cb11a0 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8932515a-4ad2-4d92-9721-1497fe680110 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:10 devstack sudo[103257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8932515a-4ad2-4d92-9721-1497fe680110 Aug 10 12:59:10 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:10 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d4c8cb4c-683e-4710-bc9e-ebf085cb11a0 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8932515a-4ad2-4d92-9721-1497fe680110" returned: 0 in 0.297s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:10 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d4c8cb4c-683e-4710-bc9e-ebf085cb11a0 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "cinder-quobyte-8932515a-4ad2-4d92-9721-1497fe680110" released by "delete_volume" :: held 0.781s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63.17c77a8c-61b2-43bf-b709-6ef0e076f747" returned: 0 in 0.458s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 12:59:10 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c40916-3853-4e9c-9037-37d38d8eef9d]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:59:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:11 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-d4c8cb4c-683e-4710-bc9e-ebf085cb11a0 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Created reservations ['3ad905f1-60c4-4db7-b9da-5a8675003caa', '3b81f1b4-037b-4975-896e-638b986510e1', 'c1b9da9f-242e-4768-a0a9-de8755e0d4f8', '24503621-59dc-4c74-96a8-6bbe9b60fcf4'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:59:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d4c8cb4c-683e-4710-bc9e-ebf085cb11a0 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d4c8cb4c-683e-4710-bc9e-ebf085cb11a0 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:11 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-d4c8cb4c-683e-4710-bc9e-ebf085cb11a0 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:59:11 devstack sudo[103267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63 Aug 10 12:59:11 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-d4c8cb4c-683e-4710-bc9e-ebf085cb11a0 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:59:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d4c8cb4c-683e-4710-bc9e-ebf085cb11a0 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d4c8cb4c-683e-4710-bc9e-ebf085cb11a0 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:11 devstack sudo[103267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:11 devstack sudo[103273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:59:11 devstack sudo[103273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:11 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a6723e57-9f71-41c5-b404-473c6fe48714 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Acquiring lock "cinder-5f1e05c0-ac72-4f26-a073-6626b3fdd4ca-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:59:11 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a6723e57-9f71-41c5-b404-473c6fe48714 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "cinder-5f1e05c0-ac72-4f26-a073-6626b3fdd4ca-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:59:11 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a6723e57-9f71-41c5-b404-473c6fe48714 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Acquiring lock "cinder-quobyte-5f1e05c0-ac72-4f26-a073-6626b3fdd4ca" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:59:11 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a6723e57-9f71-41c5-b404-473c6fe48714 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "cinder-quobyte-5f1e05c0-ac72-4f26-a073-6626b3fdd4ca" acquired by "delete_volume" :: waited 0.031s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:59:11 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[05202d4c-d9b8-490e-bd0c-cd66092e13c3]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:59:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a6723e57-9f71-41c5-b404-473c6fe48714 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5f1e05c0-ac72-4f26-a073-6626b3fdd4ca {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:11 devstack sudo[103267]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63" returned: 0 in 0.596s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:11 devstack sudo[103273]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:11 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63 {{(pid=89096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 10 12:59:11 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Creating direct copy from snapshot {{(pid=89096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 10 12:59:11 devstack cinder-volume[89096]: DEBUG cinder.utils [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Path /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2b14e86d-5868-485c-bb11-4487eb77ebf3 not found in is_blk_device check {{(pid=89096) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 10 12:59:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2b14e86d-5868-485c-bb11-4487eb77ebf3 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d4c8cb4c-683e-4710-bc9e-ebf085cb11a0 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.472s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:11 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-d4c8cb4c-683e-4710-bc9e-ebf085cb11a0 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:59:11 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-d4c8cb4c-683e-4710-bc9e-ebf085cb11a0 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Deleted volume successfully. Aug 10 12:59:11 devstack sudo[103288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2b14e86d-5868-485c-bb11-4487eb77ebf3 Aug 10 12:59:11 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:11 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d4c8cb4c-683e-4710-bc9e-ebf085cb11a0 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "cinder-8932515a-4ad2-4d92-9721-1497fe680110-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:59:11 devstack sudo[103287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5f1e05c0-ac72-4f26-a073-6626b3fdd4ca Aug 10 12:59:11 devstack sudo[103287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:12 devstack sudo[103287]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a6723e57-9f71-41c5-b404-473c6fe48714 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5f1e05c0-ac72-4f26-a073-6626b3fdd4ca" returned: 0 in 0.476s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a6723e57-9f71-41c5-b404-473c6fe48714 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5f1e05c0-ac72-4f26-a073-6626b3fdd4ca {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:12 devstack sudo[103301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5f1e05c0-ac72-4f26-a073-6626b3fdd4ca Aug 10 12:59:12 devstack sudo[103301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:12 devstack sudo[103301]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a6723e57-9f71-41c5-b404-473c6fe48714 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5f1e05c0-ac72-4f26-a073-6626b3fdd4ca" returned: 0 in 0.408s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:12 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a6723e57-9f71-41c5-b404-473c6fe48714 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "cinder-quobyte-5f1e05c0-ac72-4f26-a073-6626b3fdd4ca" released by "delete_volume" :: held 0.961s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:59:12 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-a6723e57-9f71-41c5-b404-473c6fe48714 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Created reservations ['938b5c22-5338-42f9-9829-4aad989fdb23', '37f94922-a90f-45d1-8a68-386975d87834', '8f6cd4e4-ca79-4670-a1ed-65bea3d607ee', 'df2f801a-3fec-4eb2-9ea0-07fe1bd65f4c'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:59:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a6723e57-9f71-41c5-b404-473c6fe48714 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a6723e57-9f71-41c5-b404-473c6fe48714 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:12 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a6723e57-9f71-41c5-b404-473c6fe48714 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:59:12 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a6723e57-9f71-41c5-b404-473c6fe48714 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:59:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a6723e57-9f71-41c5-b404-473c6fe48714 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a6723e57-9f71-41c5-b404-473c6fe48714 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:12 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:59:12 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:13 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a6723e57-9f71-41c5-b404-473c6fe48714 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.491s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:13 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-a6723e57-9f71-41c5-b404-473c6fe48714 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:59:13 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-a6723e57-9f71-41c5-b404-473c6fe48714 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Deleted volume successfully. Aug 10 12:59:13 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a6723e57-9f71-41c5-b404-473c6fe48714 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "cinder-5f1e05c0-ac72-4f26-a073-6626b3fdd4ca-delete_volume" released by "delete_volume" :: held 2.089s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:59:14 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f7604bad-9ba7-44c3-98ec-cb8a7584ae2d tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Acquiring lock "cinder-82598b61-054b-4892-bcad-6fe063c66948-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:59:14 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f7604bad-9ba7-44c3-98ec-cb8a7584ae2d tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "cinder-82598b61-054b-4892-bcad-6fe063c66948-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:59:14 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f7604bad-9ba7-44c3-98ec-cb8a7584ae2d tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Acquiring lock "cinder-quobyte-82598b61-054b-4892-bcad-6fe063c66948" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:59:14 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f7604bad-9ba7-44c3-98ec-cb8a7584ae2d tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "cinder-quobyte-82598b61-054b-4892-bcad-6fe063c66948" acquired by "delete_volume" :: waited 0.049s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:59:14 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfc539d-bdd2-423a-9f37-6b38a4ef09bb]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:59:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f7604bad-9ba7-44c3-98ec-cb8a7584ae2d tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-82598b61-054b-4892-bcad-6fe063c66948 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:14 devstack sudo[103313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-82598b61-054b-4892-bcad-6fe063c66948 Aug 10 12:59:14 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:15 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f7604bad-9ba7-44c3-98ec-cb8a7584ae2d tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-82598b61-054b-4892-bcad-6fe063c66948" returned: 0 in 1.374s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f7604bad-9ba7-44c3-98ec-cb8a7584ae2d tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-82598b61-054b-4892-bcad-6fe063c66948 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:15 devstack sudo[103318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-82598b61-054b-4892-bcad-6fe063c66948 Aug 10 12:59:15 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:16 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f7604bad-9ba7-44c3-98ec-cb8a7584ae2d tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-82598b61-054b-4892-bcad-6fe063c66948" returned: 0 in 0.763s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:16 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f7604bad-9ba7-44c3-98ec-cb8a7584ae2d tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "cinder-quobyte-82598b61-054b-4892-bcad-6fe063c66948" released by "delete_volume" :: held 2.304s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:59:16 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-f7604bad-9ba7-44c3-98ec-cb8a7584ae2d tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Created reservations ['02b60baf-5b5f-49bd-b193-2a00aa437a08', 'd8d124ba-2591-4c55-82d1-286836b34e69', '19d56508-9351-47cf-865d-0b7689da3144', '762a8963-3290-47c6-bb78-f92adc395859'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:59:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f7604bad-9ba7-44c3-98ec-cb8a7584ae2d tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f7604bad-9ba7-44c3-98ec-cb8a7584ae2d tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:16 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f7604bad-9ba7-44c3-98ec-cb8a7584ae2d tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:59:17 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f7604bad-9ba7-44c3-98ec-cb8a7584ae2d tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:59:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f7604bad-9ba7-44c3-98ec-cb8a7584ae2d tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f7604bad-9ba7-44c3-98ec-cb8a7584ae2d tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:17 devstack sudo[103322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:59:17 devstack sudo[103322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:17 devstack sudo[103322]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f7604bad-9ba7-44c3-98ec-cb8a7584ae2d tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.901s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:17 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-f7604bad-9ba7-44c3-98ec-cb8a7584ae2d tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:59:17 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-f7604bad-9ba7-44c3-98ec-cb8a7584ae2d tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Deleted volume successfully. Aug 10 12:59:18 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f7604bad-9ba7-44c3-98ec-cb8a7584ae2d tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "cinder-82598b61-054b-4892-bcad-6fe063c66948-delete_volume" released by "delete_volume" :: held 3.928s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:59:18 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-cda2e15a-4e6a-4fe4-a1b4-c1f9b68aca0c tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Acquiring lock "cinder-3f179909-4c52-4d6d-abae-1ae58b86a341-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:59:18 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-cda2e15a-4e6a-4fe4-a1b4-c1f9b68aca0c tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "cinder-3f179909-4c52-4d6d-abae-1ae58b86a341-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:59:18 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-cda2e15a-4e6a-4fe4-a1b4-c1f9b68aca0c tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Acquiring lock "cinder-quobyte-3f179909-4c52-4d6d-abae-1ae58b86a341" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:59:18 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-cda2e15a-4e6a-4fe4-a1b4-c1f9b68aca0c tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "cinder-quobyte-3f179909-4c52-4d6d-abae-1ae58b86a341" acquired by "delete_volume" :: waited 0.032s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:59:18 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[3400183a-9df0-4c63-a10a-681656af0d93]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:59:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-cda2e15a-4e6a-4fe4-a1b4-c1f9b68aca0c tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3f179909-4c52-4d6d-abae-1ae58b86a341 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:18 devstack sudo[103326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3f179909-4c52-4d6d-abae-1ae58b86a341 Aug 10 12:59:18 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2b14e86d-5868-485c-bb11-4487eb77ebf3" returned: 0 in 7.426s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:19 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Image conversion details: src /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63, size 1024.00 MB, duration 7.43 sec, destination /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2b14e86d-5868-485c-bb11-4487eb77ebf3 {{(pid=89096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 12:59:19 devstack cinder-volume[89096]: INFO cinder.image.image_utils [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Converted 1024.00 MB image at 137.84 MB/s Aug 10 12:59:19 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2b14e86d-5868-485c-bb11-4487eb77ebf3 is being set with open permissions: ugo+rw Aug 10 12:59:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2b14e86d-5868-485c-bb11-4487eb77ebf3 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:19 devstack sudo[103329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2b14e86d-5868-485c-bb11-4487eb77ebf3 Aug 10 12:59:19 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:19 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-cda2e15a-4e6a-4fe4-a1b4-c1f9b68aca0c tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3f179909-4c52-4d6d-abae-1ae58b86a341" returned: 0 in 0.765s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-cda2e15a-4e6a-4fe4-a1b4-c1f9b68aca0c tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3f179909-4c52-4d6d-abae-1ae58b86a341 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:19 devstack sudo[103344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3f179909-4c52-4d6d-abae-1ae58b86a341 Aug 10 12:59:19 devstack sudo[103344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:19 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2b14e86d-5868-485c-bb11-4487eb77ebf3" returned: 0 in 0.446s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:19 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Lock "cinder-quobyte-2b14e86d-5868-485c-bb11-4487eb77ebf3" released by "_copy_volume_from_snapshot" :: held 9.099s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:59:19 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Lock "cinder-quobyte-17c77a8c-61b2-43bf-b709-6ef0e076f747-2b14e86d-5868-485c-bb11-4487eb77ebf3" released by "_create_volume_from_snapshot" :: held 9.261s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:59:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.277s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:19 devstack sudo[103344]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-cda2e15a-4e6a-4fe4-a1b4-c1f9b68aca0c tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3f179909-4c52-4d6d-abae-1ae58b86a341" returned: 0 in 0.372s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:19 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-cda2e15a-4e6a-4fe4-a1b4-c1f9b68aca0c tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "cinder-quobyte-3f179909-4c52-4d6d-abae-1ae58b86a341" released by "delete_volume" :: held 1.267s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:59:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (771cf74e-5a3a-4e78-8443-8728b3aece48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b14e86d-5868-485c-bb11-4487eb77ebf3', 'volume_size': 1, 'snapshot_id': '17c77a8c-61b2-43bf-b709-6ef0e076f747'}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08dba1f3-563b-47f8-8c26-bb40b2eb3d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:19 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Volume volume-2b14e86d-5868-485c-bb11-4487eb77ebf3 (2b14e86d-5868-485c-bb11-4487eb77ebf3): created successfully Aug 10 12:59:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08dba1f3-563b-47f8-8c26-bb40b2eb3d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Flow 'volume_create_manager' (aa3b43fa-d902-431f-bfff-92352a199acf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:59:19 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-8171ef5e-eed9-464a-88a3-4802a267620a tempest-TestStampPattern-1500701631 None] Created volume successfully. Aug 10 12:59:19 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-cda2e15a-4e6a-4fe4-a1b4-c1f9b68aca0c tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Created reservations ['577c80a8-726b-4ca1-b069-9e97efd00a2d', 'acae8a8c-fe16-4c88-9911-8913b0b848c4', '41ef2aab-ef03-4284-9af4-6385cd62b2c1', 'a9a7d6ad-a31d-4cfb-93e6-99cc39bce143'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:59:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-cda2e15a-4e6a-4fe4-a1b4-c1f9b68aca0c tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-cda2e15a-4e6a-4fe4-a1b4-c1f9b68aca0c tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:19 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-cda2e15a-4e6a-4fe4-a1b4-c1f9b68aca0c tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:59:20 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-cda2e15a-4e6a-4fe4-a1b4-c1f9b68aca0c tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:59:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-cda2e15a-4e6a-4fe4-a1b4-c1f9b68aca0c tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-cda2e15a-4e6a-4fe4-a1b4-c1f9b68aca0c tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:20 devstack sudo[103361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:59:20 devstack sudo[103361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:20 devstack sudo[103361]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-cda2e15a-4e6a-4fe4-a1b4-c1f9b68aca0c tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.326s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:20 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-cda2e15a-4e6a-4fe4-a1b4-c1f9b68aca0c tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:59:20 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-cda2e15a-4e6a-4fe4-a1b4-c1f9b68aca0c tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Deleted volume successfully. Aug 10 12:59:20 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-cda2e15a-4e6a-4fe4-a1b4-c1f9b68aca0c tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "cinder-3f179909-4c52-4d6d-abae-1ae58b86a341-delete_volume" released by "delete_volume" :: held 2.147s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:59:20 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4d0c7640-2048-49f9-8258-61ec95848265 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Acquiring lock "cinder-7aac351b-bb18-4e33-baa7-6b1ca5e30f0a-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:59:20 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4d0c7640-2048-49f9-8258-61ec95848265 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "cinder-7aac351b-bb18-4e33-baa7-6b1ca5e30f0a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:59:20 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4d0c7640-2048-49f9-8258-61ec95848265 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Acquiring lock "cinder-quobyte-7aac351b-bb18-4e33-baa7-6b1ca5e30f0a" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:59:21 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4d0c7640-2048-49f9-8258-61ec95848265 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "cinder-quobyte-7aac351b-bb18-4e33-baa7-6b1ca5e30f0a" acquired by "delete_volume" :: waited 0.028s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:59:21 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[e422fc0f-8c4f-4780-8fad-598a958e068b]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:59:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4d0c7640-2048-49f9-8258-61ec95848265 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-7aac351b-bb18-4e33-baa7-6b1ca5e30f0a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:21 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-0102b5a5-a305-444b-a4c8-d5427e4ae4db tempest-AttachVolumeTestJSON-1943572718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:59:21 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0102b5a5-a305-444b-a4c8-d5427e4ae4db tempest-AttachVolumeTestJSON-1943572718 None] Flow 'volume_create_manager' (a5209f1d-bea4-49ba-8caf-86cd6804ea67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:59:21 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0102b5a5-a305-444b-a4c8-d5427e4ae4db tempest-AttachVolumeTestJSON-1943572718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (488528b9-8932-4e1d-a1a3-f27704547be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:21 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0102b5a5-a305-444b-a4c8-d5427e4ae4db tempest-AttachVolumeTestJSON-1943572718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (488528b9-8932-4e1d-a1a3-f27704547be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-199826304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f2a4ae0-7d9b-423b-8a3e-300aa489c360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a8e103ceb5044aea1b673e75b32dfca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:59:21Z,use_quota=True,user_id='44bddbf9f3844c73a155b04f9820ebb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:21 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0102b5a5-a305-444b-a4c8-d5427e4ae4db tempest-AttachVolumeTestJSON-1943572718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a4d219a-b03f-4282-94b3-e6b544fbbec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:21 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0102b5a5-a305-444b-a4c8-d5427e4ae4db tempest-AttachVolumeTestJSON-1943572718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a4d219a-b03f-4282-94b3-e6b544fbbec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:21 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0102b5a5-a305-444b-a4c8-d5427e4ae4db tempest-AttachVolumeTestJSON-1943572718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d135113f-544c-4f27-8186-9b6614edd884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:21 devstack sudo[103399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-7aac351b-bb18-4e33-baa7-6b1ca5e30f0a Aug 10 12:59:21 devstack sudo[103399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:21 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0102b5a5-a305-444b-a4c8-d5427e4ae4db tempest-AttachVolumeTestJSON-1943572718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d135113f-544c-4f27-8186-9b6614edd884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f2a4ae0-7d9b-423b-8a3e-300aa489c360', 'volume_name': 'volume-1f2a4ae0-7d9b-423b-8a3e-300aa489c360', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:21 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0102b5a5-a305-444b-a4c8-d5427e4ae4db tempest-AttachVolumeTestJSON-1943572718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f58933bc-91b0-4bbc-b740-da7c1db86870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:21 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0102b5a5-a305-444b-a4c8-d5427e4ae4db tempest-AttachVolumeTestJSON-1943572718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f58933bc-91b0-4bbc-b740-da7c1db86870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:21 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0102b5a5-a305-444b-a4c8-d5427e4ae4db tempest-AttachVolumeTestJSON-1943572718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45aacaf4-fc15-4eba-a690-1e75dc3eb246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:21 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-0102b5a5-a305-444b-a4c8-d5427e4ae4db tempest-AttachVolumeTestJSON-1943572718 None] Volume 1f2a4ae0-7d9b-423b-8a3e-300aa489c360: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f2a4ae0-7d9b-423b-8a3e-300aa489c360', 'volume_size': 1} Aug 10 12:59:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0102b5a5-a305-444b-a4c8-d5427e4ae4db tempest-AttachVolumeTestJSON-1943572718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0102b5a5-a305-444b-a4c8-d5427e4ae4db tempest-AttachVolumeTestJSON-1943572718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:21 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0102b5a5-a305-444b-a4c8-d5427e4ae4db tempest-AttachVolumeTestJSON-1943572718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-199826304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f2a4ae0-7d9b-423b-8a3e-300aa489c360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a8e103ceb5044aea1b673e75b32dfca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:59:21Z,use_quota=True,user_id='44bddbf9f3844c73a155b04f9820ebb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:59:21 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-0102b5a5-a305-444b-a4c8-d5427e4ae4db tempest-AttachVolumeTestJSON-1943572718 None] Creating volume 1f2a4ae0-7d9b-423b-8a3e-300aa489c360 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:59:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0102b5a5-a305-444b-a4c8-d5427e4ae4db tempest-AttachVolumeTestJSON-1943572718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0102b5a5-a305-444b-a4c8-d5427e4ae4db tempest-AttachVolumeTestJSON-1943572718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:21 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0102b5a5-a305-444b-a4c8-d5427e4ae4db tempest-AttachVolumeTestJSON-1943572718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:59:21 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0102b5a5-a305-444b-a4c8-d5427e4ae4db tempest-AttachVolumeTestJSON-1943572718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:59:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0102b5a5-a305-444b-a4c8-d5427e4ae4db tempest-AttachVolumeTestJSON-1943572718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:21 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0102b5a5-a305-444b-a4c8-d5427e4ae4db tempest-AttachVolumeTestJSON-1943572718 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:59:21 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-0102b5a5-a305-444b-a4c8-d5427e4ae4db tempest-AttachVolumeTestJSON-1943572718 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:59:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0102b5a5-a305-444b-a4c8-d5427e4ae4db tempest-AttachVolumeTestJSON-1943572718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1f2a4ae0-7d9b-423b-8a3e-300aa489c360 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:21 devstack sudo[103405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1f2a4ae0-7d9b-423b-8a3e-300aa489c360 1073741824 Aug 10 12:59:21 devstack sudo[103405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:21 devstack sudo[103399]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4d0c7640-2048-49f9-8258-61ec95848265 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-7aac351b-bb18-4e33-baa7-6b1ca5e30f0a" returned: 0 in 0.608s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4d0c7640-2048-49f9-8258-61ec95848265 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-7aac351b-bb18-4e33-baa7-6b1ca5e30f0a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:21 devstack sudo[103423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-7aac351b-bb18-4e33-baa7-6b1ca5e30f0a Aug 10 12:59:21 devstack sudo[103423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:21 devstack sudo[103405]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0102b5a5-a305-444b-a4c8-d5427e4ae4db tempest-AttachVolumeTestJSON-1943572718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1f2a4ae0-7d9b-423b-8a3e-300aa489c360 1073741824" returned: 0 in 0.555s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0102b5a5-a305-444b-a4c8-d5427e4ae4db tempest-AttachVolumeTestJSON-1943572718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1f2a4ae0-7d9b-423b-8a3e-300aa489c360 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:21 devstack sudo[103434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1f2a4ae0-7d9b-423b-8a3e-300aa489c360 Aug 10 12:59:21 devstack sudo[103434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:21 devstack sudo[103423]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4d0c7640-2048-49f9-8258-61ec95848265 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-7aac351b-bb18-4e33-baa7-6b1ca5e30f0a" returned: 0 in 0.300s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:22 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4d0c7640-2048-49f9-8258-61ec95848265 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "cinder-quobyte-7aac351b-bb18-4e33-baa7-6b1ca5e30f0a" released by "delete_volume" :: held 1.001s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:59:22 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-4d0c7640-2048-49f9-8258-61ec95848265 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Created reservations ['81636fe7-dd4b-4fc5-8df8-f18460ccdddc', 'dd3fb3d6-b2e7-45e5-b29c-cda8b9b85284', 'f2df23e1-29a9-4372-bc8a-202c501a1345', '8289c37f-241c-47d5-8a71-23b3707e3aea'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:59:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4d0c7640-2048-49f9-8258-61ec95848265 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4d0c7640-2048-49f9-8258-61ec95848265 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:22 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4d0c7640-2048-49f9-8258-61ec95848265 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:59:22 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4d0c7640-2048-49f9-8258-61ec95848265 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:59:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4d0c7640-2048-49f9-8258-61ec95848265 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4d0c7640-2048-49f9-8258-61ec95848265 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:22 devstack sudo[103443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:59:22 devstack sudo[103443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:22 devstack sudo[103434]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0102b5a5-a305-444b-a4c8-d5427e4ae4db tempest-AttachVolumeTestJSON-1943572718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1f2a4ae0-7d9b-423b-8a3e-300aa489c360" returned: 0 in 0.310s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:22 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0102b5a5-a305-444b-a4c8-d5427e4ae4db tempest-AttachVolumeTestJSON-1943572718 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:59:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0102b5a5-a305-444b-a4c8-d5427e4ae4db tempest-AttachVolumeTestJSON-1943572718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:22 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0102b5a5-a305-444b-a4c8-d5427e4ae4db tempest-AttachVolumeTestJSON-1943572718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45aacaf4-fc15-4eba-a690-1e75dc3eb246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f2a4ae0-7d9b-423b-8a3e-300aa489c360', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:22 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0102b5a5-a305-444b-a4c8-d5427e4ae4db tempest-AttachVolumeTestJSON-1943572718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad7bda5a-78f7-4bf2-88e8-c4092c55050c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:22 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-0102b5a5-a305-444b-a4c8-d5427e4ae4db tempest-AttachVolumeTestJSON-1943572718 None] Volume volume-1f2a4ae0-7d9b-423b-8a3e-300aa489c360 (1f2a4ae0-7d9b-423b-8a3e-300aa489c360): created successfully Aug 10 12:59:22 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0102b5a5-a305-444b-a4c8-d5427e4ae4db tempest-AttachVolumeTestJSON-1943572718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad7bda5a-78f7-4bf2-88e8-c4092c55050c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:22 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0102b5a5-a305-444b-a4c8-d5427e4ae4db tempest-AttachVolumeTestJSON-1943572718 None] Flow 'volume_create_manager' (a5209f1d-bea4-49ba-8caf-86cd6804ea67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:59:22 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-0102b5a5-a305-444b-a4c8-d5427e4ae4db tempest-AttachVolumeTestJSON-1943572718 None] Created volume successfully. Aug 10 12:59:22 devstack sudo[103443]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4d0c7640-2048-49f9-8258-61ec95848265 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.281s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:22 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-4d0c7640-2048-49f9-8258-61ec95848265 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:59:22 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-4d0c7640-2048-49f9-8258-61ec95848265 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Deleted volume successfully. Aug 10 12:59:22 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4d0c7640-2048-49f9-8258-61ec95848265 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "cinder-7aac351b-bb18-4e33-baa7-6b1ca5e30f0a-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:59:23 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-3664e90e-df38-4c7e-b608-7a7970a6a204 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Acquiring lock "cinder-c78f2b73-87d4-4dea-b7db-3f36562a8bd8-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:59:23 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-3664e90e-df38-4c7e-b608-7a7970a6a204 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "cinder-c78f2b73-87d4-4dea-b7db-3f36562a8bd8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:59:23 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-3664e90e-df38-4c7e-b608-7a7970a6a204 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Acquiring lock "cinder-quobyte-c78f2b73-87d4-4dea-b7db-3f36562a8bd8" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:59:23 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-3664e90e-df38-4c7e-b608-7a7970a6a204 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "cinder-quobyte-c78f2b73-87d4-4dea-b7db-3f36562a8bd8" acquired by "delete_volume" :: waited 0.031s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:59:23 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e40002-0d59-4960-92f3-2e18703f8e35]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:59:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3664e90e-df38-4c7e-b608-7a7970a6a204 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c78f2b73-87d4-4dea-b7db-3f36562a8bd8 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:23 devstack sudo[103451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c78f2b73-87d4-4dea-b7db-3f36562a8bd8 Aug 10 12:59:23 devstack sudo[103451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:23 devstack sudo[103451]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3664e90e-df38-4c7e-b608-7a7970a6a204 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c78f2b73-87d4-4dea-b7db-3f36562a8bd8" returned: 0 in 0.468s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3664e90e-df38-4c7e-b608-7a7970a6a204 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c78f2b73-87d4-4dea-b7db-3f36562a8bd8 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:23 devstack sudo[103457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c78f2b73-87d4-4dea-b7db-3f36562a8bd8 Aug 10 12:59:23 devstack sudo[103457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:24 devstack sudo[103457]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3664e90e-df38-4c7e-b608-7a7970a6a204 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c78f2b73-87d4-4dea-b7db-3f36562a8bd8" returned: 0 in 0.386s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-8ca85b4c-a466-43e6-bf2e-39ec794d8795 req-9b33e011-7fc0-4d58-a14b-c66853f38467 tempest-AttachVolumeTestJSON-1943572718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-8ca85b4c-a466-43e6-bf2e-39ec794d8795 req-9b33e011-7fc0-4d58-a14b-c66853f38467 tempest-AttachVolumeTestJSON-1943572718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:24 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-3664e90e-df38-4c7e-b608-7a7970a6a204 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "cinder-quobyte-c78f2b73-87d4-4dea-b7db-3f36562a8bd8" released by "delete_volume" :: held 0.921s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:59:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-8ca85b4c-a466-43e6-bf2e-39ec794d8795 req-9b33e011-7fc0-4d58-a14b-c66853f38467 tempest-AttachVolumeTestJSON-1943572718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-8ca85b4c-a466-43e6-bf2e-39ec794d8795 req-9b33e011-7fc0-4d58-a14b-c66853f38467 tempest-AttachVolumeTestJSON-1943572718 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d', 'name': 'volume-1f2a4ae0-7d9b-423b-8a3e-300aa489c360', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0ee2c2ae-3957-4e8d-91a1-8507de0869ad', 'enforce_multipath': True} {{(pid=89096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Aug 10 12:59:24 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-3664e90e-df38-4c7e-b608-7a7970a6a204 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Created reservations ['287f22a3-e04b-40be-b70c-8e94f0cf89b5', 'e0d4daf2-0e25-4405-88a3-04f97e04c9c7', 'c1add3fe-1cbc-4c25-8e4b-2c94e51f82f1', '1c839050-5802-469b-8be3-391c856089f3'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:59:24 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-8ca85b4c-a466-43e6-bf2e-39ec794d8795 req-9b33e011-7fc0-4d58-a14b-c66853f38467 tempest-AttachVolumeTestJSON-1943572718 None] attachment_update completed successfully. Aug 10 12:59:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3664e90e-df38-4c7e-b608-7a7970a6a204 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3664e90e-df38-4c7e-b608-7a7970a6a204 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:24 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3664e90e-df38-4c7e-b608-7a7970a6a204 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:59:24 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3664e90e-df38-4c7e-b608-7a7970a6a204 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:59:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3664e90e-df38-4c7e-b608-7a7970a6a204 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3664e90e-df38-4c7e-b608-7a7970a6a204 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:24 devstack sudo[103469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:59:24 devstack sudo[103469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:24 devstack sudo[103469]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3664e90e-df38-4c7e-b608-7a7970a6a204 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.403s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:24 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-3664e90e-df38-4c7e-b608-7a7970a6a204 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:59:24 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-3664e90e-df38-4c7e-b608-7a7970a6a204 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Deleted volume successfully. Aug 10 12:59:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-3664e90e-df38-4c7e-b608-7a7970a6a204 tempest-CreateVolumesFromSourceVolumeTest-1969187265 None] Lock "cinder-c78f2b73-87d4-4dea-b7db-3f36562a8bd8-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:59:29 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-c21c3c3a-b5d4-426d-8be3-84e86bd0aba5 tempest-CinderUnicodeTest-108584270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:59:29 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c21c3c3a-b5d4-426d-8be3-84e86bd0aba5 tempest-CinderUnicodeTest-108584270 None] Flow 'volume_create_manager' (55a34683-c3ab-429f-a674-c2604ac5be91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:59:29 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c21c3c3a-b5d4-426d-8be3-84e86bd0aba5 tempest-CinderUnicodeTest-108584270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d85b3151-b3b1-45a7-a65f-605619cb9737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:29 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c21c3c3a-b5d4-426d-8be3-84e86bd0aba5 tempest-CinderUnicodeTest-108584270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d85b3151-b3b1-45a7-a65f-605619cb9737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=585958f0-15d4-422c-9034-0317725bbc03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7d63f9d2d5e48629e63a578c2ef9df7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:59:30Z,use_quota=True,user_id='f544dcac4c0546019d3f4769b087cfea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:29 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c21c3c3a-b5d4-426d-8be3-84e86bd0aba5 tempest-CinderUnicodeTest-108584270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d50983-4042-4ef7-a767-fba0658ebe94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:29 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c21c3c3a-b5d4-426d-8be3-84e86bd0aba5 tempest-CinderUnicodeTest-108584270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d50983-4042-4ef7-a767-fba0658ebe94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:29 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c21c3c3a-b5d4-426d-8be3-84e86bd0aba5 tempest-CinderUnicodeTest-108584270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (061e3d46-0303-4bc6-8305-df341f273556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:29 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c21c3c3a-b5d4-426d-8be3-84e86bd0aba5 tempest-CinderUnicodeTest-108584270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (061e3d46-0303-4bc6-8305-df341f273556) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '585958f0-15d4-422c-9034-0317725bbc03', 'volume_name': 'volume-585958f0-15d4-422c-9034-0317725bbc03', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:29 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c21c3c3a-b5d4-426d-8be3-84e86bd0aba5 tempest-CinderUnicodeTest-108584270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b78213d3-1d7a-41f0-aef1-5dbdbb6b8397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:29 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c21c3c3a-b5d4-426d-8be3-84e86bd0aba5 tempest-CinderUnicodeTest-108584270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b78213d3-1d7a-41f0-aef1-5dbdbb6b8397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:29 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c21c3c3a-b5d4-426d-8be3-84e86bd0aba5 tempest-CinderUnicodeTest-108584270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd5912f-3054-49bb-b9c8-a1a820777ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:29 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-c21c3c3a-b5d4-426d-8be3-84e86bd0aba5 tempest-CinderUnicodeTest-108584270 None] Volume 585958f0-15d4-422c-9034-0317725bbc03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-585958f0-15d4-422c-9034-0317725bbc03', 'volume_size': 1} Aug 10 12:59:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c21c3c3a-b5d4-426d-8be3-84e86bd0aba5 tempest-CinderUnicodeTest-108584270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c21c3c3a-b5d4-426d-8be3-84e86bd0aba5 tempest-CinderUnicodeTest-108584270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:29 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c21c3c3a-b5d4-426d-8be3-84e86bd0aba5 tempest-CinderUnicodeTest-108584270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=585958f0-15d4-422c-9034-0317725bbc03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7d63f9d2d5e48629e63a578c2ef9df7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:59:30Z,use_quota=True,user_id='f544dcac4c0546019d3f4769b087cfea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:59:29 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-c21c3c3a-b5d4-426d-8be3-84e86bd0aba5 tempest-CinderUnicodeTest-108584270 None] Creating volume 585958f0-15d4-422c-9034-0317725bbc03 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:59:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c21c3c3a-b5d4-426d-8be3-84e86bd0aba5 tempest-CinderUnicodeTest-108584270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c21c3c3a-b5d4-426d-8be3-84e86bd0aba5 tempest-CinderUnicodeTest-108584270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:29 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c21c3c3a-b5d4-426d-8be3-84e86bd0aba5 tempest-CinderUnicodeTest-108584270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:59:29 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c21c3c3a-b5d4-426d-8be3-84e86bd0aba5 tempest-CinderUnicodeTest-108584270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:59:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c21c3c3a-b5d4-426d-8be3-84e86bd0aba5 tempest-CinderUnicodeTest-108584270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:29 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c21c3c3a-b5d4-426d-8be3-84e86bd0aba5 tempest-CinderUnicodeTest-108584270 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:59:29 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-c21c3c3a-b5d4-426d-8be3-84e86bd0aba5 tempest-CinderUnicodeTest-108584270 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:59:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c21c3c3a-b5d4-426d-8be3-84e86bd0aba5 tempest-CinderUnicodeTest-108584270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-585958f0-15d4-422c-9034-0317725bbc03 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:29 devstack sudo[103903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-585958f0-15d4-422c-9034-0317725bbc03 1073741824 Aug 10 12:59:29 devstack sudo[103903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:30 devstack sudo[103903]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c21c3c3a-b5d4-426d-8be3-84e86bd0aba5 tempest-CinderUnicodeTest-108584270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-585958f0-15d4-422c-9034-0317725bbc03 1073741824" returned: 0 in 0.773s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c21c3c3a-b5d4-426d-8be3-84e86bd0aba5 tempest-CinderUnicodeTest-108584270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-585958f0-15d4-422c-9034-0317725bbc03 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:30 devstack sudo[104016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-585958f0-15d4-422c-9034-0317725bbc03 Aug 10 12:59:30 devstack sudo[104016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:30 devstack sudo[104016]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c21c3c3a-b5d4-426d-8be3-84e86bd0aba5 tempest-CinderUnicodeTest-108584270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-585958f0-15d4-422c-9034-0317725bbc03" returned: 0 in 0.368s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:30 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c21c3c3a-b5d4-426d-8be3-84e86bd0aba5 tempest-CinderUnicodeTest-108584270 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:59:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c21c3c3a-b5d4-426d-8be3-84e86bd0aba5 tempest-CinderUnicodeTest-108584270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c21c3c3a-b5d4-426d-8be3-84e86bd0aba5 tempest-CinderUnicodeTest-108584270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd5912f-3054-49bb-b9c8-a1a820777ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-585958f0-15d4-422c-9034-0317725bbc03', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c21c3c3a-b5d4-426d-8be3-84e86bd0aba5 tempest-CinderUnicodeTest-108584270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2de15da6-44b1-4326-aeea-d67c75f7b0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:30 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-c21c3c3a-b5d4-426d-8be3-84e86bd0aba5 tempest-CinderUnicodeTest-108584270 None] Volume volume-585958f0-15d4-422c-9034-0317725bbc03 (585958f0-15d4-422c-9034-0317725bbc03): created successfully Aug 10 12:59:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c21c3c3a-b5d4-426d-8be3-84e86bd0aba5 tempest-CinderUnicodeTest-108584270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2de15da6-44b1-4326-aeea-d67c75f7b0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c21c3c3a-b5d4-426d-8be3-84e86bd0aba5 tempest-CinderUnicodeTest-108584270 None] Flow 'volume_create_manager' (55a34683-c3ab-429f-a674-c2604ac5be91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:59:30 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-c21c3c3a-b5d4-426d-8be3-84e86bd0aba5 tempest-CinderUnicodeTest-108584270 None] Created volume successfully. Aug 10 12:59:32 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-25ed8459-f19c-4bdb-9dfd-35bf31e90c7d tempest-CinderUnicodeTest-108584270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:59:32 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-25ed8459-f19c-4bdb-9dfd-35bf31e90c7d tempest-CinderUnicodeTest-108584270 None] Flow 'volume_create_manager' (b5d9f118-a81f-4f9c-ae88-f8059cd95b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:59:32 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-25ed8459-f19c-4bdb-9dfd-35bf31e90c7d tempest-CinderUnicodeTest-108584270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8e6cadb-7a6e-4405-8975-daf763f531d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:32 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-25ed8459-f19c-4bdb-9dfd-35bf31e90c7d tempest-CinderUnicodeTest-108584270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8e6cadb-7a6e-4405-8975-daf763f531d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:59:32Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1515575670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=887ebb0a-4561-49e8-8ad1-2acce6bd9c83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7d63f9d2d5e48629e63a578c2ef9df7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:59:33Z,use_quota=True,user_id='f544dcac4c0546019d3f4769b087cfea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:32 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-25ed8459-f19c-4bdb-9dfd-35bf31e90c7d tempest-CinderUnicodeTest-108584270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d37eb579-e163-4704-878a-41a8914e2419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:32 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-25ed8459-f19c-4bdb-9dfd-35bf31e90c7d tempest-CinderUnicodeTest-108584270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d37eb579-e163-4704-878a-41a8914e2419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:32 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-25ed8459-f19c-4bdb-9dfd-35bf31e90c7d tempest-CinderUnicodeTest-108584270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28c71387-3fc9-4792-a9f4-98390ef0f77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:32 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-25ed8459-f19c-4bdb-9dfd-35bf31e90c7d tempest-CinderUnicodeTest-108584270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28c71387-3fc9-4792-a9f4-98390ef0f77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '887ebb0a-4561-49e8-8ad1-2acce6bd9c83', 'volume_name': 'volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:32 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-25ed8459-f19c-4bdb-9dfd-35bf31e90c7d tempest-CinderUnicodeTest-108584270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af34a55e-2b34-4e2e-ad4d-0babe07a9bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:32 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-25ed8459-f19c-4bdb-9dfd-35bf31e90c7d tempest-CinderUnicodeTest-108584270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af34a55e-2b34-4e2e-ad4d-0babe07a9bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:32 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-25ed8459-f19c-4bdb-9dfd-35bf31e90c7d tempest-CinderUnicodeTest-108584270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a3780b4-9930-4ea6-8394-5aa5227cfceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:32 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-25ed8459-f19c-4bdb-9dfd-35bf31e90c7d tempest-CinderUnicodeTest-108584270 None] Volume 887ebb0a-4561-49e8-8ad1-2acce6bd9c83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83', 'volume_size': 1} Aug 10 12:59:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-25ed8459-f19c-4bdb-9dfd-35bf31e90c7d tempest-CinderUnicodeTest-108584270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-25ed8459-f19c-4bdb-9dfd-35bf31e90c7d tempest-CinderUnicodeTest-108584270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:32 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-25ed8459-f19c-4bdb-9dfd-35bf31e90c7d tempest-CinderUnicodeTest-108584270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:59:32Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1515575670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=887ebb0a-4561-49e8-8ad1-2acce6bd9c83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7d63f9d2d5e48629e63a578c2ef9df7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:59:33Z,use_quota=True,user_id='f544dcac4c0546019d3f4769b087cfea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:59:32 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-25ed8459-f19c-4bdb-9dfd-35bf31e90c7d tempest-CinderUnicodeTest-108584270 None] Creating volume 887ebb0a-4561-49e8-8ad1-2acce6bd9c83 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:59:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-25ed8459-f19c-4bdb-9dfd-35bf31e90c7d tempest-CinderUnicodeTest-108584270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-25ed8459-f19c-4bdb-9dfd-35bf31e90c7d tempest-CinderUnicodeTest-108584270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:32 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-25ed8459-f19c-4bdb-9dfd-35bf31e90c7d tempest-CinderUnicodeTest-108584270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:59:32 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-25ed8459-f19c-4bdb-9dfd-35bf31e90c7d tempest-CinderUnicodeTest-108584270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:59:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-25ed8459-f19c-4bdb-9dfd-35bf31e90c7d tempest-CinderUnicodeTest-108584270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:32 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-25ed8459-f19c-4bdb-9dfd-35bf31e90c7d tempest-CinderUnicodeTest-108584270 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:59:32 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-25ed8459-f19c-4bdb-9dfd-35bf31e90c7d tempest-CinderUnicodeTest-108584270 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:59:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-25ed8459-f19c-4bdb-9dfd-35bf31e90c7d tempest-CinderUnicodeTest-108584270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:32 devstack sudo[104408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83 1073741824 Aug 10 12:59:32 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:33 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-25ed8459-f19c-4bdb-9dfd-35bf31e90c7d tempest-CinderUnicodeTest-108584270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83 1073741824" returned: 0 in 0.480s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-25ed8459-f19c-4bdb-9dfd-35bf31e90c7d tempest-CinderUnicodeTest-108584270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:33 devstack sudo[104431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83 Aug 10 12:59:33 devstack sudo[104431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:33 devstack sudo[104431]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-25ed8459-f19c-4bdb-9dfd-35bf31e90c7d tempest-CinderUnicodeTest-108584270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83" returned: 0 in 0.282s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:33 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-25ed8459-f19c-4bdb-9dfd-35bf31e90c7d tempest-CinderUnicodeTest-108584270 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:59:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-25ed8459-f19c-4bdb-9dfd-35bf31e90c7d tempest-CinderUnicodeTest-108584270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:33 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-25ed8459-f19c-4bdb-9dfd-35bf31e90c7d tempest-CinderUnicodeTest-108584270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a3780b4-9930-4ea6-8394-5aa5227cfceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:33 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-25ed8459-f19c-4bdb-9dfd-35bf31e90c7d tempest-CinderUnicodeTest-108584270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (836a2df9-cda4-4db4-bf6e-aa1431a74181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:33 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-25ed8459-f19c-4bdb-9dfd-35bf31e90c7d tempest-CinderUnicodeTest-108584270 None] Volume volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83 (887ebb0a-4561-49e8-8ad1-2acce6bd9c83): created successfully Aug 10 12:59:33 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-25ed8459-f19c-4bdb-9dfd-35bf31e90c7d tempest-CinderUnicodeTest-108584270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (836a2df9-cda4-4db4-bf6e-aa1431a74181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:33 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-25ed8459-f19c-4bdb-9dfd-35bf31e90c7d tempest-CinderUnicodeTest-108584270 None] Flow 'volume_create_manager' (b5d9f118-a81f-4f9c-ae88-f8059cd95b77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:59:33 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-25ed8459-f19c-4bdb-9dfd-35bf31e90c7d tempest-CinderUnicodeTest-108584270 None] Created volume successfully. Aug 10 12:59:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2cfafde0-730e-4349-9142-bc36f05c5730 tempest-CinderUnicodeTest-108584270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2cfafde0-730e-4349-9142-bc36f05c5730 tempest-CinderUnicodeTest-108584270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:35 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-2cfafde0-730e-4349-9142-bc36f05c5730 tempest-CinderUnicodeTest-108584270 None] Creating offline snapshot 35e4832c-7763-473e-b327-e008333abec7 of volume 887ebb0a-4561-49e8-8ad1-2acce6bd9c83 {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 12:59:35 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[914e0054-a4ee-4a43-b860-35d2f615fc4e]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:59:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cfafde0-730e-4349-9142-bc36f05c5730 tempest-CinderUnicodeTest-108584270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:35 devstack sudo[104437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83 Aug 10 12:59:35 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:35 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cfafde0-730e-4349-9142-bc36f05c5730 tempest-CinderUnicodeTest-108584270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83" returned: 0 in 0.403s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cfafde0-730e-4349-9142-bc36f05c5730 tempest-CinderUnicodeTest-108584270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83.35e4832c-7763-473e-b327-e008333abec7 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:35 devstack sudo[104442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83.35e4832c-7763-473e-b327-e008333abec7 1G Aug 10 12:59:35 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:36 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cfafde0-730e-4349-9142-bc36f05c5730 tempest-CinderUnicodeTest-108584270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83.35e4832c-7763-473e-b327-e008333abec7 1G" returned: 0 in 0.433s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cfafde0-730e-4349-9142-bc36f05c5730 tempest-CinderUnicodeTest-108584270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83.35e4832c-7763-473e-b327-e008333abec7 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:36 devstack sudo[104453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83.35e4832c-7763-473e-b327-e008333abec7 Aug 10 12:59:36 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:36 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cfafde0-730e-4349-9142-bc36f05c5730 tempest-CinderUnicodeTest-108584270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83.35e4832c-7763-473e-b327-e008333abec7" returned: 0 in 0.324s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:36 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-2cfafde0-730e-4349-9142-bc36f05c5730 tempest-CinderUnicodeTest-108584270 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83.35e4832c-7763-473e-b327-e008333abec7 is being set with open permissions: ugo+rw Aug 10 12:59:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cfafde0-730e-4349-9142-bc36f05c5730 tempest-CinderUnicodeTest-108584270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83.35e4832c-7763-473e-b327-e008333abec7 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:36 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83.35e4832c-7763-473e-b327-e008333abec7 Aug 10 12:59:36 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:36 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cfafde0-730e-4349-9142-bc36f05c5730 tempest-CinderUnicodeTest-108584270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83.35e4832c-7763-473e-b327-e008333abec7" returned: 0 in 0.261s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cfafde0-730e-4349-9142-bc36f05c5730 tempest-CinderUnicodeTest-108584270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:36 devstack sudo[104461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83.info Aug 10 12:59:36 devstack sudo[104461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:36 devstack sudo[104461]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cfafde0-730e-4349-9142-bc36f05c5730 tempest-CinderUnicodeTest-108584270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83.info" returned: 0 in 0.262s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:36 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-2cfafde0-730e-4349-9142-bc36f05c5730 tempest-CinderUnicodeTest-108584270 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83.info is being set with open permissions: ugo+rw Aug 10 12:59:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cfafde0-730e-4349-9142-bc36f05c5730 tempest-CinderUnicodeTest-108584270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:36 devstack sudo[104464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83.info Aug 10 12:59:36 devstack sudo[104464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:37 devstack sudo[104464]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2cfafde0-730e-4349-9142-bc36f05c5730 tempest-CinderUnicodeTest-108584270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83.info" returned: 0 in 0.254s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2cfafde0-730e-4349-9142-bc36f05c5730 tempest-CinderUnicodeTest-108584270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.066s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:37 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-2cfafde0-730e-4349-9142-bc36f05c5730 tempest-CinderUnicodeTest-108584270 None] Create snapshot completed successfully Aug 10 12:59:38 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-181c2cbf-7aaa-44c6-9bdf-85280fde8de9 tempest-CinderUnicodeTest-108584270 None] Acquiring lock "cinder-35e4832c-7763-473e-b327-e008333abec7-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:59:38 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-181c2cbf-7aaa-44c6-9bdf-85280fde8de9 tempest-CinderUnicodeTest-108584270 None] Lock "cinder-35e4832c-7763-473e-b327-e008333abec7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:59:38 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-181c2cbf-7aaa-44c6-9bdf-85280fde8de9 tempest-CinderUnicodeTest-108584270 None] Acquiring lock "cinder-quobyte-887ebb0a-4561-49e8-8ad1-2acce6bd9c83" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:59:38 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-181c2cbf-7aaa-44c6-9bdf-85280fde8de9 tempest-CinderUnicodeTest-108584270 None] Lock "cinder-quobyte-887ebb0a-4561-49e8-8ad1-2acce6bd9c83" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:59:38 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-181c2cbf-7aaa-44c6-9bdf-85280fde8de9 tempest-CinderUnicodeTest-108584270 None] Acquiring lock "cinder-quobyte-35e4832c-7763-473e-b327-e008333abec7" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:59:38 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-181c2cbf-7aaa-44c6-9bdf-85280fde8de9 tempest-CinderUnicodeTest-108584270 None] Lock "cinder-quobyte-35e4832c-7763-473e-b327-e008333abec7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:59:38 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-181c2cbf-7aaa-44c6-9bdf-85280fde8de9 tempest-CinderUnicodeTest-108584270 None] Deleting offline snapshot 35e4832c-7763-473e-b327-e008333abec7 of volume 887ebb0a-4561-49e8-8ad1-2acce6bd9c83 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 12:59:38 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-181c2cbf-7aaa-44c6-9bdf-85280fde8de9 tempest-CinderUnicodeTest-108584270 None] snapshot_file for this snap is: volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83.35e4832c-7763-473e-b327-e008333abec7 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 12:59:38 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1558043-761f-49c5-8017-7e3309f823d1]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:59:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-181c2cbf-7aaa-44c6-9bdf-85280fde8de9 tempest-CinderUnicodeTest-108584270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83.35e4832c-7763-473e-b327-e008333abec7 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:38 devstack sudo[104467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83.35e4832c-7763-473e-b327-e008333abec7 Aug 10 12:59:38 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:38 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-181c2cbf-7aaa-44c6-9bdf-85280fde8de9 tempest-CinderUnicodeTest-108584270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83.35e4832c-7763-473e-b327-e008333abec7" returned: 0 in 0.370s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:38 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-181c2cbf-7aaa-44c6-9bdf-85280fde8de9 tempest-CinderUnicodeTest-108584270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 12:59:38 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[5154bed2-4893-4ef4-bac5-eba9dd1969ac]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:59:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-181c2cbf-7aaa-44c6-9bdf-85280fde8de9 tempest-CinderUnicodeTest-108584270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:38 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83 Aug 10 12:59:38 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:39 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-181c2cbf-7aaa-44c6-9bdf-85280fde8de9 tempest-CinderUnicodeTest-108584270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83" returned: 0 in 0.344s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-181c2cbf-7aaa-44c6-9bdf-85280fde8de9 tempest-CinderUnicodeTest-108584270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83.35e4832c-7763-473e-b327-e008333abec7 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:39 devstack sudo[104478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83.35e4832c-7763-473e-b327-e008333abec7 Aug 10 12:59:39 devstack sudo[104478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:39 devstack sudo[104478]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-181c2cbf-7aaa-44c6-9bdf-85280fde8de9 tempest-CinderUnicodeTest-108584270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83.35e4832c-7763-473e-b327-e008333abec7" returned: 0 in 0.349s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-181c2cbf-7aaa-44c6-9bdf-85280fde8de9 tempest-CinderUnicodeTest-108584270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83.35e4832c-7763-473e-b327-e008333abec7 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:39 devstack sudo[104483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83.35e4832c-7763-473e-b327-e008333abec7 Aug 10 12:59:39 devstack sudo[104483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:39 devstack sudo[104483]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-181c2cbf-7aaa-44c6-9bdf-85280fde8de9 tempest-CinderUnicodeTest-108584270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83.35e4832c-7763-473e-b327-e008333abec7" returned: 0 in 0.248s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:39 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:UPDATE=86,cinder:SELECT=91,cinder:INSERT=28,cinder:DELETE=10 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:59:39 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=83,cinder:INSERT=23,cinder:UPDATE=108,cinder:DELETE=10 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 12:59:39 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-181c2cbf-7aaa-44c6-9bdf-85280fde8de9 tempest-CinderUnicodeTest-108584270 None] Lock "cinder-quobyte-35e4832c-7763-473e-b327-e008333abec7" released by "_delete_snapshot" :: held 1.440s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:59:39 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-181c2cbf-7aaa-44c6-9bdf-85280fde8de9 tempest-CinderUnicodeTest-108584270 None] Lock "cinder-quobyte-887ebb0a-4561-49e8-8ad1-2acce6bd9c83" released by "delete_snapshot" :: held 1.466s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:59:39 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-181c2cbf-7aaa-44c6-9bdf-85280fde8de9 tempest-CinderUnicodeTest-108584270 None] Created reservations ['72cf10a5-e3e1-44a0-a6d7-1d1160753d9d', 'cdce11ac-b1f4-4881-97ca-411bf51526cf', 'b7b23401-4e0a-4597-a6d3-5aa9a56b9165', 'b3ca73d7-43f4-47b5-9e97-5735fe214a0b'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:59:39 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-181c2cbf-7aaa-44c6-9bdf-85280fde8de9 tempest-CinderUnicodeTest-108584270 None] Delete snapshot completed successfully. Aug 10 12:59:39 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-181c2cbf-7aaa-44c6-9bdf-85280fde8de9 tempest-CinderUnicodeTest-108584270 None] Lock "cinder-35e4832c-7763-473e-b327-e008333abec7-delete_snapshot" released by "delete_snapshot" :: held 1.619s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:59:40 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-bb79de04-fcfd-4e74-9df1-389c18e447e8 tempest-CinderUnicodeTest-108584270 None] Acquiring lock "cinder-887ebb0a-4561-49e8-8ad1-2acce6bd9c83-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:59:40 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-bb79de04-fcfd-4e74-9df1-389c18e447e8 tempest-CinderUnicodeTest-108584270 None] Lock "cinder-887ebb0a-4561-49e8-8ad1-2acce6bd9c83-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:59:40 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-bb79de04-fcfd-4e74-9df1-389c18e447e8 tempest-CinderUnicodeTest-108584270 None] Acquiring lock "cinder-quobyte-887ebb0a-4561-49e8-8ad1-2acce6bd9c83" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:59:40 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-bb79de04-fcfd-4e74-9df1-389c18e447e8 tempest-CinderUnicodeTest-108584270 None] Lock "cinder-quobyte-887ebb0a-4561-49e8-8ad1-2acce6bd9c83" acquired by "delete_volume" :: waited 0.017s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:59:40 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b6084c-546f-41b2-8131-b3247b618717]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:59:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-bb79de04-fcfd-4e74-9df1-389c18e447e8 tempest-CinderUnicodeTest-108584270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:40 devstack sudo[104486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83 Aug 10 12:59:40 devstack sudo[104486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:41 devstack sudo[104486]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-bb79de04-fcfd-4e74-9df1-389c18e447e8 tempest-CinderUnicodeTest-108584270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83" returned: 0 in 0.373s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-bb79de04-fcfd-4e74-9df1-389c18e447e8 tempest-CinderUnicodeTest-108584270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:41 devstack sudo[104491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83 Aug 10 12:59:41 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:41 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-bb79de04-fcfd-4e74-9df1-389c18e447e8 tempest-CinderUnicodeTest-108584270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-887ebb0a-4561-49e8-8ad1-2acce6bd9c83" returned: 0 in 0.259s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:41 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-bb79de04-fcfd-4e74-9df1-389c18e447e8 tempest-CinderUnicodeTest-108584270 None] Lock "cinder-quobyte-887ebb0a-4561-49e8-8ad1-2acce6bd9c83" released by "delete_volume" :: held 0.700s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:59:41 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-bb79de04-fcfd-4e74-9df1-389c18e447e8 tempest-CinderUnicodeTest-108584270 None] Created reservations ['2b3639da-a548-4361-b022-a13d71b02676', '86f21040-d612-4520-853f-b7092b4d54e9', '3a4ad5c4-9423-4b9e-aaf7-bf783ec26136', 'c38cb1c6-d888-4ee6-bcd3-3ea6f5dc197f'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:59:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-bb79de04-fcfd-4e74-9df1-389c18e447e8 tempest-CinderUnicodeTest-108584270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-bb79de04-fcfd-4e74-9df1-389c18e447e8 tempest-CinderUnicodeTest-108584270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:41 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-bb79de04-fcfd-4e74-9df1-389c18e447e8 tempest-CinderUnicodeTest-108584270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:59:41 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-bb79de04-fcfd-4e74-9df1-389c18e447e8 tempest-CinderUnicodeTest-108584270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:59:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-bb79de04-fcfd-4e74-9df1-389c18e447e8 tempest-CinderUnicodeTest-108584270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-bb79de04-fcfd-4e74-9df1-389c18e447e8 tempest-CinderUnicodeTest-108584270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:41 devstack sudo[104494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:59:41 devstack sudo[104494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:41 devstack sudo[104494]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-bb79de04-fcfd-4e74-9df1-389c18e447e8 tempest-CinderUnicodeTest-108584270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.257s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:41 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-bb79de04-fcfd-4e74-9df1-389c18e447e8 tempest-CinderUnicodeTest-108584270 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:59:41 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-bb79de04-fcfd-4e74-9df1-389c18e447e8 tempest-CinderUnicodeTest-108584270 None] Deleted volume successfully. Aug 10 12:59:41 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-bb79de04-fcfd-4e74-9df1-389c18e447e8 tempest-CinderUnicodeTest-108584270 None] Lock "cinder-887ebb0a-4561-49e8-8ad1-2acce6bd9c83-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:59:41 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-859f229c-c285-4ffc-a931-32042351df8c tempest-CinderUnicodeTest-108584270 None] Acquiring lock "cinder-585958f0-15d4-422c-9034-0317725bbc03-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:59:41 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-859f229c-c285-4ffc-a931-32042351df8c tempest-CinderUnicodeTest-108584270 None] Lock "cinder-585958f0-15d4-422c-9034-0317725bbc03-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:59:41 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-859f229c-c285-4ffc-a931-32042351df8c tempest-CinderUnicodeTest-108584270 None] Acquiring lock "cinder-quobyte-585958f0-15d4-422c-9034-0317725bbc03" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:59:41 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-859f229c-c285-4ffc-a931-32042351df8c tempest-CinderUnicodeTest-108584270 None] Lock "cinder-quobyte-585958f0-15d4-422c-9034-0317725bbc03" acquired by "delete_volume" :: waited 0.019s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:59:41 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21d1af6-17b0-4ad5-9771-7920194cae22]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:59:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-859f229c-c285-4ffc-a931-32042351df8c tempest-CinderUnicodeTest-108584270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-585958f0-15d4-422c-9034-0317725bbc03 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:41 devstack sudo[104497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-585958f0-15d4-422c-9034-0317725bbc03 Aug 10 12:59:41 devstack sudo[104497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:42 devstack sudo[104497]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-859f229c-c285-4ffc-a931-32042351df8c tempest-CinderUnicodeTest-108584270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-585958f0-15d4-422c-9034-0317725bbc03" returned: 0 in 0.371s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-859f229c-c285-4ffc-a931-32042351df8c tempest-CinderUnicodeTest-108584270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-585958f0-15d4-422c-9034-0317725bbc03 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:42 devstack sudo[104502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-585958f0-15d4-422c-9034-0317725bbc03 Aug 10 12:59:42 devstack sudo[104502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:42 devstack sudo[104502]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-859f229c-c285-4ffc-a931-32042351df8c tempest-CinderUnicodeTest-108584270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-585958f0-15d4-422c-9034-0317725bbc03" returned: 0 in 0.256s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:42 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-859f229c-c285-4ffc-a931-32042351df8c tempest-CinderUnicodeTest-108584270 None] Lock "cinder-quobyte-585958f0-15d4-422c-9034-0317725bbc03" released by "delete_volume" :: held 0.666s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:59:42 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-859f229c-c285-4ffc-a931-32042351df8c tempest-CinderUnicodeTest-108584270 None] Created reservations ['4b10e627-d0b1-40ac-8b3b-30e0416af174', '596e1fa8-272f-48c0-be57-e99943773d29', '49e2df02-79f9-4250-a0bf-f325792c0bc7', 'cc4ed978-0452-484b-aafe-15d8998efc5b'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:59:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-859f229c-c285-4ffc-a931-32042351df8c tempest-CinderUnicodeTest-108584270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-859f229c-c285-4ffc-a931-32042351df8c tempest-CinderUnicodeTest-108584270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:42 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-859f229c-c285-4ffc-a931-32042351df8c tempest-CinderUnicodeTest-108584270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:59:42 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-859f229c-c285-4ffc-a931-32042351df8c tempest-CinderUnicodeTest-108584270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:59:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-859f229c-c285-4ffc-a931-32042351df8c tempest-CinderUnicodeTest-108584270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-859f229c-c285-4ffc-a931-32042351df8c tempest-CinderUnicodeTest-108584270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:42 devstack sudo[104505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:59:42 devstack sudo[104505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:42 devstack sudo[104505]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-859f229c-c285-4ffc-a931-32042351df8c tempest-CinderUnicodeTest-108584270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.265s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:42 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-859f229c-c285-4ffc-a931-32042351df8c tempest-CinderUnicodeTest-108584270 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:59:42 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-859f229c-c285-4ffc-a931-32042351df8c tempest-CinderUnicodeTest-108584270 None] Deleted volume successfully. Aug 10 12:59:42 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-859f229c-c285-4ffc-a931-32042351df8c tempest-CinderUnicodeTest-108584270 None] Lock "cinder-585958f0-15d4-422c-9034-0317725bbc03-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:59:46 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f75454f-8345-4e92-b1a2-8ab1777ca1c8 tempest-ProjectReaderTests-1477261192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:59:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6f75454f-8345-4e92-b1a2-8ab1777ca1c8 tempest-ProjectReaderTests-1477261192 None] Flow 'volume_create_manager' (de639757-476f-410f-92cf-ca2bc3062b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:59:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6f75454f-8345-4e92-b1a2-8ab1777ca1c8 tempest-ProjectReaderTests-1477261192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54568c7e-610c-4de9-aac4-4e7c3c67a7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6f75454f-8345-4e92-b1a2-8ab1777ca1c8 tempest-ProjectReaderTests-1477261192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54568c7e-610c-4de9-aac4-4e7c3c67a7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1287711692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c8b577a-0c5f-4b6c-b837-65ae4b603ee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ae54acfce9749689749012a60d17bf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:59:47Z,use_quota=True,user_id='7e89746d93504822a95b9704586bd597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6f75454f-8345-4e92-b1a2-8ab1777ca1c8 tempest-ProjectReaderTests-1477261192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b8b2d20-beb7-4d00-847b-6140441b6fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6f75454f-8345-4e92-b1a2-8ab1777ca1c8 tempest-ProjectReaderTests-1477261192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b8b2d20-beb7-4d00-847b-6140441b6fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6f75454f-8345-4e92-b1a2-8ab1777ca1c8 tempest-ProjectReaderTests-1477261192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f9aa6f1-a499-4c82-9005-12a4e97eacfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6f75454f-8345-4e92-b1a2-8ab1777ca1c8 tempest-ProjectReaderTests-1477261192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f9aa6f1-a499-4c82-9005-12a4e97eacfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c8b577a-0c5f-4b6c-b837-65ae4b603ee1', 'volume_name': 'volume-8c8b577a-0c5f-4b6c-b837-65ae4b603ee1', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6f75454f-8345-4e92-b1a2-8ab1777ca1c8 tempest-ProjectReaderTests-1477261192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe990fb-2cd2-4615-b3c5-cb1f38fd900f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6f75454f-8345-4e92-b1a2-8ab1777ca1c8 tempest-ProjectReaderTests-1477261192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe990fb-2cd2-4615-b3c5-cb1f38fd900f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6f75454f-8345-4e92-b1a2-8ab1777ca1c8 tempest-ProjectReaderTests-1477261192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd493a6-b881-4242-86f8-c5cc29c10002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:46 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-6f75454f-8345-4e92-b1a2-8ab1777ca1c8 tempest-ProjectReaderTests-1477261192 None] Volume 8c8b577a-0c5f-4b6c-b837-65ae4b603ee1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c8b577a-0c5f-4b6c-b837-65ae4b603ee1', 'volume_size': 1} Aug 10 12:59:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6f75454f-8345-4e92-b1a2-8ab1777ca1c8 tempest-ProjectReaderTests-1477261192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6f75454f-8345-4e92-b1a2-8ab1777ca1c8 tempest-ProjectReaderTests-1477261192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:46 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6f75454f-8345-4e92-b1a2-8ab1777ca1c8 tempest-ProjectReaderTests-1477261192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1287711692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c8b577a-0c5f-4b6c-b837-65ae4b603ee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ae54acfce9749689749012a60d17bf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:59:47Z,use_quota=True,user_id='7e89746d93504822a95b9704586bd597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:59:46 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-6f75454f-8345-4e92-b1a2-8ab1777ca1c8 tempest-ProjectReaderTests-1477261192 None] Creating volume 8c8b577a-0c5f-4b6c-b837-65ae4b603ee1 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:59:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6f75454f-8345-4e92-b1a2-8ab1777ca1c8 tempest-ProjectReaderTests-1477261192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6f75454f-8345-4e92-b1a2-8ab1777ca1c8 tempest-ProjectReaderTests-1477261192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:46 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6f75454f-8345-4e92-b1a2-8ab1777ca1c8 tempest-ProjectReaderTests-1477261192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:59:46 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6f75454f-8345-4e92-b1a2-8ab1777ca1c8 tempest-ProjectReaderTests-1477261192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:59:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6f75454f-8345-4e92-b1a2-8ab1777ca1c8 tempest-ProjectReaderTests-1477261192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:46 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6f75454f-8345-4e92-b1a2-8ab1777ca1c8 tempest-ProjectReaderTests-1477261192 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:59:46 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-6f75454f-8345-4e92-b1a2-8ab1777ca1c8 tempest-ProjectReaderTests-1477261192 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:59:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6f75454f-8345-4e92-b1a2-8ab1777ca1c8 tempest-ProjectReaderTests-1477261192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8c8b577a-0c5f-4b6c-b837-65ae4b603ee1 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:46 devstack sudo[104514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8c8b577a-0c5f-4b6c-b837-65ae4b603ee1 1073741824 Aug 10 12:59:46 devstack sudo[104514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:47 devstack sudo[104514]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6f75454f-8345-4e92-b1a2-8ab1777ca1c8 tempest-ProjectReaderTests-1477261192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8c8b577a-0c5f-4b6c-b837-65ae4b603ee1 1073741824" returned: 0 in 0.419s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6f75454f-8345-4e92-b1a2-8ab1777ca1c8 tempest-ProjectReaderTests-1477261192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8c8b577a-0c5f-4b6c-b837-65ae4b603ee1 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:47 devstack sudo[104519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8c8b577a-0c5f-4b6c-b837-65ae4b603ee1 Aug 10 12:59:47 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:47 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6f75454f-8345-4e92-b1a2-8ab1777ca1c8 tempest-ProjectReaderTests-1477261192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8c8b577a-0c5f-4b6c-b837-65ae4b603ee1" returned: 0 in 0.255s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:47 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6f75454f-8345-4e92-b1a2-8ab1777ca1c8 tempest-ProjectReaderTests-1477261192 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:59:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6f75454f-8345-4e92-b1a2-8ab1777ca1c8 tempest-ProjectReaderTests-1477261192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6f75454f-8345-4e92-b1a2-8ab1777ca1c8 tempest-ProjectReaderTests-1477261192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd493a6-b881-4242-86f8-c5cc29c10002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c8b577a-0c5f-4b6c-b837-65ae4b603ee1', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6f75454f-8345-4e92-b1a2-8ab1777ca1c8 tempest-ProjectReaderTests-1477261192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8606520-cfd3-4ca2-aee9-ebf902950589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:47 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-6f75454f-8345-4e92-b1a2-8ab1777ca1c8 tempest-ProjectReaderTests-1477261192 None] Volume volume-8c8b577a-0c5f-4b6c-b837-65ae4b603ee1 (8c8b577a-0c5f-4b6c-b837-65ae4b603ee1): created successfully Aug 10 12:59:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6f75454f-8345-4e92-b1a2-8ab1777ca1c8 tempest-ProjectReaderTests-1477261192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8606520-cfd3-4ca2-aee9-ebf902950589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6f75454f-8345-4e92-b1a2-8ab1777ca1c8 tempest-ProjectReaderTests-1477261192 None] Flow 'volume_create_manager' (de639757-476f-410f-92cf-ca2bc3062b31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:59:47 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-6f75454f-8345-4e92-b1a2-8ab1777ca1c8 tempest-ProjectReaderTests-1477261192 None] Created volume successfully. Aug 10 12:59:47 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-97606c3f-0c5b-426a-b230-0ad88f8d6ada tempest-ProjectReaderTests-1477261192 None] Acquiring lock "cinder-8c8b577a-0c5f-4b6c-b837-65ae4b603ee1-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:59:47 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-97606c3f-0c5b-426a-b230-0ad88f8d6ada tempest-ProjectReaderTests-1477261192 None] Lock "cinder-8c8b577a-0c5f-4b6c-b837-65ae4b603ee1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:59:47 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-97606c3f-0c5b-426a-b230-0ad88f8d6ada tempest-ProjectReaderTests-1477261192 None] Acquiring lock "cinder-quobyte-8c8b577a-0c5f-4b6c-b837-65ae4b603ee1" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:59:47 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-97606c3f-0c5b-426a-b230-0ad88f8d6ada tempest-ProjectReaderTests-1477261192 None] Lock "cinder-quobyte-8c8b577a-0c5f-4b6c-b837-65ae4b603ee1" acquired by "delete_volume" :: waited 0.019s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:59:47 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb66994-2e38-425b-b8f9-81b156c363c2]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:59:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-97606c3f-0c5b-426a-b230-0ad88f8d6ada tempest-ProjectReaderTests-1477261192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8c8b577a-0c5f-4b6c-b837-65ae4b603ee1 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:48 devstack sudo[104522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8c8b577a-0c5f-4b6c-b837-65ae4b603ee1 Aug 10 12:59:48 devstack sudo[104522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:48 devstack sudo[104522]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-97606c3f-0c5b-426a-b230-0ad88f8d6ada tempest-ProjectReaderTests-1477261192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8c8b577a-0c5f-4b6c-b837-65ae4b603ee1" returned: 0 in 0.391s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-97606c3f-0c5b-426a-b230-0ad88f8d6ada tempest-ProjectReaderTests-1477261192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8c8b577a-0c5f-4b6c-b837-65ae4b603ee1 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:48 devstack sudo[104527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8c8b577a-0c5f-4b6c-b837-65ae4b603ee1 Aug 10 12:59:48 devstack sudo[104527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:48 devstack sudo[104527]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-97606c3f-0c5b-426a-b230-0ad88f8d6ada tempest-ProjectReaderTests-1477261192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-8c8b577a-0c5f-4b6c-b837-65ae4b603ee1" returned: 0 in 0.256s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:48 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-97606c3f-0c5b-426a-b230-0ad88f8d6ada tempest-ProjectReaderTests-1477261192 None] Lock "cinder-quobyte-8c8b577a-0c5f-4b6c-b837-65ae4b603ee1" released by "delete_volume" :: held 0.703s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:59:48 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-97606c3f-0c5b-426a-b230-0ad88f8d6ada tempest-ProjectReaderTests-1477261192 None] Created reservations ['d2d335b9-456b-4533-83f0-3664030fb268', 'baa13b61-749a-4363-b017-c9639a5a43c6', 'd58380f6-2802-406e-96a3-523b936312d8', 'bf97ddb7-d72b-43dd-b746-a49ddcf0ecb8'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:59:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-97606c3f-0c5b-426a-b230-0ad88f8d6ada tempest-ProjectReaderTests-1477261192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-97606c3f-0c5b-426a-b230-0ad88f8d6ada tempest-ProjectReaderTests-1477261192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:48 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-97606c3f-0c5b-426a-b230-0ad88f8d6ada tempest-ProjectReaderTests-1477261192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:59:48 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-97606c3f-0c5b-426a-b230-0ad88f8d6ada tempest-ProjectReaderTests-1477261192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:59:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-97606c3f-0c5b-426a-b230-0ad88f8d6ada tempest-ProjectReaderTests-1477261192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-97606c3f-0c5b-426a-b230-0ad88f8d6ada tempest-ProjectReaderTests-1477261192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:48 devstack sudo[104536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:59:48 devstack sudo[104536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:49 devstack sudo[104536]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-97606c3f-0c5b-426a-b230-0ad88f8d6ada tempest-ProjectReaderTests-1477261192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.345s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:49 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-97606c3f-0c5b-426a-b230-0ad88f8d6ada tempest-ProjectReaderTests-1477261192 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:59:49 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-97606c3f-0c5b-426a-b230-0ad88f8d6ada tempest-ProjectReaderTests-1477261192 None] Deleted volume successfully. Aug 10 12:59:49 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-97606c3f-0c5b-426a-b230-0ad88f8d6ada tempest-ProjectReaderTests-1477261192 None] Lock "cinder-8c8b577a-0c5f-4b6c-b837-65ae4b603ee1-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:59:49 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-10520aaf-aaab-4aa9-9f48-0650576b8b4a tempest-ProjectReaderTests-1477261192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:59:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10520aaf-aaab-4aa9-9f48-0650576b8b4a tempest-ProjectReaderTests-1477261192 None] Flow 'volume_create_manager' (45108412-5cdb-4410-bd89-acf86c5561c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:59:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10520aaf-aaab-4aa9-9f48-0650576b8b4a tempest-ProjectReaderTests-1477261192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebec07e9-b884-44e5-9a21-511a2a475d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10520aaf-aaab-4aa9-9f48-0650576b8b4a tempest-ProjectReaderTests-1477261192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebec07e9-b884-44e5-9a21-511a2a475d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-722174160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac203c8-a5a7-4bba-b774-ead251966c0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ae54acfce9749689749012a60d17bf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:59:50Z,use_quota=True,user_id='7e89746d93504822a95b9704586bd597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10520aaf-aaab-4aa9-9f48-0650576b8b4a tempest-ProjectReaderTests-1477261192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e341bf8-172f-4b37-bcb0-a027072b77f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10520aaf-aaab-4aa9-9f48-0650576b8b4a tempest-ProjectReaderTests-1477261192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e341bf8-172f-4b37-bcb0-a027072b77f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10520aaf-aaab-4aa9-9f48-0650576b8b4a tempest-ProjectReaderTests-1477261192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d98be1d-26e6-434a-99f7-9b9bd8193a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10520aaf-aaab-4aa9-9f48-0650576b8b4a tempest-ProjectReaderTests-1477261192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d98be1d-26e6-434a-99f7-9b9bd8193a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ac203c8-a5a7-4bba-b774-ead251966c0e', 'volume_name': 'volume-4ac203c8-a5a7-4bba-b774-ead251966c0e', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10520aaf-aaab-4aa9-9f48-0650576b8b4a tempest-ProjectReaderTests-1477261192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ec0fa3-700f-473a-8bc9-a26ef967dd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10520aaf-aaab-4aa9-9f48-0650576b8b4a tempest-ProjectReaderTests-1477261192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ec0fa3-700f-473a-8bc9-a26ef967dd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10520aaf-aaab-4aa9-9f48-0650576b8b4a tempest-ProjectReaderTests-1477261192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6654b7e7-feac-43ac-b010-2bafe661bd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:49 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-10520aaf-aaab-4aa9-9f48-0650576b8b4a tempest-ProjectReaderTests-1477261192 None] Volume 4ac203c8-a5a7-4bba-b774-ead251966c0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ac203c8-a5a7-4bba-b774-ead251966c0e', 'volume_size': 1} Aug 10 12:59:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-10520aaf-aaab-4aa9-9f48-0650576b8b4a tempest-ProjectReaderTests-1477261192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-10520aaf-aaab-4aa9-9f48-0650576b8b4a tempest-ProjectReaderTests-1477261192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:49 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-10520aaf-aaab-4aa9-9f48-0650576b8b4a tempest-ProjectReaderTests-1477261192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-722174160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac203c8-a5a7-4bba-b774-ead251966c0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ae54acfce9749689749012a60d17bf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:59:50Z,use_quota=True,user_id='7e89746d93504822a95b9704586bd597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:59:49 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-10520aaf-aaab-4aa9-9f48-0650576b8b4a tempest-ProjectReaderTests-1477261192 None] Creating volume 4ac203c8-a5a7-4bba-b774-ead251966c0e {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:59:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-10520aaf-aaab-4aa9-9f48-0650576b8b4a tempest-ProjectReaderTests-1477261192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-10520aaf-aaab-4aa9-9f48-0650576b8b4a tempest-ProjectReaderTests-1477261192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:49 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-10520aaf-aaab-4aa9-9f48-0650576b8b4a tempest-ProjectReaderTests-1477261192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:59:49 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-10520aaf-aaab-4aa9-9f48-0650576b8b4a tempest-ProjectReaderTests-1477261192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:59:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-10520aaf-aaab-4aa9-9f48-0650576b8b4a tempest-ProjectReaderTests-1477261192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:49 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-10520aaf-aaab-4aa9-9f48-0650576b8b4a tempest-ProjectReaderTests-1477261192 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:59:49 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-10520aaf-aaab-4aa9-9f48-0650576b8b4a tempest-ProjectReaderTests-1477261192 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:59:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-10520aaf-aaab-4aa9-9f48-0650576b8b4a tempest-ProjectReaderTests-1477261192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4ac203c8-a5a7-4bba-b774-ead251966c0e 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:49 devstack sudo[104545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4ac203c8-a5a7-4bba-b774-ead251966c0e 1073741824 Aug 10 12:59:49 devstack sudo[104545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:50 devstack sudo[104545]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-10520aaf-aaab-4aa9-9f48-0650576b8b4a tempest-ProjectReaderTests-1477261192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4ac203c8-a5a7-4bba-b774-ead251966c0e 1073741824" returned: 0 in 0.430s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-10520aaf-aaab-4aa9-9f48-0650576b8b4a tempest-ProjectReaderTests-1477261192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4ac203c8-a5a7-4bba-b774-ead251966c0e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:50 devstack sudo[104551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4ac203c8-a5a7-4bba-b774-ead251966c0e Aug 10 12:59:50 devstack sudo[104551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:50 devstack sudo[104551]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-10520aaf-aaab-4aa9-9f48-0650576b8b4a tempest-ProjectReaderTests-1477261192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4ac203c8-a5a7-4bba-b774-ead251966c0e" returned: 0 in 0.253s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:50 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-10520aaf-aaab-4aa9-9f48-0650576b8b4a tempest-ProjectReaderTests-1477261192 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:59:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-10520aaf-aaab-4aa9-9f48-0650576b8b4a tempest-ProjectReaderTests-1477261192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:50 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10520aaf-aaab-4aa9-9f48-0650576b8b4a tempest-ProjectReaderTests-1477261192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6654b7e7-feac-43ac-b010-2bafe661bd1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ac203c8-a5a7-4bba-b774-ead251966c0e', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:50 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10520aaf-aaab-4aa9-9f48-0650576b8b4a tempest-ProjectReaderTests-1477261192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a38672-c575-4894-9e40-c6f2c397940e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:50 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-10520aaf-aaab-4aa9-9f48-0650576b8b4a tempest-ProjectReaderTests-1477261192 None] Volume volume-4ac203c8-a5a7-4bba-b774-ead251966c0e (4ac203c8-a5a7-4bba-b774-ead251966c0e): created successfully Aug 10 12:59:50 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10520aaf-aaab-4aa9-9f48-0650576b8b4a tempest-ProjectReaderTests-1477261192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a38672-c575-4894-9e40-c6f2c397940e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:50 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-10520aaf-aaab-4aa9-9f48-0650576b8b4a tempest-ProjectReaderTests-1477261192 None] Flow 'volume_create_manager' (45108412-5cdb-4410-bd89-acf86c5561c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:59:50 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-10520aaf-aaab-4aa9-9f48-0650576b8b4a tempest-ProjectReaderTests-1477261192 None] Created volume successfully. Aug 10 12:59:50 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7181d5dc-bb67-4c6b-9f70-e0d163c86c2b tempest-ProjectReaderTests-1477261192 None] Acquiring lock "cinder-4ac203c8-a5a7-4bba-b774-ead251966c0e-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:59:50 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7181d5dc-bb67-4c6b-9f70-e0d163c86c2b tempest-ProjectReaderTests-1477261192 None] Lock "cinder-4ac203c8-a5a7-4bba-b774-ead251966c0e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:59:50 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7181d5dc-bb67-4c6b-9f70-e0d163c86c2b tempest-ProjectReaderTests-1477261192 None] Acquiring lock "cinder-quobyte-4ac203c8-a5a7-4bba-b774-ead251966c0e" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 12:59:50 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7181d5dc-bb67-4c6b-9f70-e0d163c86c2b tempest-ProjectReaderTests-1477261192 None] Lock "cinder-quobyte-4ac203c8-a5a7-4bba-b774-ead251966c0e" acquired by "delete_volume" :: waited 0.015s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 12:59:50 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cd96fc-637c-4986-8749-8b09e2c342ac]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 12:59:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7181d5dc-bb67-4c6b-9f70-e0d163c86c2b tempest-ProjectReaderTests-1477261192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4ac203c8-a5a7-4bba-b774-ead251966c0e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:50 devstack sudo[104578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4ac203c8-a5a7-4bba-b774-ead251966c0e Aug 10 12:59:50 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:51 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7181d5dc-bb67-4c6b-9f70-e0d163c86c2b tempest-ProjectReaderTests-1477261192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4ac203c8-a5a7-4bba-b774-ead251966c0e" returned: 0 in 0.358s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7181d5dc-bb67-4c6b-9f70-e0d163c86c2b tempest-ProjectReaderTests-1477261192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4ac203c8-a5a7-4bba-b774-ead251966c0e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:51 devstack sudo[104583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4ac203c8-a5a7-4bba-b774-ead251966c0e Aug 10 12:59:51 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:51 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7181d5dc-bb67-4c6b-9f70-e0d163c86c2b tempest-ProjectReaderTests-1477261192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4ac203c8-a5a7-4bba-b774-ead251966c0e" returned: 0 in 0.249s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:51 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7181d5dc-bb67-4c6b-9f70-e0d163c86c2b tempest-ProjectReaderTests-1477261192 None] Lock "cinder-quobyte-4ac203c8-a5a7-4bba-b774-ead251966c0e" released by "delete_volume" :: held 0.646s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:59:51 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-7181d5dc-bb67-4c6b-9f70-e0d163c86c2b tempest-ProjectReaderTests-1477261192 None] Created reservations ['b0289be2-9134-4459-9a3d-7d2e620852dc', 'c314afac-d246-4a43-8257-5545bb76fbf6', 'a08672df-47f2-4d2d-b283-a4e642db6072', 'de275ef3-21f6-4cec-9ebc-187013e812f8'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 12:59:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7181d5dc-bb67-4c6b-9f70-e0d163c86c2b tempest-ProjectReaderTests-1477261192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7181d5dc-bb67-4c6b-9f70-e0d163c86c2b tempest-ProjectReaderTests-1477261192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:51 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-7181d5dc-bb67-4c6b-9f70-e0d163c86c2b tempest-ProjectReaderTests-1477261192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:59:51 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-7181d5dc-bb67-4c6b-9f70-e0d163c86c2b tempest-ProjectReaderTests-1477261192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:59:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7181d5dc-bb67-4c6b-9f70-e0d163c86c2b tempest-ProjectReaderTests-1477261192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7181d5dc-bb67-4c6b-9f70-e0d163c86c2b tempest-ProjectReaderTests-1477261192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:51 devstack sudo[104586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 12:59:51 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:51 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7181d5dc-bb67-4c6b-9f70-e0d163c86c2b tempest-ProjectReaderTests-1477261192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.242s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:51 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-7181d5dc-bb67-4c6b-9f70-e0d163c86c2b tempest-ProjectReaderTests-1477261192 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 12:59:51 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-7181d5dc-bb67-4c6b-9f70-e0d163c86c2b tempest-ProjectReaderTests-1477261192 None] Deleted volume successfully. Aug 10 12:59:51 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7181d5dc-bb67-4c6b-9f70-e0d163c86c2b tempest-ProjectReaderTests-1477261192 None] Lock "cinder-4ac203c8-a5a7-4bba-b774-ead251966c0e-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 12:59:59 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e454a39-e6a1-4bdf-bf06-689831c06f54 tempest-ProjectReaderTests-964479947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 12:59:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5e454a39-e6a1-4bdf-bf06-689831c06f54 tempest-ProjectReaderTests-964479947 None] Flow 'volume_create_manager' (da9c74fb-302e-42ad-9193-ab9e3e74f35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 12:59:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5e454a39-e6a1-4bdf-bf06-689831c06f54 tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73eb69cc-b3fc-4d56-aa8e-007d5d5500f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5e454a39-e6a1-4bdf-bf06-689831c06f54 tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73eb69cc-b3fc-4d56-aa8e-007d5d5500f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1159277588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff2eef27-ba99-4963-a44f-195900a3dbad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b44ba6a8564f678e13416cfffbb5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:59:59Z,use_quota=True,user_id='19dc291876bf4af6a07e80320690b3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5e454a39-e6a1-4bdf-bf06-689831c06f54 tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdee14db-d237-40f7-9f3b-b741398e825a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5e454a39-e6a1-4bdf-bf06-689831c06f54 tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdee14db-d237-40f7-9f3b-b741398e825a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5e454a39-e6a1-4bdf-bf06-689831c06f54 tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83b789c3-7119-41cd-b6fe-f33794e2f6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5e454a39-e6a1-4bdf-bf06-689831c06f54 tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83b789c3-7119-41cd-b6fe-f33794e2f6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff2eef27-ba99-4963-a44f-195900a3dbad', 'volume_name': 'volume-ff2eef27-ba99-4963-a44f-195900a3dbad', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5e454a39-e6a1-4bdf-bf06-689831c06f54 tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4fdf144-11d4-4139-965a-8649fd74764d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5e454a39-e6a1-4bdf-bf06-689831c06f54 tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4fdf144-11d4-4139-965a-8649fd74764d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 12:59:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5e454a39-e6a1-4bdf-bf06-689831c06f54 tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46541529-a29d-4c06-a634-713615deb1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 12:59:59 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-5e454a39-e6a1-4bdf-bf06-689831c06f54 tempest-ProjectReaderTests-964479947 None] Volume ff2eef27-ba99-4963-a44f-195900a3dbad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff2eef27-ba99-4963-a44f-195900a3dbad', 'volume_size': 1} Aug 10 12:59:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5e454a39-e6a1-4bdf-bf06-689831c06f54 tempest-ProjectReaderTests-964479947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5e454a39-e6a1-4bdf-bf06-689831c06f54 tempest-ProjectReaderTests-964479947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-5e454a39-e6a1-4bdf-bf06-689831c06f54 tempest-ProjectReaderTests-964479947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T10:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1159277588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff2eef27-ba99-4963-a44f-195900a3dbad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b44ba6a8564f678e13416cfffbb5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T10:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T10:59:59Z,use_quota=True,user_id='19dc291876bf4af6a07e80320690b3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 12:59:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-5e454a39-e6a1-4bdf-bf06-689831c06f54 tempest-ProjectReaderTests-964479947 None] Creating volume ff2eef27-ba99-4963-a44f-195900a3dbad {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 12:59:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5e454a39-e6a1-4bdf-bf06-689831c06f54 tempest-ProjectReaderTests-964479947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 12:59:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5e454a39-e6a1-4bdf-bf06-689831c06f54 tempest-ProjectReaderTests-964479947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 12:59:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-5e454a39-e6a1-4bdf-bf06-689831c06f54 tempest-ProjectReaderTests-964479947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 12:59:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-5e454a39-e6a1-4bdf-bf06-689831c06f54 tempest-ProjectReaderTests-964479947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 12:59:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5e454a39-e6a1-4bdf-bf06-689831c06f54 tempest-ProjectReaderTests-964479947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-5e454a39-e6a1-4bdf-bf06-689831c06f54 tempest-ProjectReaderTests-964479947 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 12:59:59 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-5e454a39-e6a1-4bdf-bf06-689831c06f54 tempest-ProjectReaderTests-964479947 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 12:59:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5e454a39-e6a1-4bdf-bf06-689831c06f54 tempest-ProjectReaderTests-964479947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff2eef27-ba99-4963-a44f-195900a3dbad 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:59 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff2eef27-ba99-4963-a44f-195900a3dbad 1073741824 Aug 10 12:59:59 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:59 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5e454a39-e6a1-4bdf-bf06-689831c06f54 tempest-ProjectReaderTests-964479947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff2eef27-ba99-4963-a44f-195900a3dbad 1073741824" returned: 0 in 0.407s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5e454a39-e6a1-4bdf-bf06-689831c06f54 tempest-ProjectReaderTests-964479947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff2eef27-ba99-4963-a44f-195900a3dbad {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 12:59:59 devstack sudo[104598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff2eef27-ba99-4963-a44f-195900a3dbad Aug 10 12:59:59 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 12:59:59 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root Aug 10 12:59:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5e454a39-e6a1-4bdf-bf06-689831c06f54 tempest-ProjectReaderTests-964479947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff2eef27-ba99-4963-a44f-195900a3dbad" returned: 0 in 0.231s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 12:59:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-5e454a39-e6a1-4bdf-bf06-689831c06f54 tempest-ProjectReaderTests-964479947 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 12:59:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5e454a39-e6a1-4bdf-bf06-689831c06f54 tempest-ProjectReaderTests-964479947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 12:59:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5e454a39-e6a1-4bdf-bf06-689831c06f54 tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46541529-a29d-4c06-a634-713615deb1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff2eef27-ba99-4963-a44f-195900a3dbad', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:00:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5e454a39-e6a1-4bdf-bf06-689831c06f54 tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed5da4c8-f440-4aed-a133-2c05d9210da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:00:00 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-5e454a39-e6a1-4bdf-bf06-689831c06f54 tempest-ProjectReaderTests-964479947 None] Volume volume-ff2eef27-ba99-4963-a44f-195900a3dbad (ff2eef27-ba99-4963-a44f-195900a3dbad): created successfully Aug 10 13:00:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5e454a39-e6a1-4bdf-bf06-689831c06f54 tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed5da4c8-f440-4aed-a133-2c05d9210da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:00:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5e454a39-e6a1-4bdf-bf06-689831c06f54 tempest-ProjectReaderTests-964479947 None] Flow 'volume_create_manager' (da9c74fb-302e-42ad-9193-ab9e3e74f35b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:00:00 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-5e454a39-e6a1-4bdf-bf06-689831c06f54 tempest-ProjectReaderTests-964479947 None] Created volume successfully. Aug 10 13:00:00 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-fb2f245f-aa8f-4e6c-b607-01b7e0bd55d6 tempest-ProjectReaderTests-964479947 None] Acquiring lock "cinder-ff2eef27-ba99-4963-a44f-195900a3dbad-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:00:00 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-fb2f245f-aa8f-4e6c-b607-01b7e0bd55d6 tempest-ProjectReaderTests-964479947 None] Lock "cinder-ff2eef27-ba99-4963-a44f-195900a3dbad-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:00:00 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-fb2f245f-aa8f-4e6c-b607-01b7e0bd55d6 tempest-ProjectReaderTests-964479947 None] Acquiring lock "cinder-quobyte-ff2eef27-ba99-4963-a44f-195900a3dbad" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:00:00 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-fb2f245f-aa8f-4e6c-b607-01b7e0bd55d6 tempest-ProjectReaderTests-964479947 None] Lock "cinder-quobyte-ff2eef27-ba99-4963-a44f-195900a3dbad" acquired by "delete_volume" :: waited 0.015s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:00:00 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[526bc224-5d14-47e5-8043-738c58c25aa1]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:00:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fb2f245f-aa8f-4e6c-b607-01b7e0bd55d6 tempest-ProjectReaderTests-964479947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff2eef27-ba99-4963-a44f-195900a3dbad {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:00 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff2eef27-ba99-4963-a44f-195900a3dbad Aug 10 13:00:00 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:00 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fb2f245f-aa8f-4e6c-b607-01b7e0bd55d6 tempest-ProjectReaderTests-964479947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff2eef27-ba99-4963-a44f-195900a3dbad" returned: 0 in 0.345s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fb2f245f-aa8f-4e6c-b607-01b7e0bd55d6 tempest-ProjectReaderTests-964479947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff2eef27-ba99-4963-a44f-195900a3dbad {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:00 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff2eef27-ba99-4963-a44f-195900a3dbad Aug 10 13:00:00 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:01 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fb2f245f-aa8f-4e6c-b607-01b7e0bd55d6 tempest-ProjectReaderTests-964479947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff2eef27-ba99-4963-a44f-195900a3dbad" returned: 0 in 0.238s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:01 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-fb2f245f-aa8f-4e6c-b607-01b7e0bd55d6 tempest-ProjectReaderTests-964479947 None] Lock "cinder-quobyte-ff2eef27-ba99-4963-a44f-195900a3dbad" released by "delete_volume" :: held 0.621s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:00:01 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-fb2f245f-aa8f-4e6c-b607-01b7e0bd55d6 tempest-ProjectReaderTests-964479947 None] Created reservations ['704121b2-06b1-4280-be2e-94c4a47900bc', '2697a2f0-c60e-4afc-9189-56b8dc707b1d', 'c668fcc6-4437-4d91-9f1d-8cee4cc0ccee', 'cb0c82ba-fddf-438b-bde1-61646860d34e'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:00:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-fb2f245f-aa8f-4e6c-b607-01b7e0bd55d6 tempest-ProjectReaderTests-964479947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:00:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-fb2f245f-aa8f-4e6c-b607-01b7e0bd55d6 tempest-ProjectReaderTests-964479947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:00:01 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-fb2f245f-aa8f-4e6c-b607-01b7e0bd55d6 tempest-ProjectReaderTests-964479947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:00:01 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-fb2f245f-aa8f-4e6c-b607-01b7e0bd55d6 tempest-ProjectReaderTests-964479947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:00:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-fb2f245f-aa8f-4e6c-b607-01b7e0bd55d6 tempest-ProjectReaderTests-964479947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:00:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fb2f245f-aa8f-4e6c-b607-01b7e0bd55d6 tempest-ProjectReaderTests-964479947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:01 devstack sudo[104611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:00:01 devstack sudo[104611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:01 devstack sudo[104611]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fb2f245f-aa8f-4e6c-b607-01b7e0bd55d6 tempest-ProjectReaderTests-964479947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.248s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:01 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-fb2f245f-aa8f-4e6c-b607-01b7e0bd55d6 tempest-ProjectReaderTests-964479947 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:00:01 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-fb2f245f-aa8f-4e6c-b607-01b7e0bd55d6 tempest-ProjectReaderTests-964479947 None] Deleted volume successfully. Aug 10 13:00:01 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-fb2f245f-aa8f-4e6c-b607-01b7e0bd55d6 tempest-ProjectReaderTests-964479947 None] Lock "cinder-ff2eef27-ba99-4963-a44f-195900a3dbad-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:00:01 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4068363-7410-438a-a384-a4acec3e81c8 tempest-ProjectReaderTests-964479947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:00:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b4068363-7410-438a-a384-a4acec3e81c8 tempest-ProjectReaderTests-964479947 None] Flow 'volume_create_manager' (1c8e1752-0e22-4570-9ad2-4cc99d54b2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:00:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b4068363-7410-438a-a384-a4acec3e81c8 tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be7577f5-90e1-473b-90ca-bf4406363b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:00:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b4068363-7410-438a-a384-a4acec3e81c8 tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be7577f5-90e1-473b-90ca-bf4406363b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-819282680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c932c23e-1283-45ee-b938-c94c10bfecb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b44ba6a8564f678e13416cfffbb5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:00:02Z,use_quota=True,user_id='19dc291876bf4af6a07e80320690b3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:00:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b4068363-7410-438a-a384-a4acec3e81c8 tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43704eaa-8615-4101-b4dc-d1e10df15a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:00:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b4068363-7410-438a-a384-a4acec3e81c8 tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43704eaa-8615-4101-b4dc-d1e10df15a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:00:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b4068363-7410-438a-a384-a4acec3e81c8 tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b22e5d5-23db-4658-b7dd-78214719cfd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:00:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b4068363-7410-438a-a384-a4acec3e81c8 tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b22e5d5-23db-4658-b7dd-78214719cfd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c932c23e-1283-45ee-b938-c94c10bfecb2', 'volume_name': 'volume-c932c23e-1283-45ee-b938-c94c10bfecb2', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:00:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b4068363-7410-438a-a384-a4acec3e81c8 tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1e40c46-bdef-435d-91d7-3b51368b914c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:00:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b4068363-7410-438a-a384-a4acec3e81c8 tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1e40c46-bdef-435d-91d7-3b51368b914c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:00:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b4068363-7410-438a-a384-a4acec3e81c8 tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99a22952-ca63-4870-b9f8-8b39c071b544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:00:02 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-b4068363-7410-438a-a384-a4acec3e81c8 tempest-ProjectReaderTests-964479947 None] Volume c932c23e-1283-45ee-b938-c94c10bfecb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c932c23e-1283-45ee-b938-c94c10bfecb2', 'volume_size': 1} Aug 10 13:00:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b4068363-7410-438a-a384-a4acec3e81c8 tempest-ProjectReaderTests-964479947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:00:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b4068363-7410-438a-a384-a4acec3e81c8 tempest-ProjectReaderTests-964479947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:00:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b4068363-7410-438a-a384-a4acec3e81c8 tempest-ProjectReaderTests-964479947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-819282680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c932c23e-1283-45ee-b938-c94c10bfecb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b44ba6a8564f678e13416cfffbb5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:00:02Z,use_quota=True,user_id='19dc291876bf4af6a07e80320690b3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:00:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-b4068363-7410-438a-a384-a4acec3e81c8 tempest-ProjectReaderTests-964479947 None] Creating volume c932c23e-1283-45ee-b938-c94c10bfecb2 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:00:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b4068363-7410-438a-a384-a4acec3e81c8 tempest-ProjectReaderTests-964479947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:00:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b4068363-7410-438a-a384-a4acec3e81c8 tempest-ProjectReaderTests-964479947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:00:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b4068363-7410-438a-a384-a4acec3e81c8 tempest-ProjectReaderTests-964479947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:00:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b4068363-7410-438a-a384-a4acec3e81c8 tempest-ProjectReaderTests-964479947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:00:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b4068363-7410-438a-a384-a4acec3e81c8 tempest-ProjectReaderTests-964479947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:00:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b4068363-7410-438a-a384-a4acec3e81c8 tempest-ProjectReaderTests-964479947 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:00:02 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-b4068363-7410-438a-a384-a4acec3e81c8 tempest-ProjectReaderTests-964479947 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:00:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b4068363-7410-438a-a384-a4acec3e81c8 tempest-ProjectReaderTests-964479947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c932c23e-1283-45ee-b938-c94c10bfecb2 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:02 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c932c23e-1283-45ee-b938-c94c10bfecb2 1073741824 Aug 10 13:00:02 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:02 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b4068363-7410-438a-a384-a4acec3e81c8 tempest-ProjectReaderTests-964479947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c932c23e-1283-45ee-b938-c94c10bfecb2 1073741824" returned: 0 in 0.406s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b4068363-7410-438a-a384-a4acec3e81c8 tempest-ProjectReaderTests-964479947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c932c23e-1283-45ee-b938-c94c10bfecb2 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:02 devstack sudo[104620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c932c23e-1283-45ee-b938-c94c10bfecb2 Aug 10 13:00:02 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:02 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b4068363-7410-438a-a384-a4acec3e81c8 tempest-ProjectReaderTests-964479947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c932c23e-1283-45ee-b938-c94c10bfecb2" returned: 0 in 0.237s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b4068363-7410-438a-a384-a4acec3e81c8 tempest-ProjectReaderTests-964479947 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:00:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b4068363-7410-438a-a384-a4acec3e81c8 tempest-ProjectReaderTests-964479947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:00:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b4068363-7410-438a-a384-a4acec3e81c8 tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99a22952-ca63-4870-b9f8-8b39c071b544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c932c23e-1283-45ee-b938-c94c10bfecb2', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:00:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b4068363-7410-438a-a384-a4acec3e81c8 tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (800c06d1-49aa-420c-9345-e68fc59bdab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:00:02 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-b4068363-7410-438a-a384-a4acec3e81c8 tempest-ProjectReaderTests-964479947 None] Volume volume-c932c23e-1283-45ee-b938-c94c10bfecb2 (c932c23e-1283-45ee-b938-c94c10bfecb2): created successfully Aug 10 13:00:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b4068363-7410-438a-a384-a4acec3e81c8 tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (800c06d1-49aa-420c-9345-e68fc59bdab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:00:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b4068363-7410-438a-a384-a4acec3e81c8 tempest-ProjectReaderTests-964479947 None] Flow 'volume_create_manager' (1c8e1752-0e22-4570-9ad2-4cc99d54b2a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:00:02 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-b4068363-7410-438a-a384-a4acec3e81c8 tempest-ProjectReaderTests-964479947 None] Created volume successfully. Aug 10 13:00:03 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-42d5b3e7-5615-4554-87b9-bb4bf853e78e tempest-ProjectReaderTests-964479947 None] Acquiring lock "cinder-c932c23e-1283-45ee-b938-c94c10bfecb2-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:00:03 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-42d5b3e7-5615-4554-87b9-bb4bf853e78e tempest-ProjectReaderTests-964479947 None] Lock "cinder-c932c23e-1283-45ee-b938-c94c10bfecb2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:00:03 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-42d5b3e7-5615-4554-87b9-bb4bf853e78e tempest-ProjectReaderTests-964479947 None] Acquiring lock "cinder-quobyte-c932c23e-1283-45ee-b938-c94c10bfecb2" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:00:03 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-42d5b3e7-5615-4554-87b9-bb4bf853e78e tempest-ProjectReaderTests-964479947 None] Lock "cinder-quobyte-c932c23e-1283-45ee-b938-c94c10bfecb2" acquired by "delete_volume" :: waited 0.015s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:00:03 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fa2363-9d5b-4d57-b2ec-960ff8e0bfb8]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:00:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-42d5b3e7-5615-4554-87b9-bb4bf853e78e tempest-ProjectReaderTests-964479947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c932c23e-1283-45ee-b938-c94c10bfecb2 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:03 devstack sudo[104623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c932c23e-1283-45ee-b938-c94c10bfecb2 Aug 10 13:00:03 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:03 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-42d5b3e7-5615-4554-87b9-bb4bf853e78e tempest-ProjectReaderTests-964479947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c932c23e-1283-45ee-b938-c94c10bfecb2" returned: 0 in 0.380s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-42d5b3e7-5615-4554-87b9-bb4bf853e78e tempest-ProjectReaderTests-964479947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c932c23e-1283-45ee-b938-c94c10bfecb2 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:03 devstack sudo[104633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c932c23e-1283-45ee-b938-c94c10bfecb2 Aug 10 13:00:03 devstack sudo[104633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:03 devstack sudo[104633]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-42d5b3e7-5615-4554-87b9-bb4bf853e78e tempest-ProjectReaderTests-964479947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c932c23e-1283-45ee-b938-c94c10bfecb2" returned: 0 in 0.264s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:03 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-42d5b3e7-5615-4554-87b9-bb4bf853e78e tempest-ProjectReaderTests-964479947 None] Lock "cinder-quobyte-c932c23e-1283-45ee-b938-c94c10bfecb2" released by "delete_volume" :: held 0.684s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:00:03 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-42d5b3e7-5615-4554-87b9-bb4bf853e78e tempest-ProjectReaderTests-964479947 None] Created reservations ['f1144421-1678-4ab3-86cd-3919e9375d3c', 'f0696e98-5cc9-4089-92c1-99fc1f983ac6', 'fb7ddabe-5a8c-4bb5-ad7e-8fba2bfd6ba3', 'bd057fe7-81f9-4b2f-b880-1c4d2e577f66'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:00:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-42d5b3e7-5615-4554-87b9-bb4bf853e78e tempest-ProjectReaderTests-964479947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:00:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-42d5b3e7-5615-4554-87b9-bb4bf853e78e tempest-ProjectReaderTests-964479947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:00:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-42d5b3e7-5615-4554-87b9-bb4bf853e78e tempest-ProjectReaderTests-964479947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:00:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-42d5b3e7-5615-4554-87b9-bb4bf853e78e tempest-ProjectReaderTests-964479947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:00:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-42d5b3e7-5615-4554-87b9-bb4bf853e78e tempest-ProjectReaderTests-964479947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:00:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-42d5b3e7-5615-4554-87b9-bb4bf853e78e tempest-ProjectReaderTests-964479947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:03 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 13:00:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:00:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:00:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:00:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:00:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:00:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:03 devstack sudo[104639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:00:03 devstack sudo[104639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:03 devstack sudo[104640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:00:03 devstack sudo[104640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:04 devstack sudo[104640]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.296s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:04 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:00:04 devstack sudo[104639]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:04 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager._thread_info {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 13:00:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread count: 28 {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 13:00:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread info: [<_MainThread(MainThread, started 130607683133568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Aug 10 13:00:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-42d5b3e7-5615-4554-87b9-bb4bf853e78e tempest-ProjectReaderTests-964479947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.331s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:04 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-42d5b3e7-5615-4554-87b9-bb4bf853e78e tempest-ProjectReaderTests-964479947 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:00:04 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-42d5b3e7-5615-4554-87b9-bb4bf853e78e tempest-ProjectReaderTests-964479947 None] Deleted volume successfully. Aug 10 13:00:04 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-42d5b3e7-5615-4554-87b9-bb4bf853e78e tempest-ProjectReaderTests-964479947 None] Lock "cinder-c932c23e-1283-45ee-b938-c94c10bfecb2-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:00:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-0c232ecd-c80c-4b05-b12e-5cd6b32de56e req-358d8ec8-dac2-48f0-9a41-56220b45c0b6 tempest-TestStampPattern-1500701631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:00:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-0c232ecd-c80c-4b05-b12e-5cd6b32de56e req-358d8ec8-dac2-48f0-9a41-56220b45c0b6 tempest-TestStampPattern-1500701631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:00:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-0c232ecd-c80c-4b05-b12e-5cd6b32de56e req-358d8ec8-dac2-48f0-9a41-56220b45c0b6 tempest-TestStampPattern-1500701631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:00:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-0c232ecd-c80c-4b05-b12e-5cd6b32de56e req-358d8ec8-dac2-48f0-9a41-56220b45c0b6 tempest-TestStampPattern-1500701631 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d', 'name': 'volume-2b14e86d-5868-485c-bb11-4487eb77ebf3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '06fd5024-7432-4ace-8765-6335d2d57daa', 'enforce_multipath': True} {{(pid=89096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Aug 10 13:00:04 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-0c232ecd-c80c-4b05-b12e-5cd6b32de56e req-358d8ec8-dac2-48f0-9a41-56220b45c0b6 tempest-TestStampPattern-1500701631 None] attachment_update completed successfully. Aug 10 13:00:04 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1cb6264-e09b-4242-989e-a815bb983982 tempest-ProjectReaderTests-964479947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:00:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b1cb6264-e09b-4242-989e-a815bb983982 tempest-ProjectReaderTests-964479947 None] Flow 'volume_create_manager' (69957460-7665-4231-ad1e-ba4ba86bf50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:00:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b1cb6264-e09b-4242-989e-a815bb983982 tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c0d6e4f-faed-4d3e-86cc-2c01be130939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:00:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b1cb6264-e09b-4242-989e-a815bb983982 tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c0d6e4f-faed-4d3e-86cc-2c01be130939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1019103361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db31640b-c106-45d3-b7ba-4e0f489dba04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b44ba6a8564f678e13416cfffbb5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:00:05Z,use_quota=True,user_id='19dc291876bf4af6a07e80320690b3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:00:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b1cb6264-e09b-4242-989e-a815bb983982 tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ec64356-fb5a-4454-b036-8cb743bd6176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:00:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b1cb6264-e09b-4242-989e-a815bb983982 tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ec64356-fb5a-4454-b036-8cb743bd6176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:00:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b1cb6264-e09b-4242-989e-a815bb983982 tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (228cebd4-4929-4f64-95c8-db4863fc09dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:00:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b1cb6264-e09b-4242-989e-a815bb983982 tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (228cebd4-4929-4f64-95c8-db4863fc09dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db31640b-c106-45d3-b7ba-4e0f489dba04', 'volume_name': 'volume-db31640b-c106-45d3-b7ba-4e0f489dba04', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:00:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b1cb6264-e09b-4242-989e-a815bb983982 tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd581938-3dc0-49bb-a0bc-2508fb1eeea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:00:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b1cb6264-e09b-4242-989e-a815bb983982 tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd581938-3dc0-49bb-a0bc-2508fb1eeea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:00:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b1cb6264-e09b-4242-989e-a815bb983982 tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72b9a78a-fee9-4960-a823-5919c86600a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:00:04 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-b1cb6264-e09b-4242-989e-a815bb983982 tempest-ProjectReaderTests-964479947 None] Volume db31640b-c106-45d3-b7ba-4e0f489dba04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db31640b-c106-45d3-b7ba-4e0f489dba04', 'volume_size': 1} Aug 10 13:00:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b1cb6264-e09b-4242-989e-a815bb983982 tempest-ProjectReaderTests-964479947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:00:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b1cb6264-e09b-4242-989e-a815bb983982 tempest-ProjectReaderTests-964479947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:00:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b1cb6264-e09b-4242-989e-a815bb983982 tempest-ProjectReaderTests-964479947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1019103361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db31640b-c106-45d3-b7ba-4e0f489dba04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b44ba6a8564f678e13416cfffbb5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:00:05Z,use_quota=True,user_id='19dc291876bf4af6a07e80320690b3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:00:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-b1cb6264-e09b-4242-989e-a815bb983982 tempest-ProjectReaderTests-964479947 None] Creating volume db31640b-c106-45d3-b7ba-4e0f489dba04 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:00:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b1cb6264-e09b-4242-989e-a815bb983982 tempest-ProjectReaderTests-964479947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:00:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b1cb6264-e09b-4242-989e-a815bb983982 tempest-ProjectReaderTests-964479947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:00:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b1cb6264-e09b-4242-989e-a815bb983982 tempest-ProjectReaderTests-964479947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:00:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b1cb6264-e09b-4242-989e-a815bb983982 tempest-ProjectReaderTests-964479947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:00:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b1cb6264-e09b-4242-989e-a815bb983982 tempest-ProjectReaderTests-964479947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:00:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b1cb6264-e09b-4242-989e-a815bb983982 tempest-ProjectReaderTests-964479947 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:00:04 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-b1cb6264-e09b-4242-989e-a815bb983982 tempest-ProjectReaderTests-964479947 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:00:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b1cb6264-e09b-4242-989e-a815bb983982 tempest-ProjectReaderTests-964479947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-db31640b-c106-45d3-b7ba-4e0f489dba04 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:04 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-db31640b-c106-45d3-b7ba-4e0f489dba04 1073741824 Aug 10 13:00:04 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:05 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b1cb6264-e09b-4242-989e-a815bb983982 tempest-ProjectReaderTests-964479947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-db31640b-c106-45d3-b7ba-4e0f489dba04 1073741824" returned: 0 in 0.474s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b1cb6264-e09b-4242-989e-a815bb983982 tempest-ProjectReaderTests-964479947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-db31640b-c106-45d3-b7ba-4e0f489dba04 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:05 devstack sudo[104667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-db31640b-c106-45d3-b7ba-4e0f489dba04 Aug 10 13:00:05 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:05 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b1cb6264-e09b-4242-989e-a815bb983982 tempest-ProjectReaderTests-964479947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-db31640b-c106-45d3-b7ba-4e0f489dba04" returned: 0 in 0.249s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b1cb6264-e09b-4242-989e-a815bb983982 tempest-ProjectReaderTests-964479947 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:00:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b1cb6264-e09b-4242-989e-a815bb983982 tempest-ProjectReaderTests-964479947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:00:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b1cb6264-e09b-4242-989e-a815bb983982 tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72b9a78a-fee9-4960-a823-5919c86600a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db31640b-c106-45d3-b7ba-4e0f489dba04', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:00:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b1cb6264-e09b-4242-989e-a815bb983982 tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bcbce39-b95c-47ef-b427-e941a5db783f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:00:05 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-b1cb6264-e09b-4242-989e-a815bb983982 tempest-ProjectReaderTests-964479947 None] Volume volume-db31640b-c106-45d3-b7ba-4e0f489dba04 (db31640b-c106-45d3-b7ba-4e0f489dba04): created successfully Aug 10 13:00:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b1cb6264-e09b-4242-989e-a815bb983982 tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bcbce39-b95c-47ef-b427-e941a5db783f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:00:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b1cb6264-e09b-4242-989e-a815bb983982 tempest-ProjectReaderTests-964479947 None] Flow 'volume_create_manager' (69957460-7665-4231-ad1e-ba4ba86bf50d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:00:05 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-b1cb6264-e09b-4242-989e-a815bb983982 tempest-ProjectReaderTests-964479947 None] Created volume successfully. Aug 10 13:00:05 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-40281ced-4a58-4a9a-b560-ac6e312ecb9d tempest-ProjectReaderTests-964479947 None] Acquiring lock "cinder-db31640b-c106-45d3-b7ba-4e0f489dba04-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:00:05 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-40281ced-4a58-4a9a-b560-ac6e312ecb9d tempest-ProjectReaderTests-964479947 None] Lock "cinder-db31640b-c106-45d3-b7ba-4e0f489dba04-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:00:05 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-40281ced-4a58-4a9a-b560-ac6e312ecb9d tempest-ProjectReaderTests-964479947 None] Acquiring lock "cinder-quobyte-db31640b-c106-45d3-b7ba-4e0f489dba04" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:00:05 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-40281ced-4a58-4a9a-b560-ac6e312ecb9d tempest-ProjectReaderTests-964479947 None] Lock "cinder-quobyte-db31640b-c106-45d3-b7ba-4e0f489dba04" acquired by "delete_volume" :: waited 0.015s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:00:05 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac503cf-e46d-4411-8c06-fa33846ef01c]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:00:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-40281ced-4a58-4a9a-b560-ac6e312ecb9d tempest-ProjectReaderTests-964479947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-db31640b-c106-45d3-b7ba-4e0f489dba04 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:05 devstack sudo[104670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-db31640b-c106-45d3-b7ba-4e0f489dba04 Aug 10 13:00:05 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:06 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-40281ced-4a58-4a9a-b560-ac6e312ecb9d tempest-ProjectReaderTests-964479947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-db31640b-c106-45d3-b7ba-4e0f489dba04" returned: 0 in 0.354s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-40281ced-4a58-4a9a-b560-ac6e312ecb9d tempest-ProjectReaderTests-964479947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-db31640b-c106-45d3-b7ba-4e0f489dba04 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:06 devstack sudo[104677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-db31640b-c106-45d3-b7ba-4e0f489dba04 Aug 10 13:00:06 devstack sudo[104677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:06 devstack sudo[104677]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-40281ced-4a58-4a9a-b560-ac6e312ecb9d tempest-ProjectReaderTests-964479947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-db31640b-c106-45d3-b7ba-4e0f489dba04" returned: 0 in 0.248s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:06 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-40281ced-4a58-4a9a-b560-ac6e312ecb9d tempest-ProjectReaderTests-964479947 None] Lock "cinder-quobyte-db31640b-c106-45d3-b7ba-4e0f489dba04" released by "delete_volume" :: held 0.639s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:00:06 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-40281ced-4a58-4a9a-b560-ac6e312ecb9d tempest-ProjectReaderTests-964479947 None] Created reservations ['32e691c8-6ece-4d41-8479-f707ed1d72d3', '714e5135-1867-4235-bfdd-2da5c6f86852', '78995522-ab45-4180-b530-13fb9798eaad', '36dcf14e-1ba5-4657-897f-c805833e5f3c'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:00:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-40281ced-4a58-4a9a-b560-ac6e312ecb9d tempest-ProjectReaderTests-964479947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:00:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-40281ced-4a58-4a9a-b560-ac6e312ecb9d tempest-ProjectReaderTests-964479947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:00:06 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-40281ced-4a58-4a9a-b560-ac6e312ecb9d tempest-ProjectReaderTests-964479947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:00:06 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-40281ced-4a58-4a9a-b560-ac6e312ecb9d tempest-ProjectReaderTests-964479947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:00:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-40281ced-4a58-4a9a-b560-ac6e312ecb9d tempest-ProjectReaderTests-964479947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:00:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-40281ced-4a58-4a9a-b560-ac6e312ecb9d tempest-ProjectReaderTests-964479947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:06 devstack sudo[104688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:00:06 devstack sudo[104688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:06 devstack sudo[104688]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-40281ced-4a58-4a9a-b560-ac6e312ecb9d tempest-ProjectReaderTests-964479947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.249s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:06 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-40281ced-4a58-4a9a-b560-ac6e312ecb9d tempest-ProjectReaderTests-964479947 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:00:06 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-40281ced-4a58-4a9a-b560-ac6e312ecb9d tempest-ProjectReaderTests-964479947 None] Deleted volume successfully. Aug 10 13:00:06 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-40281ced-4a58-4a9a-b560-ac6e312ecb9d tempest-ProjectReaderTests-964479947 None] Lock "cinder-db31640b-c106-45d3-b7ba-4e0f489dba04-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:00:07 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-20f72ea8-4c06-469b-b724-4c078fd9292f tempest-ProjectReaderTests-964479947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:00:07 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-20f72ea8-4c06-469b-b724-4c078fd9292f tempest-ProjectReaderTests-964479947 None] Flow 'volume_create_manager' (0348c40e-cf21-4626-b80d-ecbf397336cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:00:07 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-20f72ea8-4c06-469b-b724-4c078fd9292f tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9797903-63c2-4a8f-89b5-6f54cdf4ad8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:00:07 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-20f72ea8-4c06-469b-b724-4c078fd9292f tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9797903-63c2-4a8f-89b5-6f54cdf4ad8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-575016888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f8e868b-e1b2-4793-a256-928c1840d7cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b44ba6a8564f678e13416cfffbb5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:00:07Z,use_quota=True,user_id='19dc291876bf4af6a07e80320690b3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:00:07 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-20f72ea8-4c06-469b-b724-4c078fd9292f tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fed97095-df3c-446a-b76b-fc584cae6afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:00:07 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-20f72ea8-4c06-469b-b724-4c078fd9292f tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fed97095-df3c-446a-b76b-fc584cae6afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:00:07 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-20f72ea8-4c06-469b-b724-4c078fd9292f tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9a132e1-7416-45a6-b147-34e1d5e9bdee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:00:07 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-20f72ea8-4c06-469b-b724-4c078fd9292f tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9a132e1-7416-45a6-b147-34e1d5e9bdee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f8e868b-e1b2-4793-a256-928c1840d7cf', 'volume_name': 'volume-5f8e868b-e1b2-4793-a256-928c1840d7cf', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:00:07 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-20f72ea8-4c06-469b-b724-4c078fd9292f tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9565a2a6-e36a-4523-9241-82c8211554e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:00:07 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-20f72ea8-4c06-469b-b724-4c078fd9292f tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9565a2a6-e36a-4523-9241-82c8211554e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:00:07 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-20f72ea8-4c06-469b-b724-4c078fd9292f tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a91289e-99a9-4e92-83b0-5a3178436909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:00:07 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-20f72ea8-4c06-469b-b724-4c078fd9292f tempest-ProjectReaderTests-964479947 None] Volume 5f8e868b-e1b2-4793-a256-928c1840d7cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f8e868b-e1b2-4793-a256-928c1840d7cf', 'volume_size': 1} Aug 10 13:00:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-20f72ea8-4c06-469b-b724-4c078fd9292f tempest-ProjectReaderTests-964479947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:00:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-20f72ea8-4c06-469b-b724-4c078fd9292f tempest-ProjectReaderTests-964479947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:00:07 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-20f72ea8-4c06-469b-b724-4c078fd9292f tempest-ProjectReaderTests-964479947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-575016888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f8e868b-e1b2-4793-a256-928c1840d7cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b44ba6a8564f678e13416cfffbb5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:00:07Z,use_quota=True,user_id='19dc291876bf4af6a07e80320690b3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:00:07 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-20f72ea8-4c06-469b-b724-4c078fd9292f tempest-ProjectReaderTests-964479947 None] Creating volume 5f8e868b-e1b2-4793-a256-928c1840d7cf {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:00:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-20f72ea8-4c06-469b-b724-4c078fd9292f tempest-ProjectReaderTests-964479947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:00:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-20f72ea8-4c06-469b-b724-4c078fd9292f tempest-ProjectReaderTests-964479947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:00:07 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-20f72ea8-4c06-469b-b724-4c078fd9292f tempest-ProjectReaderTests-964479947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:00:07 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-20f72ea8-4c06-469b-b724-4c078fd9292f tempest-ProjectReaderTests-964479947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:00:07 devstack sudo[104699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5f8e868b-e1b2-4793-a256-928c1840d7cf 1073741824 Aug 10 13:00:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-20f72ea8-4c06-469b-b724-4c078fd9292f tempest-ProjectReaderTests-964479947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:00:07 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-20f72ea8-4c06-469b-b724-4c078fd9292f tempest-ProjectReaderTests-964479947 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:00:07 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-20f72ea8-4c06-469b-b724-4c078fd9292f tempest-ProjectReaderTests-964479947 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:00:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-20f72ea8-4c06-469b-b724-4c078fd9292f tempest-ProjectReaderTests-964479947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5f8e868b-e1b2-4793-a256-928c1840d7cf 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:07 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:07 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-11d61642-ee7e-4a3d-a2dc-7772c19f6581 req-683dea28-7207-48e0-b520-6d0c544f4529 tempest-TestStampPattern-1500701631 None] Terminate volume connection completed successfully. Aug 10 13:00:07 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-11d61642-ee7e-4a3d-a2dc-7772c19f6581 req-683dea28-7207-48e0-b520-6d0c544f4529 tempest-TestStampPattern-1500701631 None] Deleting attachment 06fd5024-7432-4ace-8765-6335d2d57daa. {{(pid=89096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Aug 10 13:00:07 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-20f72ea8-4c06-469b-b724-4c078fd9292f tempest-ProjectReaderTests-964479947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5f8e868b-e1b2-4793-a256-928c1840d7cf 1073741824" returned: 0 in 0.502s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-20f72ea8-4c06-469b-b724-4c078fd9292f tempest-ProjectReaderTests-964479947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5f8e868b-e1b2-4793-a256-928c1840d7cf {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:08 devstack sudo[104710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5f8e868b-e1b2-4793-a256-928c1840d7cf Aug 10 13:00:08 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:08 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-20f72ea8-4c06-469b-b724-4c078fd9292f tempest-ProjectReaderTests-964479947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5f8e868b-e1b2-4793-a256-928c1840d7cf" returned: 0 in 0.253s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-20f72ea8-4c06-469b-b724-4c078fd9292f tempest-ProjectReaderTests-964479947 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:00:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-20f72ea8-4c06-469b-b724-4c078fd9292f tempest-ProjectReaderTests-964479947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:00:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-20f72ea8-4c06-469b-b724-4c078fd9292f tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a91289e-99a9-4e92-83b0-5a3178436909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f8e868b-e1b2-4793-a256-928c1840d7cf', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:00:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-20f72ea8-4c06-469b-b724-4c078fd9292f tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ca0717-45f1-44e1-9929-d6ba1523f42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:00:08 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-20f72ea8-4c06-469b-b724-4c078fd9292f tempest-ProjectReaderTests-964479947 None] Volume volume-5f8e868b-e1b2-4793-a256-928c1840d7cf (5f8e868b-e1b2-4793-a256-928c1840d7cf): created successfully Aug 10 13:00:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-20f72ea8-4c06-469b-b724-4c078fd9292f tempest-ProjectReaderTests-964479947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ca0717-45f1-44e1-9929-d6ba1523f42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:00:08 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-20f72ea8-4c06-469b-b724-4c078fd9292f tempest-ProjectReaderTests-964479947 None] Flow 'volume_create_manager' (0348c40e-cf21-4626-b80d-ecbf397336cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:00:08 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-20f72ea8-4c06-469b-b724-4c078fd9292f tempest-ProjectReaderTests-964479947 None] Created volume successfully. Aug 10 13:00:09 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d8440541-dcb7-4915-b461-9d0866ae9b20 tempest-ProjectReaderTests-964479947 None] Acquiring lock "cinder-5f8e868b-e1b2-4793-a256-928c1840d7cf-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:00:09 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d8440541-dcb7-4915-b461-9d0866ae9b20 tempest-ProjectReaderTests-964479947 None] Lock "cinder-5f8e868b-e1b2-4793-a256-928c1840d7cf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:00:09 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d8440541-dcb7-4915-b461-9d0866ae9b20 tempest-ProjectReaderTests-964479947 None] Acquiring lock "cinder-quobyte-5f8e868b-e1b2-4793-a256-928c1840d7cf" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:00:09 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d8440541-dcb7-4915-b461-9d0866ae9b20 tempest-ProjectReaderTests-964479947 None] Lock "cinder-quobyte-5f8e868b-e1b2-4793-a256-928c1840d7cf" acquired by "delete_volume" :: waited 0.027s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:00:09 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[87da0524-aa1b-4815-9ee2-92e8edd6d368]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:00:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d8440541-dcb7-4915-b461-9d0866ae9b20 tempest-ProjectReaderTests-964479947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5f8e868b-e1b2-4793-a256-928c1840d7cf {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:09 devstack sudo[104724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5f8e868b-e1b2-4793-a256-928c1840d7cf Aug 10 13:00:09 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:10 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d8440541-dcb7-4915-b461-9d0866ae9b20 tempest-ProjectReaderTests-964479947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5f8e868b-e1b2-4793-a256-928c1840d7cf" returned: 0 in 0.524s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d8440541-dcb7-4915-b461-9d0866ae9b20 tempest-ProjectReaderTests-964479947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5f8e868b-e1b2-4793-a256-928c1840d7cf {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:10 devstack sudo[104748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5f8e868b-e1b2-4793-a256-928c1840d7cf Aug 10 13:00:10 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:10 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d8440541-dcb7-4915-b461-9d0866ae9b20 tempest-ProjectReaderTests-964479947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5f8e868b-e1b2-4793-a256-928c1840d7cf" returned: 0 in 0.287s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d8440541-dcb7-4915-b461-9d0866ae9b20 tempest-ProjectReaderTests-964479947 None] Lock "cinder-quobyte-5f8e868b-e1b2-4793-a256-928c1840d7cf" released by "delete_volume" :: held 0.861s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:00:10 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-d8440541-dcb7-4915-b461-9d0866ae9b20 tempest-ProjectReaderTests-964479947 None] Created reservations ['55319c15-b270-4c03-976a-f6324f4a8eca', '200460ba-ca37-46c5-aa2f-11bb813f7ef8', '5b50133e-324b-48c7-88e5-84fa2a5ac8c1', '55a379ba-8134-429b-baa2-ac99c698a449'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:00:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d8440541-dcb7-4915-b461-9d0866ae9b20 tempest-ProjectReaderTests-964479947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:00:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d8440541-dcb7-4915-b461-9d0866ae9b20 tempest-ProjectReaderTests-964479947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:00:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-d8440541-dcb7-4915-b461-9d0866ae9b20 tempest-ProjectReaderTests-964479947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:00:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-d8440541-dcb7-4915-b461-9d0866ae9b20 tempest-ProjectReaderTests-964479947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:00:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d8440541-dcb7-4915-b461-9d0866ae9b20 tempest-ProjectReaderTests-964479947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:00:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d8440541-dcb7-4915-b461-9d0866ae9b20 tempest-ProjectReaderTests-964479947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:10 devstack sudo[104752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:00:10 devstack sudo[104752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:10 devstack sudo[104752]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d8440541-dcb7-4915-b461-9d0866ae9b20 tempest-ProjectReaderTests-964479947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.360s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:10 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-d8440541-dcb7-4915-b461-9d0866ae9b20 tempest-ProjectReaderTests-964479947 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:00:10 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-d8440541-dcb7-4915-b461-9d0866ae9b20 tempest-ProjectReaderTests-964479947 None] Deleted volume successfully. Aug 10 13:00:11 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d8440541-dcb7-4915-b461-9d0866ae9b20 tempest-ProjectReaderTests-964479947 None] Lock "cinder-5f8e868b-e1b2-4793-a256-928c1840d7cf-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:00:12 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-9cd7b58b-0bfc-43c6-8427-3a6d81771869 req-e81f1a1a-99ed-4131-a0fe-7ec25b34ffad tempest-AttachVolumeTestJSON-1943572718 None] Terminate volume connection completed successfully. Aug 10 13:00:12 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-9cd7b58b-0bfc-43c6-8427-3a6d81771869 req-e81f1a1a-99ed-4131-a0fe-7ec25b34ffad tempest-AttachVolumeTestJSON-1943572718 None] Deleting attachment 0ee2c2ae-3957-4e8d-91a1-8507de0869ad. {{(pid=89096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Aug 10 13:00:13 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-142cb205-2bf1-4315-952b-1247a90d340b tempest-TestStampPattern-1500701631 None] Acquiring lock "cinder-2b14e86d-5868-485c-bb11-4487eb77ebf3-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:00:13 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-142cb205-2bf1-4315-952b-1247a90d340b tempest-TestStampPattern-1500701631 None] Lock "cinder-2b14e86d-5868-485c-bb11-4487eb77ebf3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:00:13 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-142cb205-2bf1-4315-952b-1247a90d340b tempest-TestStampPattern-1500701631 None] Acquiring lock "cinder-quobyte-2b14e86d-5868-485c-bb11-4487eb77ebf3" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:00:13 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-142cb205-2bf1-4315-952b-1247a90d340b tempest-TestStampPattern-1500701631 None] Lock "cinder-quobyte-2b14e86d-5868-485c-bb11-4487eb77ebf3" acquired by "delete_volume" :: waited 0.018s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:00:13 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f55267-c677-4d9e-a56b-e4b7f846d5e5]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:00:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-142cb205-2bf1-4315-952b-1247a90d340b tempest-TestStampPattern-1500701631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2b14e86d-5868-485c-bb11-4487eb77ebf3 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:13 devstack sudo[104776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2b14e86d-5868-485c-bb11-4487eb77ebf3 Aug 10 13:00:13 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:13 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-142cb205-2bf1-4315-952b-1247a90d340b tempest-TestStampPattern-1500701631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2b14e86d-5868-485c-bb11-4487eb77ebf3" returned: 0 in 0.422s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-142cb205-2bf1-4315-952b-1247a90d340b tempest-TestStampPattern-1500701631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2b14e86d-5868-485c-bb11-4487eb77ebf3 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:13 devstack sudo[104792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2b14e86d-5868-485c-bb11-4487eb77ebf3 Aug 10 13:00:13 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:14 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-142cb205-2bf1-4315-952b-1247a90d340b tempest-TestStampPattern-1500701631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2b14e86d-5868-485c-bb11-4487eb77ebf3" returned: 0 in 0.328s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:14 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-142cb205-2bf1-4315-952b-1247a90d340b tempest-TestStampPattern-1500701631 None] Lock "cinder-quobyte-2b14e86d-5868-485c-bb11-4487eb77ebf3" released by "delete_volume" :: held 0.823s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:00:14 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-142cb205-2bf1-4315-952b-1247a90d340b tempest-TestStampPattern-1500701631 None] Created reservations ['cfb1025c-8454-4462-a713-fe329e202de1', '43ad2be7-5d6b-42e6-a478-04f94107c029', '11251ac9-e516-4b5e-954b-642913ce7975', '3b889cf5-651b-47db-963f-a159d45ae9d8'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:00:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-142cb205-2bf1-4315-952b-1247a90d340b tempest-TestStampPattern-1500701631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:00:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-142cb205-2bf1-4315-952b-1247a90d340b tempest-TestStampPattern-1500701631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:00:14 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-142cb205-2bf1-4315-952b-1247a90d340b tempest-TestStampPattern-1500701631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:00:14 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-142cb205-2bf1-4315-952b-1247a90d340b tempest-TestStampPattern-1500701631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:00:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-142cb205-2bf1-4315-952b-1247a90d340b tempest-TestStampPattern-1500701631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:00:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-142cb205-2bf1-4315-952b-1247a90d340b tempest-TestStampPattern-1500701631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:14 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:00:14 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:14 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-142cb205-2bf1-4315-952b-1247a90d340b tempest-TestStampPattern-1500701631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.378s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:14 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-142cb205-2bf1-4315-952b-1247a90d340b tempest-TestStampPattern-1500701631 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:00:14 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-142cb205-2bf1-4315-952b-1247a90d340b tempest-TestStampPattern-1500701631 None] Deleted volume successfully. Aug 10 13:00:14 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-142cb205-2bf1-4315-952b-1247a90d340b tempest-TestStampPattern-1500701631 None] Lock "cinder-2b14e86d-5868-485c-bb11-4487eb77ebf3-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:00:14 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0163281b-5174-4023-8a11-3bb312f73837 tempest-TestStampPattern-1500701631 None] Acquiring lock "cinder-17c77a8c-61b2-43bf-b709-6ef0e076f747-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:00:15 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0163281b-5174-4023-8a11-3bb312f73837 tempest-TestStampPattern-1500701631 None] Lock "cinder-17c77a8c-61b2-43bf-b709-6ef0e076f747-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:00:15 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0163281b-5174-4023-8a11-3bb312f73837 tempest-TestStampPattern-1500701631 None] Acquiring lock "cinder-quobyte-b21c97ed-d738-4d79-aa6e-0ef6b9826c63" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:00:15 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0163281b-5174-4023-8a11-3bb312f73837 tempest-TestStampPattern-1500701631 None] Lock "cinder-quobyte-b21c97ed-d738-4d79-aa6e-0ef6b9826c63" acquired by "delete_snapshot" :: waited 0.028s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:00:15 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0163281b-5174-4023-8a11-3bb312f73837 tempest-TestStampPattern-1500701631 None] Acquiring lock "cinder-quobyte-17c77a8c-61b2-43bf-b709-6ef0e076f747" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:00:15 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0163281b-5174-4023-8a11-3bb312f73837 tempest-TestStampPattern-1500701631 None] Lock "cinder-quobyte-17c77a8c-61b2-43bf-b709-6ef0e076f747" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:00:15 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-0163281b-5174-4023-8a11-3bb312f73837 tempest-TestStampPattern-1500701631 None] Deleting offline snapshot 17c77a8c-61b2-43bf-b709-6ef0e076f747 of volume b21c97ed-d738-4d79-aa6e-0ef6b9826c63 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 13:00:15 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-0163281b-5174-4023-8a11-3bb312f73837 tempest-TestStampPattern-1500701631 None] snapshot_file for this snap is: volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63.17c77a8c-61b2-43bf-b709-6ef0e076f747 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 13:00:15 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc964d6-87cb-43b2-90ff-34703dadce93]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:00:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0163281b-5174-4023-8a11-3bb312f73837 tempest-TestStampPattern-1500701631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63.17c77a8c-61b2-43bf-b709-6ef0e076f747 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:15 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63.17c77a8c-61b2-43bf-b709-6ef0e076f747 Aug 10 13:00:15 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:15 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0163281b-5174-4023-8a11-3bb312f73837 tempest-TestStampPattern-1500701631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63.17c77a8c-61b2-43bf-b709-6ef0e076f747" returned: 0 in 0.440s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:15 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-0163281b-5174-4023-8a11-3bb312f73837 tempest-TestStampPattern-1500701631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 13:00:15 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3072d24-56df-4db9-94fa-2a7e11a59573]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:00:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0163281b-5174-4023-8a11-3bb312f73837 tempest-TestStampPattern-1500701631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:15 devstack sudo[104805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63 Aug 10 13:00:15 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:16 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0163281b-5174-4023-8a11-3bb312f73837 tempest-TestStampPattern-1500701631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63" returned: 0 in 0.804s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0163281b-5174-4023-8a11-3bb312f73837 tempest-TestStampPattern-1500701631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63.17c77a8c-61b2-43bf-b709-6ef0e076f747 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:16 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63.17c77a8c-61b2-43bf-b709-6ef0e076f747 Aug 10 13:00:16 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:16 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0163281b-5174-4023-8a11-3bb312f73837 tempest-TestStampPattern-1500701631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63.17c77a8c-61b2-43bf-b709-6ef0e076f747" returned: 0 in 0.432s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0163281b-5174-4023-8a11-3bb312f73837 tempest-TestStampPattern-1500701631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63.17c77a8c-61b2-43bf-b709-6ef0e076f747 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:16 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63.17c77a8c-61b2-43bf-b709-6ef0e076f747 Aug 10 13:00:16 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:17 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0163281b-5174-4023-8a11-3bb312f73837 tempest-TestStampPattern-1500701631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63.17c77a8c-61b2-43bf-b709-6ef0e076f747" returned: 0 in 0.405s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:17 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0163281b-5174-4023-8a11-3bb312f73837 tempest-TestStampPattern-1500701631 None] Lock "cinder-quobyte-17c77a8c-61b2-43bf-b709-6ef0e076f747" released by "_delete_snapshot" :: held 2.231s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:00:17 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0163281b-5174-4023-8a11-3bb312f73837 tempest-TestStampPattern-1500701631 None] Lock "cinder-quobyte-b21c97ed-d738-4d79-aa6e-0ef6b9826c63" released by "delete_snapshot" :: held 2.271s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:00:17 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-0163281b-5174-4023-8a11-3bb312f73837 tempest-TestStampPattern-1500701631 None] Created reservations ['e4c51427-611f-4e69-a322-a0e5d0c02816', 'b4f66d0c-c190-45dc-b4c2-c77ef78a6626', 'c4a1a15a-5a21-463c-8d61-e4354376c98e', '64f60bcb-492d-4d0b-bf8a-4157a4fd722f'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:00:17 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-0163281b-5174-4023-8a11-3bb312f73837 tempest-TestStampPattern-1500701631 None] Delete snapshot completed successfully. Aug 10 13:00:17 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0163281b-5174-4023-8a11-3bb312f73837 tempest-TestStampPattern-1500701631 None] Lock "cinder-17c77a8c-61b2-43bf-b709-6ef0e076f747-delete_snapshot" released by "delete_snapshot" :: held 2.606s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:00:23 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8385634a-b71b-450a-b94e-1fa377e8d61b tempest-TestStampPattern-1500701631 None] Acquiring lock "cinder-b21c97ed-d738-4d79-aa6e-0ef6b9826c63-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:00:23 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8385634a-b71b-450a-b94e-1fa377e8d61b tempest-TestStampPattern-1500701631 None] Lock "cinder-b21c97ed-d738-4d79-aa6e-0ef6b9826c63-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:00:23 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8385634a-b71b-450a-b94e-1fa377e8d61b tempest-TestStampPattern-1500701631 None] Acquiring lock "cinder-quobyte-b21c97ed-d738-4d79-aa6e-0ef6b9826c63" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:00:23 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8385634a-b71b-450a-b94e-1fa377e8d61b tempest-TestStampPattern-1500701631 None] Lock "cinder-quobyte-b21c97ed-d738-4d79-aa6e-0ef6b9826c63" acquired by "delete_volume" :: waited 0.031s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:00:23 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c400d8e1-bff2-4af1-85de-3e6048308f1b]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:00:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8385634a-b71b-450a-b94e-1fa377e8d61b tempest-TestStampPattern-1500701631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:23 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63 Aug 10 13:00:23 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:23 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8385634a-b71b-450a-b94e-1fa377e8d61b tempest-TestStampPattern-1500701631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63" returned: 0 in 0.618s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8385634a-b71b-450a-b94e-1fa377e8d61b tempest-TestStampPattern-1500701631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:23 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63 Aug 10 13:00:23 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:24 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8385634a-b71b-450a-b94e-1fa377e8d61b tempest-TestStampPattern-1500701631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b21c97ed-d738-4d79-aa6e-0ef6b9826c63" returned: 0 in 0.339s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:24 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8385634a-b71b-450a-b94e-1fa377e8d61b tempest-TestStampPattern-1500701631 None] Lock "cinder-quobyte-b21c97ed-d738-4d79-aa6e-0ef6b9826c63" released by "delete_volume" :: held 1.045s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:00:24 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-8385634a-b71b-450a-b94e-1fa377e8d61b tempest-TestStampPattern-1500701631 None] Created reservations ['5a0e59aa-d502-4a33-be4a-53382fb4c82d', 'f0e3ba49-09c0-4a1e-b1d8-7a52e5b22b67', '3c2c87ba-d3b8-4ebd-8dd5-1f63ab16ad3c', 'e92319d8-36f6-46ec-b2b6-360d0ba7da5e'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:00:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8385634a-b71b-450a-b94e-1fa377e8d61b tempest-TestStampPattern-1500701631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:00:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8385634a-b71b-450a-b94e-1fa377e8d61b tempest-TestStampPattern-1500701631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:00:24 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8385634a-b71b-450a-b94e-1fa377e8d61b tempest-TestStampPattern-1500701631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:00:24 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8385634a-b71b-450a-b94e-1fa377e8d61b tempest-TestStampPattern-1500701631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:00:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8385634a-b71b-450a-b94e-1fa377e8d61b tempest-TestStampPattern-1500701631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:00:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8385634a-b71b-450a-b94e-1fa377e8d61b tempest-TestStampPattern-1500701631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:24 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:00:24 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:24 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8385634a-b71b-450a-b94e-1fa377e8d61b tempest-TestStampPattern-1500701631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.366s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:24 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-8385634a-b71b-450a-b94e-1fa377e8d61b tempest-TestStampPattern-1500701631 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:00:24 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-8385634a-b71b-450a-b94e-1fa377e8d61b tempest-TestStampPattern-1500701631 None] Deleted volume successfully. Aug 10 13:00:24 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8385634a-b71b-450a-b94e-1fa377e8d61b tempest-TestStampPattern-1500701631 None] Lock "cinder-b21c97ed-d738-4d79-aa6e-0ef6b9826c63-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:00:34 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=78,cinder:INSERT=22,cinder:UPDATE=112,cinder:DELETE=6 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 13:00:34 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=83,cinder:INSERT=32,cinder:UPDATE=109,cinder:DELETE=10 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 13:00:39 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-22dfe3ef-3e4f-460e-b536-1b40addb2336 tempest-SnapshotDependencyTests-1069630469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:00:40 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-22dfe3ef-3e4f-460e-b536-1b40addb2336 tempest-SnapshotDependencyTests-1069630469 None] Flow 'volume_create_manager' (784a5f3e-2761-4eb8-88ed-125136e237ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:00:40 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-22dfe3ef-3e4f-460e-b536-1b40addb2336 tempest-SnapshotDependencyTests-1069630469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd83c53d-2ab6-40e9-899e-7a577831c7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:00:40 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-22dfe3ef-3e4f-460e-b536-1b40addb2336 tempest-SnapshotDependencyTests-1069630469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd83c53d-2ab6-40e9-899e-7a577831c7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-643691912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f361f2ba-d620-441b-b906-95b334676e0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02eb4585d389430e8f954dc74b583676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:00:40Z,use_quota=True,user_id='103b504be9044bd8b6c4e3fd0ea1e242',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:00:40 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-22dfe3ef-3e4f-460e-b536-1b40addb2336 tempest-SnapshotDependencyTests-1069630469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cb5bb57-2f39-4b86-96e7-aaae5943752c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:00:40 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-22dfe3ef-3e4f-460e-b536-1b40addb2336 tempest-SnapshotDependencyTests-1069630469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cb5bb57-2f39-4b86-96e7-aaae5943752c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:00:40 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-22dfe3ef-3e4f-460e-b536-1b40addb2336 tempest-SnapshotDependencyTests-1069630469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c2a2f13-bc58-4766-abc4-194d3b7d7c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:00:40 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-22dfe3ef-3e4f-460e-b536-1b40addb2336 tempest-SnapshotDependencyTests-1069630469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c2a2f13-bc58-4766-abc4-194d3b7d7c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f361f2ba-d620-441b-b906-95b334676e0b', 'volume_name': 'volume-f361f2ba-d620-441b-b906-95b334676e0b', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:00:40 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-22dfe3ef-3e4f-460e-b536-1b40addb2336 tempest-SnapshotDependencyTests-1069630469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (428d3dd9-3838-4ff4-9c20-a86ebc72fca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:00:40 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-22dfe3ef-3e4f-460e-b536-1b40addb2336 tempest-SnapshotDependencyTests-1069630469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (428d3dd9-3838-4ff4-9c20-a86ebc72fca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:00:40 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-22dfe3ef-3e4f-460e-b536-1b40addb2336 tempest-SnapshotDependencyTests-1069630469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58119f2b-8a9c-48d6-8b53-a6cec49f614a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:00:40 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-22dfe3ef-3e4f-460e-b536-1b40addb2336 tempest-SnapshotDependencyTests-1069630469 None] Volume f361f2ba-d620-441b-b906-95b334676e0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f361f2ba-d620-441b-b906-95b334676e0b', 'volume_size': 1} Aug 10 13:00:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-22dfe3ef-3e4f-460e-b536-1b40addb2336 tempest-SnapshotDependencyTests-1069630469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:00:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-22dfe3ef-3e4f-460e-b536-1b40addb2336 tempest-SnapshotDependencyTests-1069630469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:00:40 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-22dfe3ef-3e4f-460e-b536-1b40addb2336 tempest-SnapshotDependencyTests-1069630469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-643691912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f361f2ba-d620-441b-b906-95b334676e0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02eb4585d389430e8f954dc74b583676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:00:40Z,use_quota=True,user_id='103b504be9044bd8b6c4e3fd0ea1e242',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:00:40 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-22dfe3ef-3e4f-460e-b536-1b40addb2336 tempest-SnapshotDependencyTests-1069630469 None] Creating volume f361f2ba-d620-441b-b906-95b334676e0b {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:00:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-22dfe3ef-3e4f-460e-b536-1b40addb2336 tempest-SnapshotDependencyTests-1069630469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:00:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-22dfe3ef-3e4f-460e-b536-1b40addb2336 tempest-SnapshotDependencyTests-1069630469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:00:40 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-22dfe3ef-3e4f-460e-b536-1b40addb2336 tempest-SnapshotDependencyTests-1069630469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:00:40 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-22dfe3ef-3e4f-460e-b536-1b40addb2336 tempest-SnapshotDependencyTests-1069630469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:00:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-22dfe3ef-3e4f-460e-b536-1b40addb2336 tempest-SnapshotDependencyTests-1069630469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:00:40 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-22dfe3ef-3e4f-460e-b536-1b40addb2336 tempest-SnapshotDependencyTests-1069630469 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:00:40 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-22dfe3ef-3e4f-460e-b536-1b40addb2336 tempest-SnapshotDependencyTests-1069630469 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:00:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-22dfe3ef-3e4f-460e-b536-1b40addb2336 tempest-SnapshotDependencyTests-1069630469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:40 devstack sudo[105010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b 1073741824 Aug 10 13:00:40 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:40 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-22dfe3ef-3e4f-460e-b536-1b40addb2336 tempest-SnapshotDependencyTests-1069630469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b 1073741824" returned: 0 in 0.475s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-22dfe3ef-3e4f-460e-b536-1b40addb2336 tempest-SnapshotDependencyTests-1069630469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:40 devstack sudo[105016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b Aug 10 13:00:40 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:40 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-22dfe3ef-3e4f-460e-b536-1b40addb2336 tempest-SnapshotDependencyTests-1069630469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b" returned: 0 in 0.238s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:40 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-22dfe3ef-3e4f-460e-b536-1b40addb2336 tempest-SnapshotDependencyTests-1069630469 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:00:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-22dfe3ef-3e4f-460e-b536-1b40addb2336 tempest-SnapshotDependencyTests-1069630469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:00:40 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-22dfe3ef-3e4f-460e-b536-1b40addb2336 tempest-SnapshotDependencyTests-1069630469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58119f2b-8a9c-48d6-8b53-a6cec49f614a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f361f2ba-d620-441b-b906-95b334676e0b', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:00:40 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-22dfe3ef-3e4f-460e-b536-1b40addb2336 tempest-SnapshotDependencyTests-1069630469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b431f35f-f722-47a0-96c1-e2c9b8a51c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:00:40 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-22dfe3ef-3e4f-460e-b536-1b40addb2336 tempest-SnapshotDependencyTests-1069630469 None] Volume volume-f361f2ba-d620-441b-b906-95b334676e0b (f361f2ba-d620-441b-b906-95b334676e0b): created successfully Aug 10 13:00:40 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-22dfe3ef-3e4f-460e-b536-1b40addb2336 tempest-SnapshotDependencyTests-1069630469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b431f35f-f722-47a0-96c1-e2c9b8a51c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:00:40 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-22dfe3ef-3e4f-460e-b536-1b40addb2336 tempest-SnapshotDependencyTests-1069630469 None] Flow 'volume_create_manager' (784a5f3e-2761-4eb8-88ed-125136e237ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:00:40 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-22dfe3ef-3e4f-460e-b536-1b40addb2336 tempest-SnapshotDependencyTests-1069630469 None] Created volume successfully. Aug 10 13:00:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7f617f5f-4900-47f2-9665-71b50b91082b tempest-SnapshotDependencyTests-1069630469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:00:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7f617f5f-4900-47f2-9665-71b50b91082b tempest-SnapshotDependencyTests-1069630469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:00:41 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-7f617f5f-4900-47f2-9665-71b50b91082b tempest-SnapshotDependencyTests-1069630469 None] Creating offline snapshot b580355c-74ae-4681-9989-8ccdc289830a of volume f361f2ba-d620-441b-b906-95b334676e0b {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 13:00:41 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca2f3f4-be20-41c4-988b-edc9370ad2d5]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:00:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7f617f5f-4900-47f2-9665-71b50b91082b tempest-SnapshotDependencyTests-1069630469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:41 devstack sudo[105021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b Aug 10 13:00:41 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:41 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7f617f5f-4900-47f2-9665-71b50b91082b tempest-SnapshotDependencyTests-1069630469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b" returned: 0 in 0.453s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7f617f5f-4900-47f2-9665-71b50b91082b tempest-SnapshotDependencyTests-1069630469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b.b580355c-74ae-4681-9989-8ccdc289830a 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:41 devstack sudo[105027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b.b580355c-74ae-4681-9989-8ccdc289830a 1G Aug 10 13:00:41 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:42 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7f617f5f-4900-47f2-9665-71b50b91082b tempest-SnapshotDependencyTests-1069630469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b.b580355c-74ae-4681-9989-8ccdc289830a 1G" returned: 0 in 0.668s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7f617f5f-4900-47f2-9665-71b50b91082b tempest-SnapshotDependencyTests-1069630469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f361f2ba-d620-441b-b906-95b334676e0b -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b.b580355c-74ae-4681-9989-8ccdc289830a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:42 devstack sudo[105056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f361f2ba-d620-441b-b906-95b334676e0b -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b.b580355c-74ae-4681-9989-8ccdc289830a Aug 10 13:00:42 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:42 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7f617f5f-4900-47f2-9665-71b50b91082b tempest-SnapshotDependencyTests-1069630469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f361f2ba-d620-441b-b906-95b334676e0b -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b.b580355c-74ae-4681-9989-8ccdc289830a" returned: 0 in 0.386s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:42 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-7f617f5f-4900-47f2-9665-71b50b91082b tempest-SnapshotDependencyTests-1069630469 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b.b580355c-74ae-4681-9989-8ccdc289830a is being set with open permissions: ugo+rw Aug 10 13:00:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7f617f5f-4900-47f2-9665-71b50b91082b tempest-SnapshotDependencyTests-1069630469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b.b580355c-74ae-4681-9989-8ccdc289830a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:42 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:00:42 devstack sudo[105062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b.b580355c-74ae-4681-9989-8ccdc289830a Aug 10 13:00:42 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:42 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Flow 'volume_create_manager' (969eec2c-bf33-41a8-9618-585ff2fd5339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:00:42 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a47961e-a316-4d45-87e4-744e5cd06fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:00:42 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a47961e-a316-4d45-87e4-744e5cd06fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f6ebccb-ebca-4413-ad29-a2c0dcea49af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99d84ab02134a74bee98a95b102ce91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:00:43Z,use_quota=True,user_id='303ed1a4d28b42cc8e9baaf9294db236',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:00:42 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8380a4a-041b-4e01-9117-1ec6331dcacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:00:42 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8380a4a-041b-4e01-9117-1ec6331dcacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:00:42 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (117b201d-7018-4b94-aae0-4ed3f6cdb9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:00:42 devstack cinder-volume[89096]: DEBUG cinder.image.glance [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Creating Keystone auth plugin from conf {{(pid=89096) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 10 13:00:43 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7f617f5f-4900-47f2-9665-71b50b91082b tempest-SnapshotDependencyTests-1069630469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b.b580355c-74ae-4681-9989-8ccdc289830a" returned: 0 in 0.335s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:43 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (117b201d-7018-4b94-aae0-4ed3f6cdb9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1f6ebccb-ebca-4413-ad29-a2c0dcea49af', 'volume_name': 'volume-1f6ebccb-ebca-4413-ad29-a2c0dcea49af', 'volume_size': 1, 'image_id': '65b32256-474b-4f3b-8e35-318864e90fbb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65b32256-474b-4f3b-8e35-318864e90fbb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8c92c8342ab92f6a90df970359a6d558', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c99d84ab02134a74bee98a95b102ce91', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '10682ab57392086fb4b0fd96aa0e097fc54217e2dfefaa0279b49350e4332e9e64498deb888b923e649c5137fe227e10aeb234b7701c7c5e46e27de7d78d326e', 'id': '65b32256-474b-4f3b-8e35-318864e90fbb', 'created_at': datetime.datetime(2026, 8, 10, 11, 0, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 11, 0, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65b32256-474b-4f3b-8e35-318864e90fbb/file', 'properties': {}}, 'image_service': }' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:00:43 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d70e6a-35da-4c32-8032-7ce3c60b8a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:00:43 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d70e6a-35da-4c32-8032-7ce3c60b8a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:00:43 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8170feb1-ccb3-4d70-b20e-e3125a382a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:00:43 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Volume 1f6ebccb-ebca-4413-ad29-a2c0dcea49af: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1f6ebccb-ebca-4413-ad29-a2c0dcea49af', 'volume_size': 1, 'image_id': '65b32256-474b-4f3b-8e35-318864e90fbb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65b32256-474b-4f3b-8e35-318864e90fbb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8c92c8342ab92f6a90df970359a6d558', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c99d84ab02134a74bee98a95b102ce91', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '10682ab57392086fb4b0fd96aa0e097fc54217e2dfefaa0279b49350e4332e9e64498deb888b923e649c5137fe227e10aeb234b7701c7c5e46e27de7d78d326e', 'id': '65b32256-474b-4f3b-8e35-318864e90fbb', 'created_at': datetime.datetime(2026, 8, 10, 11, 0, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 11, 0, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65b32256-474b-4f3b-8e35-318864e90fbb/file', 'properties': {}}, 'image_service': } Aug 10 13:00:43 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Trying to clone 1f6ebccb-ebca-4413-ad29-a2c0dcea49af from image 65b32256-474b-4f3b-8e35-318864e90fbb at location (None, [{'url': 'file:///opt/stack/data/glance/images/65b32256-474b-4f3b-8e35-318864e90fbb', 'metadata': {}}]). {{(pid=89096) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 10 13:00:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7f617f5f-4900-47f2-9665-71b50b91082b tempest-SnapshotDependencyTests-1069630469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:43 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b.info Aug 10 13:00:43 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:43 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_65b32256-474b-4f3b-8e35-318864e90fbb_jpwnhh2edevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89096) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 10 13:00:43 devstack cinder-volume[89096]: INFO cinder.image.image_utils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Image download 0.00 MB at 0.00 MB/s Aug 10 13:00:43 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c14345-5ec2-4f83-b230-019953b03fbd]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:00:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65b32256-474b-4f3b-8e35-318864e90fbb_jpwnhh2edevstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:43 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65b32256-474b-4f3b-8e35-318864e90fbb_jpwnhh2edevstack@QuobyteHD Aug 10 13:00:43 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:43 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7f617f5f-4900-47f2-9665-71b50b91082b tempest-SnapshotDependencyTests-1069630469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b.info" returned: 0 in 0.329s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:43 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-7f617f5f-4900-47f2-9665-71b50b91082b tempest-SnapshotDependencyTests-1069630469 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b.info is being set with open permissions: ugo+rw Aug 10 13:00:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7f617f5f-4900-47f2-9665-71b50b91082b tempest-SnapshotDependencyTests-1069630469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:43 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b.info Aug 10 13:00:43 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:43 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65b32256-474b-4f3b-8e35-318864e90fbb_jpwnhh2edevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65b32256-474b-4f3b-8e35-318864e90fbb_jpwnhh2edevstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:43 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7f617f5f-4900-47f2-9665-71b50b91082b tempest-SnapshotDependencyTests-1069630469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b.info" returned: 0 in 0.334s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7f617f5f-4900-47f2-9665-71b50b91082b tempest-SnapshotDependencyTests-1069630469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.657s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:00:43 devstack sudo[105083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65b32256-474b-4f3b-8e35-318864e90fbb_jpwnhh2edevstack@QuobyteHD Aug 10 13:00:43 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:44 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-7f617f5f-4900-47f2-9665-71b50b91082b tempest-SnapshotDependencyTests-1069630469 None] Create snapshot completed successfully Aug 10 13:00:44 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65b32256-474b-4f3b-8e35-318864e90fbb_jpwnhh2edevstack@QuobyteHD" returned: 1 in 0.350s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65b32256-474b-4f3b-8e35-318864e90fbb_jpwnhh2edevstack@QuobyteHD' failed. Not Retrying. {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 13:00:44 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Temporary image 65b32256-474b-4f3b-8e35-318864e90fbb is fetched for user 303ed1a4d28b42cc8e9baaf9294db236. {{(pid=89096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 10 13:00:44 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[00be45d2-b3e0-447a-aaa2-2e44383f987a]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:00:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65b32256-474b-4f3b-8e35-318864e90fbb_jpwnhh2edevstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:44 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65b32256-474b-4f3b-8e35-318864e90fbb_jpwnhh2edevstack@QuobyteHD Aug 10 13:00:44 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:44 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65b32256-474b-4f3b-8e35-318864e90fbb_jpwnhh2edevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65b32256-474b-4f3b-8e35-318864e90fbb_jpwnhh2edevstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:44 devstack sudo[105093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65b32256-474b-4f3b-8e35-318864e90fbb_jpwnhh2edevstack@QuobyteHD Aug 10 13:00:44 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:45 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65b32256-474b-4f3b-8e35-318864e90fbb_jpwnhh2edevstack@QuobyteHD" returned: 1 in 0.353s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65b32256-474b-4f3b-8e35-318864e90fbb_jpwnhh2edevstack@QuobyteHD' failed. Not Retrying. {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f6ebccb-ebca-4413-ad29-a2c0dcea49af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99d84ab02134a74bee98a95b102ce91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:00:43Z,use_quota=True,user_id='303ed1a4d28b42cc8e9baaf9294db236',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Creating volume 1f6ebccb-ebca-4413-ad29-a2c0dcea49af {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:00:45 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1f6ebccb-ebca-4413-ad29-a2c0dcea49af 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:45 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1f6ebccb-ebca-4413-ad29-a2c0dcea49af 1073741824 Aug 10 13:00:45 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Flow 'volume_create_manager' (5bac6f38-dc07-41ab-8247-ae5a07952421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afc924dc-c7d1-49a1-98d9-6b490b968457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afc924dc-c7d1-49a1-98d9-6b490b968457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=162a7397-c7c5-4af4-aee1-095aee52c642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02eb4585d389430e8f954dc74b583676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b580355c-74ae-4681-9989-8ccdc289830a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:00:45Z,use_quota=True,user_id='103b504be9044bd8b6c4e3fd0ea1e242',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fb04d33-65d8-4c42-a15e-5ae1fd3e86d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fb04d33-65d8-4c42-a15e-5ae1fd3e86d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3f10a06-7f9f-4a4e-a55f-986e1c925e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3f10a06-7f9f-4a4e-a55f-986e1c925e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '162a7397-c7c5-4af4-aee1-095aee52c642', 'volume_name': 'volume-162a7397-c7c5-4af4-aee1-095aee52c642', 'volume_size': 1, 'snapshot_id': 'b580355c-74ae-4681-9989-8ccdc289830a'}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82bcb17a-108f-4dff-b1ce-3105fd283a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82bcb17a-108f-4dff-b1ce-3105fd283a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bdbda26-24fa-43b7-8a40-ae8795769457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:00:45 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Volume 162a7397-c7c5-4af4-aee1-095aee52c642: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-162a7397-c7c5-4af4-aee1-095aee52c642', 'volume_size': 1, 'snapshot_id': 'b580355c-74ae-4681-9989-8ccdc289830a'} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:00:45 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1f6ebccb-ebca-4413-ad29-a2c0dcea49af 1073741824" returned: 0 in 0.502s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1f6ebccb-ebca-4413-ad29-a2c0dcea49af {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:45 devstack sudo[105104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1f6ebccb-ebca-4413-ad29-a2c0dcea49af Aug 10 13:00:45 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:45 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1f6ebccb-ebca-4413-ad29-a2c0dcea49af" returned: 0 in 0.268s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.491s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Acquiring lock "cinder-quobyte-b580355c-74ae-4681-9989-8ccdc289830a-162a7397-c7c5-4af4-aee1-095aee52c642" by "_create_volume_from_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Lock "cinder-quobyte-b580355c-74ae-4681-9989-8ccdc289830a-162a7397-c7c5-4af4-aee1-095aee52c642" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Creating volume 162a7397-c7c5-4af4-aee1-095aee52c642 from snapshot b580355c-74ae-4681-9989-8ccdc289830a {{(pid=89096) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Acquiring lock "cinder-quobyte-162a7397-c7c5-4af4-aee1-095aee52c642" by "_copy_volume_from_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Lock "cinder-quobyte-162a7397-c7c5-4af4-aee1-095aee52c642" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] snapshot: b580355c-74ae-4681-9989-8ccdc289830a, volume: 162a7397-c7c5-4af4-aee1-095aee52c642, {{(pid=89096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG cinder.volume.volume_utils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Attempting download of 65b32256-474b-4f3b-8e35-318864e90fbb ((None, [{'url': 'file:///opt/stack/data/glance/images/65b32256-474b-4f3b-8e35-318864e90fbb', 'metadata': {}}])) to volume 1f6ebccb-ebca-4413-ad29-a2c0dcea49af. {{(pid=89096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f700c9-7cf8-4f07-b3b0-c426551bb56c]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:00:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b.b580355c-74ae-4681-9989-8ccdc289830a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:46 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3b293b-43b5-46a6-bea2-e4e0369c1c1b]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:00:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65b32256-474b-4f3b-8e35-318864e90fbb_cr0duu1c {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:46 devstack sudo[105107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b.b580355c-74ae-4681-9989-8ccdc289830a Aug 10 13:00:46 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:46 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65b32256-474b-4f3b-8e35-318864e90fbb_cr0duu1c Aug 10 13:00:46 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:46 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65b32256-474b-4f3b-8e35-318864e90fbb_cr0duu1c" returned: 0 in 0.363s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65b32256-474b-4f3b-8e35-318864e90fbb_cr0duu1c {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:46 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b.b580355c-74ae-4681-9989-8ccdc289830a" returned: 0 in 0.445s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:46 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f361f2ba-d620-441b-b906-95b334676e0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 13:00:46 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[094dfb10-9410-4a0e-9bae-6ac8d02f2792]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:00:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:46 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65b32256-474b-4f3b-8e35-318864e90fbb_cr0duu1c Aug 10 13:00:46 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:46 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b Aug 10 13:00:46 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:46 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65b32256-474b-4f3b-8e35-318864e90fbb_cr0duu1c" returned: 1 in 0.382s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65b32256-474b-4f3b-8e35-318864e90fbb_cr0duu1c' failed. Not Retrying. {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 13:00:46 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c575c10d-8e69-4a35-992f-682275a28221]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:00:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65b32256-474b-4f3b-8e35-318864e90fbb_jpwnhh2edevstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:46 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b" returned: 0 in 0.400s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:46 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b {{(pid=89096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 10 13:00:46 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Creating direct copy from snapshot {{(pid=89096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 10 13:00:46 devstack cinder-volume[89096]: DEBUG cinder.utils [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Path /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-162a7397-c7c5-4af4-aee1-095aee52c642 not found in is_blk_device check {{(pid=89096) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 10 13:00:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-162a7397-c7c5-4af4-aee1-095aee52c642 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:46 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65b32256-474b-4f3b-8e35-318864e90fbb_jpwnhh2edevstack@QuobyteHD Aug 10 13:00:46 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:46 devstack sudo[105126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-162a7397-c7c5-4af4-aee1-095aee52c642 Aug 10 13:00:46 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:47 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65b32256-474b-4f3b-8e35-318864e90fbb_jpwnhh2edevstack@QuobyteHD" returned: 0 in 0.350s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65b32256-474b-4f3b-8e35-318864e90fbb_jpwnhh2edevstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:47 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65b32256-474b-4f3b-8e35-318864e90fbb_jpwnhh2edevstack@QuobyteHD Aug 10 13:00:47 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:47 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65b32256-474b-4f3b-8e35-318864e90fbb_jpwnhh2edevstack@QuobyteHD" returned: 1 in 0.435s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65b32256-474b-4f3b-8e35-318864e90fbb_jpwnhh2edevstack@QuobyteHD' failed. Not Retrying. {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 13:00:47 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] 65b32256-474b-4f3b-8e35-318864e90fbb was raw, converting to qcow2 {{(pid=89096) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 10 13:00:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_65b32256-474b-4f3b-8e35-318864e90fbb_jpwnhh2edevstack@QuobyteHD /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1f6ebccb-ebca-4413-ad29-a2c0dcea49af {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:47 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_65b32256-474b-4f3b-8e35-318864e90fbb_jpwnhh2edevstack@QuobyteHD /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1f6ebccb-ebca-4413-ad29-a2c0dcea49af Aug 10 13:00:47 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:48 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_65b32256-474b-4f3b-8e35-318864e90fbb_jpwnhh2edevstack@QuobyteHD /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1f6ebccb-ebca-4413-ad29-a2c0dcea49af" returned: 0 in 1.052s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:48 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_65b32256-474b-4f3b-8e35-318864e90fbb_jpwnhh2edevstack@QuobyteHD, size 0.00 MB, duration 1.05 sec, destination /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1f6ebccb-ebca-4413-ad29-a2c0dcea49af {{(pid=89096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 13:00:48 devstack cinder-volume[89096]: INFO cinder.image.image_utils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Converted 0.00 MB image at 0.00 MB/s Aug 10 13:00:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1f6ebccb-ebca-4413-ad29-a2c0dcea49af 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:48 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1f6ebccb-ebca-4413-ad29-a2c0dcea49af 1G Aug 10 13:00:48 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:49 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1f6ebccb-ebca-4413-ad29-a2c0dcea49af 1G" returned: 0 in 0.750s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:49 devstack cinder-volume[89096]: DEBUG cinder.volume.volume_utils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Downloaded image 65b32256-474b-4f3b-8e35-318864e90fbb ((None, [{'url': 'file:///opt/stack/data/glance/images/65b32256-474b-4f3b-8e35-318864e90fbb', 'metadata': {}}])) to volume 1f6ebccb-ebca-4413-ad29-a2c0dcea49af successfully. {{(pid=89096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 10 13:00:49 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Temporary image 65b32256-474b-4f3b-8e35-318864e90fbb for user 303ed1a4d28b42cc8e9baaf9294db236 is deleted. {{(pid=89096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 10 13:00:49 devstack cinder-volume[89096]: DEBUG cinder.volume.volume_utils [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Marking volume 1f6ebccb-ebca-4413-ad29-a2c0dcea49af as bootable. {{(pid=89096) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 10 13:00:49 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Copying metadata from image 65b32256-474b-4f3b-8e35-318864e90fbb to 1f6ebccb-ebca-4413-ad29-a2c0dcea49af. {{(pid=89096) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 10 13:00:49 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Creating volume glance metadata for volume 1f6ebccb-ebca-4413-ad29-a2c0dcea49af backed by image 65b32256-474b-4f3b-8e35-318864e90fbb with: {'image_id': '65b32256-474b-4f3b-8e35-318864e90fbb', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '8c92c8342ab92f6a90df970359a6d558', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89096) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 10 13:00:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8170feb1-ccb3-4d70-b20e-e3125a382a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f6ebccb-ebca-4413-ad29-a2c0dcea49af', 'volume_size': 1, 'image_id': '65b32256-474b-4f3b-8e35-318864e90fbb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65b32256-474b-4f3b-8e35-318864e90fbb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8c92c8342ab92f6a90df970359a6d558', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c99d84ab02134a74bee98a95b102ce91', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '10682ab57392086fb4b0fd96aa0e097fc54217e2dfefaa0279b49350e4332e9e64498deb888b923e649c5137fe227e10aeb234b7701c7c5e46e27de7d78d326e', 'id': '65b32256-474b-4f3b-8e35-318864e90fbb', 'created_at': datetime.datetime(2026, 8, 10, 11, 0, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 11, 0, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65b32256-474b-4f3b-8e35-318864e90fbb/file', 'properties': {}}, 'image_service': }' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:00:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74cf4fab-c2dc-4519-a629-18bac2bcddab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:00:49 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Volume volume-1f6ebccb-ebca-4413-ad29-a2c0dcea49af (1f6ebccb-ebca-4413-ad29-a2c0dcea49af): created successfully Aug 10 13:00:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74cf4fab-c2dc-4519-a629-18bac2bcddab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:00:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Flow 'volume_create_manager' (969eec2c-bf33-41a8-9618-585ff2fd5339) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:00:49 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-99177ea8-16a7-4953-83bf-aabf32e17361 tempest-VolumeImageDependencyTests-1799194829 None] Created volume successfully. Aug 10 13:00:50 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ef238ab6-194c-4093-a62d-61286a4036eb tempest-VolumeImageDependencyTests-1799194829 None] Acquiring lock "cinder-1f6ebccb-ebca-4413-ad29-a2c0dcea49af-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:00:50 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ef238ab6-194c-4093-a62d-61286a4036eb tempest-VolumeImageDependencyTests-1799194829 None] Lock "cinder-1f6ebccb-ebca-4413-ad29-a2c0dcea49af-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:00:50 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ef238ab6-194c-4093-a62d-61286a4036eb tempest-VolumeImageDependencyTests-1799194829 None] Acquiring lock "cinder-quobyte-1f6ebccb-ebca-4413-ad29-a2c0dcea49af" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:00:50 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ef238ab6-194c-4093-a62d-61286a4036eb tempest-VolumeImageDependencyTests-1799194829 None] Lock "cinder-quobyte-1f6ebccb-ebca-4413-ad29-a2c0dcea49af" acquired by "delete_volume" :: waited 0.032s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:00:50 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2797a9-0a95-41c9-852e-57710cfb997e]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:00:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ef238ab6-194c-4093-a62d-61286a4036eb tempest-VolumeImageDependencyTests-1799194829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1f6ebccb-ebca-4413-ad29-a2c0dcea49af {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:51 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1f6ebccb-ebca-4413-ad29-a2c0dcea49af Aug 10 13:00:51 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:51 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ef238ab6-194c-4093-a62d-61286a4036eb tempest-VolumeImageDependencyTests-1799194829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1f6ebccb-ebca-4413-ad29-a2c0dcea49af" returned: 0 in 0.816s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ef238ab6-194c-4093-a62d-61286a4036eb tempest-VolumeImageDependencyTests-1799194829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1f6ebccb-ebca-4413-ad29-a2c0dcea49af {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:51 devstack sudo[105167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1f6ebccb-ebca-4413-ad29-a2c0dcea49af Aug 10 13:00:51 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:52 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ef238ab6-194c-4093-a62d-61286a4036eb tempest-VolumeImageDependencyTests-1799194829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1f6ebccb-ebca-4413-ad29-a2c0dcea49af" returned: 0 in 0.650s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:52 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ef238ab6-194c-4093-a62d-61286a4036eb tempest-VolumeImageDependencyTests-1799194829 None] Lock "cinder-quobyte-1f6ebccb-ebca-4413-ad29-a2c0dcea49af" released by "delete_volume" :: held 1.573s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:00:52 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-162a7397-c7c5-4af4-aee1-095aee52c642" returned: 0 in 5.414s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:52 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Image conversion details: src /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b, size 1024.00 MB, duration 5.42 sec, destination /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-162a7397-c7c5-4af4-aee1-095aee52c642 {{(pid=89096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 13:00:52 devstack cinder-volume[89096]: INFO cinder.image.image_utils [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Converted 1024.00 MB image at 189.08 MB/s Aug 10 13:00:52 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-162a7397-c7c5-4af4-aee1-095aee52c642 is being set with open permissions: ugo+rw Aug 10 13:00:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-162a7397-c7c5-4af4-aee1-095aee52c642 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:52 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-162a7397-c7c5-4af4-aee1-095aee52c642 Aug 10 13:00:52 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:52 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-ef238ab6-194c-4093-a62d-61286a4036eb tempest-VolumeImageDependencyTests-1799194829 None] Created reservations ['bc8b15b4-7259-42d2-8f44-85f239c746cb', '78702ed9-f5bd-4858-9ebf-7c3c7810a2ba', 'a197a7f0-63d5-46b7-bb28-88623053132b', '130ef5a6-1dbf-4c8b-b4d2-7effe97b1f7b'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:00:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ef238ab6-194c-4093-a62d-61286a4036eb tempest-VolumeImageDependencyTests-1799194829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:00:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ef238ab6-194c-4093-a62d-61286a4036eb tempest-VolumeImageDependencyTests-1799194829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:00:52 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ef238ab6-194c-4093-a62d-61286a4036eb tempest-VolumeImageDependencyTests-1799194829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:00:52 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ef238ab6-194c-4093-a62d-61286a4036eb tempest-VolumeImageDependencyTests-1799194829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:00:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ef238ab6-194c-4093-a62d-61286a4036eb tempest-VolumeImageDependencyTests-1799194829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:00:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ef238ab6-194c-4093-a62d-61286a4036eb tempest-VolumeImageDependencyTests-1799194829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:52 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:00:52 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:52 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-162a7397-c7c5-4af4-aee1-095aee52c642" returned: 0 in 0.352s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:52 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Lock "cinder-quobyte-162a7397-c7c5-4af4-aee1-095aee52c642" released by "_copy_volume_from_snapshot" :: held 6.753s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:00:52 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Lock "cinder-quobyte-b580355c-74ae-4681-9989-8ccdc289830a-162a7397-c7c5-4af4-aee1-095aee52c642" released by "_create_volume_from_snapshot" :: held 6.854s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:00:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.877s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:00:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bdbda26-24fa-43b7-8a40-ae8795769457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-162a7397-c7c5-4af4-aee1-095aee52c642', 'volume_size': 1, 'snapshot_id': 'b580355c-74ae-4681-9989-8ccdc289830a'}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:00:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (443d0a93-3c24-4f28-a574-76304c0fa071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:00:52 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Volume volume-162a7397-c7c5-4af4-aee1-095aee52c642 (162a7397-c7c5-4af4-aee1-095aee52c642): created successfully Aug 10 13:00:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (443d0a93-3c24-4f28-a574-76304c0fa071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:00:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Flow 'volume_create_manager' (5bac6f38-dc07-41ab-8247-ae5a07952421) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:00:52 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-4e523947-54ec-48d7-8ff0-d87fbfa4a918 tempest-SnapshotDependencyTests-1069630469 None] Created volume successfully. Aug 10 13:00:52 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ef238ab6-194c-4093-a62d-61286a4036eb tempest-VolumeImageDependencyTests-1799194829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.406s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:52 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-ef238ab6-194c-4093-a62d-61286a4036eb tempest-VolumeImageDependencyTests-1799194829 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:00:52 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-ef238ab6-194c-4093-a62d-61286a4036eb tempest-VolumeImageDependencyTests-1799194829 None] Deleted volume successfully. Aug 10 13:00:52 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ef238ab6-194c-4093-a62d-61286a4036eb tempest-VolumeImageDependencyTests-1799194829 None] Lock "cinder-1f6ebccb-ebca-4413-ad29-a2c0dcea49af-delete_volume" released by "delete_volume" :: held 2.288s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:00:54 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ea47c0cc-718f-4779-a8ed-aa676269194e tempest-SnapshotDependencyTests-1069630469 None] Acquiring lock "cinder-b580355c-74ae-4681-9989-8ccdc289830a-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:00:54 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ea47c0cc-718f-4779-a8ed-aa676269194e tempest-SnapshotDependencyTests-1069630469 None] Lock "cinder-b580355c-74ae-4681-9989-8ccdc289830a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:00:54 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ea47c0cc-718f-4779-a8ed-aa676269194e tempest-SnapshotDependencyTests-1069630469 None] Acquiring lock "cinder-quobyte-f361f2ba-d620-441b-b906-95b334676e0b" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:00:54 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ea47c0cc-718f-4779-a8ed-aa676269194e tempest-SnapshotDependencyTests-1069630469 None] Lock "cinder-quobyte-f361f2ba-d620-441b-b906-95b334676e0b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:00:54 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ea47c0cc-718f-4779-a8ed-aa676269194e tempest-SnapshotDependencyTests-1069630469 None] Acquiring lock "cinder-quobyte-b580355c-74ae-4681-9989-8ccdc289830a" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:00:54 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ea47c0cc-718f-4779-a8ed-aa676269194e tempest-SnapshotDependencyTests-1069630469 None] Lock "cinder-quobyte-b580355c-74ae-4681-9989-8ccdc289830a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:00:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-ea47c0cc-718f-4779-a8ed-aa676269194e tempest-SnapshotDependencyTests-1069630469 None] Deleting offline snapshot b580355c-74ae-4681-9989-8ccdc289830a of volume f361f2ba-d620-441b-b906-95b334676e0b {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 13:00:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-ea47c0cc-718f-4779-a8ed-aa676269194e tempest-SnapshotDependencyTests-1069630469 None] snapshot_file for this snap is: volume-f361f2ba-d620-441b-b906-95b334676e0b.b580355c-74ae-4681-9989-8ccdc289830a {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 13:00:54 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[3335215d-4a69-4e26-8de1-bd2d42f1112d]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:00:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ea47c0cc-718f-4779-a8ed-aa676269194e tempest-SnapshotDependencyTests-1069630469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b.b580355c-74ae-4681-9989-8ccdc289830a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:54 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b.b580355c-74ae-4681-9989-8ccdc289830a Aug 10 13:00:54 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:54 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ea47c0cc-718f-4779-a8ed-aa676269194e tempest-SnapshotDependencyTests-1069630469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b.b580355c-74ae-4681-9989-8ccdc289830a" returned: 0 in 0.418s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-ea47c0cc-718f-4779-a8ed-aa676269194e tempest-SnapshotDependencyTests-1069630469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f361f2ba-d620-441b-b906-95b334676e0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 13:00:54 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dba5faa-ac5b-4cc7-a7f8-61d031e34db6]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:00:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ea47c0cc-718f-4779-a8ed-aa676269194e tempest-SnapshotDependencyTests-1069630469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:54 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b Aug 10 13:00:54 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:55 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ea47c0cc-718f-4779-a8ed-aa676269194e tempest-SnapshotDependencyTests-1069630469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b" returned: 0 in 0.637s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ea47c0cc-718f-4779-a8ed-aa676269194e tempest-SnapshotDependencyTests-1069630469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b.b580355c-74ae-4681-9989-8ccdc289830a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:55 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b.b580355c-74ae-4681-9989-8ccdc289830a Aug 10 13:00:55 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:55 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ea47c0cc-718f-4779-a8ed-aa676269194e tempest-SnapshotDependencyTests-1069630469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b.b580355c-74ae-4681-9989-8ccdc289830a" returned: 0 in 0.458s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ea47c0cc-718f-4779-a8ed-aa676269194e tempest-SnapshotDependencyTests-1069630469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b.b580355c-74ae-4681-9989-8ccdc289830a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:55 devstack sudo[105225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b.b580355c-74ae-4681-9989-8ccdc289830a Aug 10 13:00:55 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:56 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ea47c0cc-718f-4779-a8ed-aa676269194e tempest-SnapshotDependencyTests-1069630469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b.b580355c-74ae-4681-9989-8ccdc289830a" returned: 0 in 0.347s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:56 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ea47c0cc-718f-4779-a8ed-aa676269194e tempest-SnapshotDependencyTests-1069630469 None] Lock "cinder-quobyte-b580355c-74ae-4681-9989-8ccdc289830a" released by "_delete_snapshot" :: held 2.027s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:00:56 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ea47c0cc-718f-4779-a8ed-aa676269194e tempest-SnapshotDependencyTests-1069630469 None] Lock "cinder-quobyte-f361f2ba-d620-441b-b906-95b334676e0b" released by "delete_snapshot" :: held 2.059s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:00:56 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-ea47c0cc-718f-4779-a8ed-aa676269194e tempest-SnapshotDependencyTests-1069630469 None] Created reservations ['1698f0a4-7402-493d-b313-de00feff1b4a', '6ed8cdf9-73b3-47a5-8d09-4b589b28db3a', '150dcd86-bbe5-47b6-8969-76efac6189ad', 'dd531c4f-17ce-48a0-b3d3-d16df06c8e74'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:00:56 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-ea47c0cc-718f-4779-a8ed-aa676269194e tempest-SnapshotDependencyTests-1069630469 None] Delete snapshot completed successfully. Aug 10 13:00:56 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ea47c0cc-718f-4779-a8ed-aa676269194e tempest-SnapshotDependencyTests-1069630469 None] Lock "cinder-b580355c-74ae-4681-9989-8ccdc289830a-delete_snapshot" released by "delete_snapshot" :: held 2.315s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:00:57 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-3274fa1a-348f-4992-8b4a-0357cc88d2b0 tempest-SnapshotDependencyTests-1069630469 None] Acquiring lock "cinder-f361f2ba-d620-441b-b906-95b334676e0b-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:00:57 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-3274fa1a-348f-4992-8b4a-0357cc88d2b0 tempest-SnapshotDependencyTests-1069630469 None] Lock "cinder-f361f2ba-d620-441b-b906-95b334676e0b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:00:57 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-3274fa1a-348f-4992-8b4a-0357cc88d2b0 tempest-SnapshotDependencyTests-1069630469 None] Acquiring lock "cinder-quobyte-f361f2ba-d620-441b-b906-95b334676e0b" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:00:57 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-3274fa1a-348f-4992-8b4a-0357cc88d2b0 tempest-SnapshotDependencyTests-1069630469 None] Lock "cinder-quobyte-f361f2ba-d620-441b-b906-95b334676e0b" acquired by "delete_volume" :: waited 0.026s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:00:57 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9054ac-b7c3-46e4-89dd-8dd679030d4c]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:00:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3274fa1a-348f-4992-8b4a-0357cc88d2b0 tempest-SnapshotDependencyTests-1069630469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:57 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b Aug 10 13:00:57 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:57 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3274fa1a-348f-4992-8b4a-0357cc88d2b0 tempest-SnapshotDependencyTests-1069630469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b" returned: 0 in 0.384s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3274fa1a-348f-4992-8b4a-0357cc88d2b0 tempest-SnapshotDependencyTests-1069630469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:57 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b Aug 10 13:00:57 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:58 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3274fa1a-348f-4992-8b4a-0357cc88d2b0 tempest-SnapshotDependencyTests-1069630469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f361f2ba-d620-441b-b906-95b334676e0b" returned: 0 in 0.267s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:58 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-3274fa1a-348f-4992-8b4a-0357cc88d2b0 tempest-SnapshotDependencyTests-1069630469 None] Lock "cinder-quobyte-f361f2ba-d620-441b-b906-95b334676e0b" released by "delete_volume" :: held 0.750s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:00:58 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-3274fa1a-348f-4992-8b4a-0357cc88d2b0 tempest-SnapshotDependencyTests-1069630469 None] Created reservations ['91394c8f-cd77-459d-99e6-0f067ad52403', '7e4723eb-4d3d-4626-82ab-f37a8dc75acb', '61fcce63-9e71-45cb-82d6-6a99e72e1f01', '21bc8a6f-2dd6-4da5-964f-0975615d4a66'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:00:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3274fa1a-348f-4992-8b4a-0357cc88d2b0 tempest-SnapshotDependencyTests-1069630469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:00:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3274fa1a-348f-4992-8b4a-0357cc88d2b0 tempest-SnapshotDependencyTests-1069630469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:00:58 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3274fa1a-348f-4992-8b4a-0357cc88d2b0 tempest-SnapshotDependencyTests-1069630469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:00:58 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3274fa1a-348f-4992-8b4a-0357cc88d2b0 tempest-SnapshotDependencyTests-1069630469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:00:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3274fa1a-348f-4992-8b4a-0357cc88d2b0 tempest-SnapshotDependencyTests-1069630469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:00:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3274fa1a-348f-4992-8b4a-0357cc88d2b0 tempest-SnapshotDependencyTests-1069630469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:58 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:00:58 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:58 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-277a70dd-98c4-4264-b436-08dad4010e0c tempest-SnapshotDependencyTests-1069630469 None] Acquiring lock "cinder-162a7397-c7c5-4af4-aee1-095aee52c642-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:00:58 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-277a70dd-98c4-4264-b436-08dad4010e0c tempest-SnapshotDependencyTests-1069630469 None] Lock "cinder-162a7397-c7c5-4af4-aee1-095aee52c642-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:00:58 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-277a70dd-98c4-4264-b436-08dad4010e0c tempest-SnapshotDependencyTests-1069630469 None] Acquiring lock "cinder-quobyte-162a7397-c7c5-4af4-aee1-095aee52c642" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:00:58 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3274fa1a-348f-4992-8b4a-0357cc88d2b0 tempest-SnapshotDependencyTests-1069630469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.314s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:58 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-3274fa1a-348f-4992-8b4a-0357cc88d2b0 tempest-SnapshotDependencyTests-1069630469 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:00:58 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-277a70dd-98c4-4264-b436-08dad4010e0c tempest-SnapshotDependencyTests-1069630469 None] Lock "cinder-quobyte-162a7397-c7c5-4af4-aee1-095aee52c642" acquired by "delete_volume" :: waited 0.032s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:00:58 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-3274fa1a-348f-4992-8b4a-0357cc88d2b0 tempest-SnapshotDependencyTests-1069630469 None] Deleted volume successfully. Aug 10 13:00:58 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d0e55e-d023-4e58-a35d-c7a3c9215501]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:00:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-277a70dd-98c4-4264-b436-08dad4010e0c tempest-SnapshotDependencyTests-1069630469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-162a7397-c7c5-4af4-aee1-095aee52c642 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:58 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-3274fa1a-348f-4992-8b4a-0357cc88d2b0 tempest-SnapshotDependencyTests-1069630469 None] Lock "cinder-f361f2ba-d620-441b-b906-95b334676e0b-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:00:58 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-162a7397-c7c5-4af4-aee1-095aee52c642 Aug 10 13:00:58 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:59 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-277a70dd-98c4-4264-b436-08dad4010e0c tempest-SnapshotDependencyTests-1069630469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-162a7397-c7c5-4af4-aee1-095aee52c642" returned: 0 in 0.387s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-277a70dd-98c4-4264-b436-08dad4010e0c tempest-SnapshotDependencyTests-1069630469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-162a7397-c7c5-4af4-aee1-095aee52c642 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:59 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-162a7397-c7c5-4af4-aee1-095aee52c642 Aug 10 13:00:59 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:59 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-277a70dd-98c4-4264-b436-08dad4010e0c tempest-SnapshotDependencyTests-1069630469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-162a7397-c7c5-4af4-aee1-095aee52c642" returned: 0 in 0.288s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:59 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-277a70dd-98c4-4264-b436-08dad4010e0c tempest-SnapshotDependencyTests-1069630469 None] Lock "cinder-quobyte-162a7397-c7c5-4af4-aee1-095aee52c642" released by "delete_volume" :: held 0.744s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:00:59 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-277a70dd-98c4-4264-b436-08dad4010e0c tempest-SnapshotDependencyTests-1069630469 None] Created reservations ['9d7aa134-dcda-4f62-95a8-0e4c760b711a', '2e7215ca-c0ca-401e-be8e-db72164d0ab6', '7a6c6e82-0a71-4731-8e9c-b2e6562b0aac', '065bbae7-7cff-442a-86eb-ae5dff6b70db'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:00:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-277a70dd-98c4-4264-b436-08dad4010e0c tempest-SnapshotDependencyTests-1069630469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:00:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-277a70dd-98c4-4264-b436-08dad4010e0c tempest-SnapshotDependencyTests-1069630469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:00:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-277a70dd-98c4-4264-b436-08dad4010e0c tempest-SnapshotDependencyTests-1069630469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:00:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-277a70dd-98c4-4264-b436-08dad4010e0c tempest-SnapshotDependencyTests-1069630469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:00:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-277a70dd-98c4-4264-b436-08dad4010e0c tempest-SnapshotDependencyTests-1069630469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:00:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-277a70dd-98c4-4264-b436-08dad4010e0c tempest-SnapshotDependencyTests-1069630469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:00:59 devstack sudo[105320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:00:59 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:00:59 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root Aug 10 13:00:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-277a70dd-98c4-4264-b436-08dad4010e0c tempest-SnapshotDependencyTests-1069630469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.379s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:00:59 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-277a70dd-98c4-4264-b436-08dad4010e0c tempest-SnapshotDependencyTests-1069630469 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:00:59 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-277a70dd-98c4-4264-b436-08dad4010e0c tempest-SnapshotDependencyTests-1069630469 None] Deleted volume successfully. Aug 10 13:00:59 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-277a70dd-98c4-4264-b436-08dad4010e0c tempest-SnapshotDependencyTests-1069630469 None] Lock "cinder-162a7397-c7c5-4af4-aee1-095aee52c642-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:01:03 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 13:01:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:01:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:01:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:01:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:01:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:01:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:01:03 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:01:03 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:01:04 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Aug 10 13:01:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.295s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:01:04 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:01:04 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager._thread_info {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 13:01:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread count: 28 {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 13:01:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread info: [<_MainThread(MainThread, started 130607683133568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Aug 10 13:01:09 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=40,cinder:UPDATE=43,cinder:INSERT=11,cinder:DELETE=3 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 13:01:18 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=35,cinder:UPDATE=41,cinder:DELETE=4,cinder:INSERT=18 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 13:01:20 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef0a9891-ca61-4d9d-8d75-832f9085e7b5 tempest-AttachVolumeTestJSON-1943572718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:01:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ef0a9891-ca61-4d9d-8d75-832f9085e7b5 tempest-AttachVolumeTestJSON-1943572718 None] Flow 'volume_create_manager' (813d8443-259c-4f83-8cce-887f105d5efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:01:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ef0a9891-ca61-4d9d-8d75-832f9085e7b5 tempest-AttachVolumeTestJSON-1943572718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e91f6a1-5c4c-4622-a0d5-87d89951ec60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:01:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ef0a9891-ca61-4d9d-8d75-832f9085e7b5 tempest-AttachVolumeTestJSON-1943572718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e91f6a1-5c4c-4622-a0d5-87d89951ec60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1453926652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfa18705-9728-4452-8aad-24f80e191637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a8e103ceb5044aea1b673e75b32dfca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:01:20Z,use_quota=True,user_id='44bddbf9f3844c73a155b04f9820ebb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:01:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ef0a9891-ca61-4d9d-8d75-832f9085e7b5 tempest-AttachVolumeTestJSON-1943572718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf7195ac-5512-450d-ab9b-3c993a4a66ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:01:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ef0a9891-ca61-4d9d-8d75-832f9085e7b5 tempest-AttachVolumeTestJSON-1943572718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf7195ac-5512-450d-ab9b-3c993a4a66ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:01:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ef0a9891-ca61-4d9d-8d75-832f9085e7b5 tempest-AttachVolumeTestJSON-1943572718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3cbb836-b2ce-4ba2-9e20-09c3c26abbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:01:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ef0a9891-ca61-4d9d-8d75-832f9085e7b5 tempest-AttachVolumeTestJSON-1943572718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3cbb836-b2ce-4ba2-9e20-09c3c26abbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfa18705-9728-4452-8aad-24f80e191637', 'volume_name': 'volume-dfa18705-9728-4452-8aad-24f80e191637', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:01:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ef0a9891-ca61-4d9d-8d75-832f9085e7b5 tempest-AttachVolumeTestJSON-1943572718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48c6d95c-6337-4997-bb35-2e03f29bf816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:01:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ef0a9891-ca61-4d9d-8d75-832f9085e7b5 tempest-AttachVolumeTestJSON-1943572718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48c6d95c-6337-4997-bb35-2e03f29bf816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:01:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ef0a9891-ca61-4d9d-8d75-832f9085e7b5 tempest-AttachVolumeTestJSON-1943572718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4a463c6-6e1e-45b2-b2df-b429156031d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:01:20 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-ef0a9891-ca61-4d9d-8d75-832f9085e7b5 tempest-AttachVolumeTestJSON-1943572718 None] Volume dfa18705-9728-4452-8aad-24f80e191637: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfa18705-9728-4452-8aad-24f80e191637', 'volume_size': 1} Aug 10 13:01:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ef0a9891-ca61-4d9d-8d75-832f9085e7b5 tempest-AttachVolumeTestJSON-1943572718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:01:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ef0a9891-ca61-4d9d-8d75-832f9085e7b5 tempest-AttachVolumeTestJSON-1943572718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:01:20 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ef0a9891-ca61-4d9d-8d75-832f9085e7b5 tempest-AttachVolumeTestJSON-1943572718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1453926652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfa18705-9728-4452-8aad-24f80e191637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a8e103ceb5044aea1b673e75b32dfca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:01:20Z,use_quota=True,user_id='44bddbf9f3844c73a155b04f9820ebb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:01:20 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-ef0a9891-ca61-4d9d-8d75-832f9085e7b5 tempest-AttachVolumeTestJSON-1943572718 None] Creating volume dfa18705-9728-4452-8aad-24f80e191637 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:01:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ef0a9891-ca61-4d9d-8d75-832f9085e7b5 tempest-AttachVolumeTestJSON-1943572718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:01:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ef0a9891-ca61-4d9d-8d75-832f9085e7b5 tempest-AttachVolumeTestJSON-1943572718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:01:20 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ef0a9891-ca61-4d9d-8d75-832f9085e7b5 tempest-AttachVolumeTestJSON-1943572718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:01:20 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ef0a9891-ca61-4d9d-8d75-832f9085e7b5 tempest-AttachVolumeTestJSON-1943572718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:01:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ef0a9891-ca61-4d9d-8d75-832f9085e7b5 tempest-AttachVolumeTestJSON-1943572718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:01:20 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ef0a9891-ca61-4d9d-8d75-832f9085e7b5 tempest-AttachVolumeTestJSON-1943572718 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:01:20 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-ef0a9891-ca61-4d9d-8d75-832f9085e7b5 tempest-AttachVolumeTestJSON-1943572718 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:01:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ef0a9891-ca61-4d9d-8d75-832f9085e7b5 tempest-AttachVolumeTestJSON-1943572718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dfa18705-9728-4452-8aad-24f80e191637 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:01:20 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dfa18705-9728-4452-8aad-24f80e191637 1073741824 Aug 10 13:01:20 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:01:20 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Aug 10 13:01:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ef0a9891-ca61-4d9d-8d75-832f9085e7b5 tempest-AttachVolumeTestJSON-1943572718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dfa18705-9728-4452-8aad-24f80e191637 1073741824" returned: 0 in 0.410s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:01:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ef0a9891-ca61-4d9d-8d75-832f9085e7b5 tempest-AttachVolumeTestJSON-1943572718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dfa18705-9728-4452-8aad-24f80e191637 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:01:20 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dfa18705-9728-4452-8aad-24f80e191637 Aug 10 13:01:20 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:01:20 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Aug 10 13:01:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ef0a9891-ca61-4d9d-8d75-832f9085e7b5 tempest-AttachVolumeTestJSON-1943572718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dfa18705-9728-4452-8aad-24f80e191637" returned: 0 in 0.242s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:01:20 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ef0a9891-ca61-4d9d-8d75-832f9085e7b5 tempest-AttachVolumeTestJSON-1943572718 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:01:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ef0a9891-ca61-4d9d-8d75-832f9085e7b5 tempest-AttachVolumeTestJSON-1943572718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:01:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ef0a9891-ca61-4d9d-8d75-832f9085e7b5 tempest-AttachVolumeTestJSON-1943572718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4a463c6-6e1e-45b2-b2df-b429156031d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfa18705-9728-4452-8aad-24f80e191637', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:01:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ef0a9891-ca61-4d9d-8d75-832f9085e7b5 tempest-AttachVolumeTestJSON-1943572718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5ffdd4a-f71e-463b-9893-bbfc2e7bcb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:01:20 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-ef0a9891-ca61-4d9d-8d75-832f9085e7b5 tempest-AttachVolumeTestJSON-1943572718 None] Volume volume-dfa18705-9728-4452-8aad-24f80e191637 (dfa18705-9728-4452-8aad-24f80e191637): created successfully Aug 10 13:01:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ef0a9891-ca61-4d9d-8d75-832f9085e7b5 tempest-AttachVolumeTestJSON-1943572718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5ffdd4a-f71e-463b-9893-bbfc2e7bcb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:01:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ef0a9891-ca61-4d9d-8d75-832f9085e7b5 tempest-AttachVolumeTestJSON-1943572718 None] Flow 'volume_create_manager' (813d8443-259c-4f83-8cce-887f105d5efc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:01:20 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-ef0a9891-ca61-4d9d-8d75-832f9085e7b5 tempest-AttachVolumeTestJSON-1943572718 None] Created volume successfully. Aug 10 13:01:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-c61a8804-9d0f-4f6b-9e4c-608624995c53 req-9217cf76-ac19-46a0-ad57-6790dd3b7278 tempest-AttachVolumeTestJSON-1943572718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:01:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-c61a8804-9d0f-4f6b-9e4c-608624995c53 req-9217cf76-ac19-46a0-ad57-6790dd3b7278 tempest-AttachVolumeTestJSON-1943572718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:01:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-c61a8804-9d0f-4f6b-9e4c-608624995c53 req-9217cf76-ac19-46a0-ad57-6790dd3b7278 tempest-AttachVolumeTestJSON-1943572718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:01:21 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-c61a8804-9d0f-4f6b-9e4c-608624995c53 req-9217cf76-ac19-46a0-ad57-6790dd3b7278 tempest-AttachVolumeTestJSON-1943572718 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d', 'name': 'volume-dfa18705-9728-4452-8aad-24f80e191637', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'efd26dfc-3083-4e8f-b69d-03957bbe6458', 'enforce_multipath': True} {{(pid=89096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Aug 10 13:01:21 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-c61a8804-9d0f-4f6b-9e4c-608624995c53 req-9217cf76-ac19-46a0-ad57-6790dd3b7278 tempest-AttachVolumeTestJSON-1943572718 None] attachment_update completed successfully. Aug 10 13:01:24 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-24bf332f-4837-46d8-abef-b15b6f562a1d tempest-AttachVolumeTestJSON-1943572718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:01:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-24bf332f-4837-46d8-abef-b15b6f562a1d tempest-AttachVolumeTestJSON-1943572718 None] Flow 'volume_create_manager' (5e19c946-07b9-4a52-9a3d-1dcf3e9eee97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:01:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-24bf332f-4837-46d8-abef-b15b6f562a1d tempest-AttachVolumeTestJSON-1943572718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddd691b7-5ef6-42da-a729-f49991eda5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:01:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-24bf332f-4837-46d8-abef-b15b6f562a1d tempest-AttachVolumeTestJSON-1943572718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddd691b7-5ef6-42da-a729-f49991eda5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-492993275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ea388e3-eba9-4880-ae1a-76d80a704873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a8e103ceb5044aea1b673e75b32dfca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:01:24Z,use_quota=True,user_id='44bddbf9f3844c73a155b04f9820ebb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:01:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-24bf332f-4837-46d8-abef-b15b6f562a1d tempest-AttachVolumeTestJSON-1943572718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b761c067-6c56-4894-a7d0-1208adccd309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:01:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-24bf332f-4837-46d8-abef-b15b6f562a1d tempest-AttachVolumeTestJSON-1943572718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b761c067-6c56-4894-a7d0-1208adccd309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:01:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-24bf332f-4837-46d8-abef-b15b6f562a1d tempest-AttachVolumeTestJSON-1943572718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7bb0268-de25-407d-a556-e482eae31805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:01:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-24bf332f-4837-46d8-abef-b15b6f562a1d tempest-AttachVolumeTestJSON-1943572718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7bb0268-de25-407d-a556-e482eae31805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ea388e3-eba9-4880-ae1a-76d80a704873', 'volume_name': 'volume-3ea388e3-eba9-4880-ae1a-76d80a704873', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:01:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-24bf332f-4837-46d8-abef-b15b6f562a1d tempest-AttachVolumeTestJSON-1943572718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a2f7588-f470-425f-af98-6a5c6a8f6415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:01:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-24bf332f-4837-46d8-abef-b15b6f562a1d tempest-AttachVolumeTestJSON-1943572718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a2f7588-f470-425f-af98-6a5c6a8f6415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:01:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-24bf332f-4837-46d8-abef-b15b6f562a1d tempest-AttachVolumeTestJSON-1943572718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82d2a4c4-8645-40af-ba19-17331c85b550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:01:24 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-24bf332f-4837-46d8-abef-b15b6f562a1d tempest-AttachVolumeTestJSON-1943572718 None] Volume 3ea388e3-eba9-4880-ae1a-76d80a704873: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ea388e3-eba9-4880-ae1a-76d80a704873', 'volume_size': 1} Aug 10 13:01:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-24bf332f-4837-46d8-abef-b15b6f562a1d tempest-AttachVolumeTestJSON-1943572718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:01:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-24bf332f-4837-46d8-abef-b15b6f562a1d tempest-AttachVolumeTestJSON-1943572718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:01:24 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-24bf332f-4837-46d8-abef-b15b6f562a1d tempest-AttachVolumeTestJSON-1943572718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-492993275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ea388e3-eba9-4880-ae1a-76d80a704873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a8e103ceb5044aea1b673e75b32dfca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:01:24Z,use_quota=True,user_id='44bddbf9f3844c73a155b04f9820ebb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:01:24 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-24bf332f-4837-46d8-abef-b15b6f562a1d tempest-AttachVolumeTestJSON-1943572718 None] Creating volume 3ea388e3-eba9-4880-ae1a-76d80a704873 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:01:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-24bf332f-4837-46d8-abef-b15b6f562a1d tempest-AttachVolumeTestJSON-1943572718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:01:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-24bf332f-4837-46d8-abef-b15b6f562a1d tempest-AttachVolumeTestJSON-1943572718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:01:24 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-24bf332f-4837-46d8-abef-b15b6f562a1d tempest-AttachVolumeTestJSON-1943572718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:01:24 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-24bf332f-4837-46d8-abef-b15b6f562a1d tempest-AttachVolumeTestJSON-1943572718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:01:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-24bf332f-4837-46d8-abef-b15b6f562a1d tempest-AttachVolumeTestJSON-1943572718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:01:24 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-24bf332f-4837-46d8-abef-b15b6f562a1d tempest-AttachVolumeTestJSON-1943572718 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:01:24 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-24bf332f-4837-46d8-abef-b15b6f562a1d tempest-AttachVolumeTestJSON-1943572718 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:01:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-24bf332f-4837-46d8-abef-b15b6f562a1d tempest-AttachVolumeTestJSON-1943572718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3ea388e3-eba9-4880-ae1a-76d80a704873 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:01:24 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3ea388e3-eba9-4880-ae1a-76d80a704873 1073741824 Aug 10 13:01:24 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:01:24 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Aug 10 13:01:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-24bf332f-4837-46d8-abef-b15b6f562a1d tempest-AttachVolumeTestJSON-1943572718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3ea388e3-eba9-4880-ae1a-76d80a704873 1073741824" returned: 0 in 0.420s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:01:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-24bf332f-4837-46d8-abef-b15b6f562a1d tempest-AttachVolumeTestJSON-1943572718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3ea388e3-eba9-4880-ae1a-76d80a704873 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:01:24 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3ea388e3-eba9-4880-ae1a-76d80a704873 Aug 10 13:01:24 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:01:25 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Aug 10 13:01:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-24bf332f-4837-46d8-abef-b15b6f562a1d tempest-AttachVolumeTestJSON-1943572718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3ea388e3-eba9-4880-ae1a-76d80a704873" returned: 0 in 0.242s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:01:25 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-24bf332f-4837-46d8-abef-b15b6f562a1d tempest-AttachVolumeTestJSON-1943572718 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:01:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-24bf332f-4837-46d8-abef-b15b6f562a1d tempest-AttachVolumeTestJSON-1943572718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:01:25 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-24bf332f-4837-46d8-abef-b15b6f562a1d tempest-AttachVolumeTestJSON-1943572718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82d2a4c4-8645-40af-ba19-17331c85b550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ea388e3-eba9-4880-ae1a-76d80a704873', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:01:25 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-24bf332f-4837-46d8-abef-b15b6f562a1d tempest-AttachVolumeTestJSON-1943572718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40544c72-d1b8-4f83-ae06-bb2b1601cdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:01:25 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-24bf332f-4837-46d8-abef-b15b6f562a1d tempest-AttachVolumeTestJSON-1943572718 None] Volume volume-3ea388e3-eba9-4880-ae1a-76d80a704873 (3ea388e3-eba9-4880-ae1a-76d80a704873): created successfully Aug 10 13:01:25 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-24bf332f-4837-46d8-abef-b15b6f562a1d tempest-AttachVolumeTestJSON-1943572718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40544c72-d1b8-4f83-ae06-bb2b1601cdfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:01:25 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-24bf332f-4837-46d8-abef-b15b6f562a1d tempest-AttachVolumeTestJSON-1943572718 None] Flow 'volume_create_manager' (5e19c946-07b9-4a52-9a3d-1dcf3e9eee97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:01:25 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-24bf332f-4837-46d8-abef-b15b6f562a1d tempest-AttachVolumeTestJSON-1943572718 None] Created volume successfully. Aug 10 13:01:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-9e20d797-72c6-4f30-9186-230a3befebf8 req-d8be385c-a671-4846-9453-56163fb9a27a tempest-AttachVolumeTestJSON-1943572718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:01:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-9e20d797-72c6-4f30-9186-230a3befebf8 req-d8be385c-a671-4846-9453-56163fb9a27a tempest-AttachVolumeTestJSON-1943572718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:01:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-9e20d797-72c6-4f30-9186-230a3befebf8 req-d8be385c-a671-4846-9453-56163fb9a27a tempest-AttachVolumeTestJSON-1943572718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:01:26 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-9e20d797-72c6-4f30-9186-230a3befebf8 req-d8be385c-a671-4846-9453-56163fb9a27a tempest-AttachVolumeTestJSON-1943572718 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d', 'name': 'volume-3ea388e3-eba9-4880-ae1a-76d80a704873', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd18c990f-d7d8-4836-9141-50ff8e74802e', 'enforce_multipath': True} {{(pid=89096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Aug 10 13:01:26 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-9e20d797-72c6-4f30-9186-230a3befebf8 req-d8be385c-a671-4846-9453-56163fb9a27a tempest-AttachVolumeTestJSON-1943572718 None] attachment_update completed successfully. Aug 10 13:01:28 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-b2dec4bc-3efb-4d59-b006-9886a167007a req-e7ab7680-b6e6-4c58-ab61-05d8aeeb1d6b tempest-AttachVolumeTestJSON-1943572718 None] Terminate volume connection completed successfully. Aug 10 13:01:28 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-b2dec4bc-3efb-4d59-b006-9886a167007a req-e7ab7680-b6e6-4c58-ab61-05d8aeeb1d6b tempest-AttachVolumeTestJSON-1943572718 None] Deleting attachment efd26dfc-3083-4e8f-b69d-03957bbe6458. {{(pid=89096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Aug 10 13:01:29 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-3e267d00-105a-46d0-bf03-94bbc3a3d207 req-42995b95-1e5e-4fc6-baca-8b670f3d42e2 tempest-AttachVolumeTestJSON-1943572718 None] Terminate volume connection completed successfully. Aug 10 13:01:29 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-3e267d00-105a-46d0-bf03-94bbc3a3d207 req-42995b95-1e5e-4fc6-baca-8b670f3d42e2 tempest-AttachVolumeTestJSON-1943572718 None] Deleting attachment d18c990f-d7d8-4836-9141-50ff8e74802e. {{(pid=89096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Aug 10 13:01:34 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-cf92e308-3b6c-438a-8776-eaefa8a59b4c tempest-AttachVolumeTestJSON-1943572718 None] Acquiring lock "cinder-3ea388e3-eba9-4880-ae1a-76d80a704873-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:01:34 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-cf92e308-3b6c-438a-8776-eaefa8a59b4c tempest-AttachVolumeTestJSON-1943572718 None] Lock "cinder-3ea388e3-eba9-4880-ae1a-76d80a704873-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:01:34 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-cf92e308-3b6c-438a-8776-eaefa8a59b4c tempest-AttachVolumeTestJSON-1943572718 None] Acquiring lock "cinder-quobyte-3ea388e3-eba9-4880-ae1a-76d80a704873" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:01:34 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-cf92e308-3b6c-438a-8776-eaefa8a59b4c tempest-AttachVolumeTestJSON-1943572718 None] Lock "cinder-quobyte-3ea388e3-eba9-4880-ae1a-76d80a704873" acquired by "delete_volume" :: waited 0.015s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:01:34 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[80281f62-47b7-4c96-be67-fd5fafdf1b02]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:01:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-cf92e308-3b6c-438a-8776-eaefa8a59b4c tempest-AttachVolumeTestJSON-1943572718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3ea388e3-eba9-4880-ae1a-76d80a704873 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:01:34 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3ea388e3-eba9-4880-ae1a-76d80a704873 Aug 10 13:01:34 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:01:34 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Aug 10 13:01:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-cf92e308-3b6c-438a-8776-eaefa8a59b4c tempest-AttachVolumeTestJSON-1943572718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3ea388e3-eba9-4880-ae1a-76d80a704873" returned: 0 in 0.361s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:01:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-cf92e308-3b6c-438a-8776-eaefa8a59b4c tempest-AttachVolumeTestJSON-1943572718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3ea388e3-eba9-4880-ae1a-76d80a704873 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:01:34 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3ea388e3-eba9-4880-ae1a-76d80a704873 Aug 10 13:01:34 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:01:34 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Aug 10 13:01:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-cf92e308-3b6c-438a-8776-eaefa8a59b4c tempest-AttachVolumeTestJSON-1943572718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3ea388e3-eba9-4880-ae1a-76d80a704873" returned: 0 in 0.259s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:01:34 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-cf92e308-3b6c-438a-8776-eaefa8a59b4c tempest-AttachVolumeTestJSON-1943572718 None] Lock "cinder-quobyte-3ea388e3-eba9-4880-ae1a-76d80a704873" released by "delete_volume" :: held 0.657s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:01:34 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-cf92e308-3b6c-438a-8776-eaefa8a59b4c tempest-AttachVolumeTestJSON-1943572718 None] Created reservations ['4a448834-1d7e-43aa-b268-2d5b0a3b25e7', '01c17007-4384-44eb-9abd-28c0475c126f', '0fdbfdc8-660d-41bb-a344-e0c02f393bd1', '34b23962-d5d4-4167-9ecd-b1c43b331bc1'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:01:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-cf92e308-3b6c-438a-8776-eaefa8a59b4c tempest-AttachVolumeTestJSON-1943572718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:01:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-cf92e308-3b6c-438a-8776-eaefa8a59b4c tempest-AttachVolumeTestJSON-1943572718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:01:35 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-cf92e308-3b6c-438a-8776-eaefa8a59b4c tempest-AttachVolumeTestJSON-1943572718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:01:35 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-cf92e308-3b6c-438a-8776-eaefa8a59b4c tempest-AttachVolumeTestJSON-1943572718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:01:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-cf92e308-3b6c-438a-8776-eaefa8a59b4c tempest-AttachVolumeTestJSON-1943572718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:01:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-cf92e308-3b6c-438a-8776-eaefa8a59b4c tempest-AttachVolumeTestJSON-1943572718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:01:35 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:01:35 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:01:35 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Aug 10 13:01:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-cf92e308-3b6c-438a-8776-eaefa8a59b4c tempest-AttachVolumeTestJSON-1943572718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.260s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:01:35 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-cf92e308-3b6c-438a-8776-eaefa8a59b4c tempest-AttachVolumeTestJSON-1943572718 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:01:35 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-cf92e308-3b6c-438a-8776-eaefa8a59b4c tempest-AttachVolumeTestJSON-1943572718 None] Deleted volume successfully. Aug 10 13:01:35 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-cf92e308-3b6c-438a-8776-eaefa8a59b4c tempest-AttachVolumeTestJSON-1943572718 None] Lock "cinder-3ea388e3-eba9-4880-ae1a-76d80a704873-delete_volume" released by "delete_volume" :: held 1.123s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:01:35 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-12d831f4-440a-4ab6-a2c4-c238f41e8869 tempest-AttachVolumeTestJSON-1943572718 None] Acquiring lock "cinder-dfa18705-9728-4452-8aad-24f80e191637-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:01:35 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-12d831f4-440a-4ab6-a2c4-c238f41e8869 tempest-AttachVolumeTestJSON-1943572718 None] Lock "cinder-dfa18705-9728-4452-8aad-24f80e191637-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:01:35 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-12d831f4-440a-4ab6-a2c4-c238f41e8869 tempest-AttachVolumeTestJSON-1943572718 None] Acquiring lock "cinder-quobyte-dfa18705-9728-4452-8aad-24f80e191637" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:01:35 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-12d831f4-440a-4ab6-a2c4-c238f41e8869 tempest-AttachVolumeTestJSON-1943572718 None] Lock "cinder-quobyte-dfa18705-9728-4452-8aad-24f80e191637" acquired by "delete_volume" :: waited 0.016s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:01:35 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc06494-091a-4113-8d8a-6c21fa482f60]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:01:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-12d831f4-440a-4ab6-a2c4-c238f41e8869 tempest-AttachVolumeTestJSON-1943572718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dfa18705-9728-4452-8aad-24f80e191637 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:01:35 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dfa18705-9728-4452-8aad-24f80e191637 Aug 10 13:01:35 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:01:35 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Aug 10 13:01:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-12d831f4-440a-4ab6-a2c4-c238f41e8869 tempest-AttachVolumeTestJSON-1943572718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dfa18705-9728-4452-8aad-24f80e191637" returned: 0 in 0.364s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:01:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-12d831f4-440a-4ab6-a2c4-c238f41e8869 tempest-AttachVolumeTestJSON-1943572718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dfa18705-9728-4452-8aad-24f80e191637 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:01:35 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dfa18705-9728-4452-8aad-24f80e191637 Aug 10 13:01:35 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:01:36 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Aug 10 13:01:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-12d831f4-440a-4ab6-a2c4-c238f41e8869 tempest-AttachVolumeTestJSON-1943572718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-dfa18705-9728-4452-8aad-24f80e191637" returned: 0 in 0.251s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:01:36 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-12d831f4-440a-4ab6-a2c4-c238f41e8869 tempest-AttachVolumeTestJSON-1943572718 None] Lock "cinder-quobyte-dfa18705-9728-4452-8aad-24f80e191637" released by "delete_volume" :: held 0.659s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:01:36 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-12d831f4-440a-4ab6-a2c4-c238f41e8869 tempest-AttachVolumeTestJSON-1943572718 None] Created reservations ['ae2d953a-3175-407d-b1cc-46dc48f9d078', '665c516e-792f-435c-aa83-b97078e6af86', '45dd2964-dc02-4ab9-bfdc-17bd0fa6a499', 'c8d5c59f-f02c-4b7d-b8a1-b2e4e0e4679c'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:01:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-12d831f4-440a-4ab6-a2c4-c238f41e8869 tempest-AttachVolumeTestJSON-1943572718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:01:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-12d831f4-440a-4ab6-a2c4-c238f41e8869 tempest-AttachVolumeTestJSON-1943572718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:01:36 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-12d831f4-440a-4ab6-a2c4-c238f41e8869 tempest-AttachVolumeTestJSON-1943572718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:01:36 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-12d831f4-440a-4ab6-a2c4-c238f41e8869 tempest-AttachVolumeTestJSON-1943572718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:01:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-12d831f4-440a-4ab6-a2c4-c238f41e8869 tempest-AttachVolumeTestJSON-1943572718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:01:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-12d831f4-440a-4ab6-a2c4-c238f41e8869 tempest-AttachVolumeTestJSON-1943572718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:01:36 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:01:36 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:01:36 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Aug 10 13:01:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-12d831f4-440a-4ab6-a2c4-c238f41e8869 tempest-AttachVolumeTestJSON-1943572718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.236s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:01:36 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-12d831f4-440a-4ab6-a2c4-c238f41e8869 tempest-AttachVolumeTestJSON-1943572718 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:01:36 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-12d831f4-440a-4ab6-a2c4-c238f41e8869 tempest-AttachVolumeTestJSON-1943572718 None] Deleted volume successfully. Aug 10 13:01:36 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-12d831f4-440a-4ab6-a2c4-c238f41e8869 tempest-AttachVolumeTestJSON-1943572718 None] Lock "cinder-dfa18705-9728-4452-8aad-24f80e191637-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:01:36 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-db774176-8193-4ead-a372-aa9f376e34e1 tempest-AttachVolumeTestJSON-1943572718 None] Acquiring lock "cinder-1f2a4ae0-7d9b-423b-8a3e-300aa489c360-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:01:36 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-db774176-8193-4ead-a372-aa9f376e34e1 tempest-AttachVolumeTestJSON-1943572718 None] Lock "cinder-1f2a4ae0-7d9b-423b-8a3e-300aa489c360-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:01:36 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-db774176-8193-4ead-a372-aa9f376e34e1 tempest-AttachVolumeTestJSON-1943572718 None] Acquiring lock "cinder-quobyte-1f2a4ae0-7d9b-423b-8a3e-300aa489c360" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:01:36 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-db774176-8193-4ead-a372-aa9f376e34e1 tempest-AttachVolumeTestJSON-1943572718 None] Lock "cinder-quobyte-1f2a4ae0-7d9b-423b-8a3e-300aa489c360" acquired by "delete_volume" :: waited 0.014s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:01:36 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87f970d-8e70-40fb-a192-a8e6ba94b74c]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:01:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-db774176-8193-4ead-a372-aa9f376e34e1 tempest-AttachVolumeTestJSON-1943572718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1f2a4ae0-7d9b-423b-8a3e-300aa489c360 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:01:36 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1f2a4ae0-7d9b-423b-8a3e-300aa489c360 Aug 10 13:01:36 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:01:37 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Aug 10 13:01:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-db774176-8193-4ead-a372-aa9f376e34e1 tempest-AttachVolumeTestJSON-1943572718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1f2a4ae0-7d9b-423b-8a3e-300aa489c360" returned: 0 in 0.356s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:01:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-db774176-8193-4ead-a372-aa9f376e34e1 tempest-AttachVolumeTestJSON-1943572718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1f2a4ae0-7d9b-423b-8a3e-300aa489c360 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:01:37 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1f2a4ae0-7d9b-423b-8a3e-300aa489c360 Aug 10 13:01:37 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:01:37 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Aug 10 13:01:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-db774176-8193-4ead-a372-aa9f376e34e1 tempest-AttachVolumeTestJSON-1943572718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1f2a4ae0-7d9b-423b-8a3e-300aa489c360" returned: 0 in 0.235s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:01:37 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-db774176-8193-4ead-a372-aa9f376e34e1 tempest-AttachVolumeTestJSON-1943572718 None] Lock "cinder-quobyte-1f2a4ae0-7d9b-423b-8a3e-300aa489c360" released by "delete_volume" :: held 0.630s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:01:37 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-db774176-8193-4ead-a372-aa9f376e34e1 tempest-AttachVolumeTestJSON-1943572718 None] Created reservations ['4f2baef5-adb5-4d50-a113-8ab51a4a7681', '16486a3e-28a2-4e8b-a442-e3b9880ae168', '2dbc4e57-cb37-4e66-89c3-1ff16d487575', '1c9626cc-6d9a-445a-8173-d7080f3e54ff'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:01:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-db774176-8193-4ead-a372-aa9f376e34e1 tempest-AttachVolumeTestJSON-1943572718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:01:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-db774176-8193-4ead-a372-aa9f376e34e1 tempest-AttachVolumeTestJSON-1943572718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:01:37 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-db774176-8193-4ead-a372-aa9f376e34e1 tempest-AttachVolumeTestJSON-1943572718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:01:37 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-db774176-8193-4ead-a372-aa9f376e34e1 tempest-AttachVolumeTestJSON-1943572718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:01:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-db774176-8193-4ead-a372-aa9f376e34e1 tempest-AttachVolumeTestJSON-1943572718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:01:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-db774176-8193-4ead-a372-aa9f376e34e1 tempest-AttachVolumeTestJSON-1943572718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:01:37 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:01:37 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:01:37 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Aug 10 13:01:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-db774176-8193-4ead-a372-aa9f376e34e1 tempest-AttachVolumeTestJSON-1943572718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.252s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:01:37 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-db774176-8193-4ead-a372-aa9f376e34e1 tempest-AttachVolumeTestJSON-1943572718 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:01:37 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-db774176-8193-4ead-a372-aa9f376e34e1 tempest-AttachVolumeTestJSON-1943572718 None] Deleted volume successfully. Aug 10 13:01:37 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-db774176-8193-4ead-a372-aa9f376e34e1 tempest-AttachVolumeTestJSON-1943572718 None] Lock "cinder-1f2a4ae0-7d9b-423b-8a3e-300aa489c360-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:01:44 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-64020248-f723-4584-95a1-82b92d666eec tempest-BackendsCapabilitiesAdminTestsJSON-43280899 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576522827148, 'free_capacity_gb': 1775.7576522827148, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89096) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4831}} Aug 10 13:01:44 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6d4e1772-7195-4f45-ad8a-8812798db39b tempest-BackendsCapabilitiesAdminTestsJSON-43280899 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576522827148, 'free_capacity_gb': 1775.7576522827148, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89096) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4831}} Aug 10 13:01:47 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=37,cinder:UPDATE=36,cinder:DELETE=3,cinder:INSERT=6 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 13:01:47 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:UPDATE=30,cinder:SELECT=31,cinder:INSERT=8,cinder:DELETE=2 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 13:01:48 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-05e7f711-84c4-4580-91d8-e3347a5e1d7c tempest-GroupSnapshotsV319Test-491837196 None] Group tempest-GroupSnapshotsV319Test-Group-1201449705: creating Aug 10 13:01:48 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-05e7f711-84c4-4580-91d8-e3347a5e1d7c tempest-GroupSnapshotsV319Test-491837196 None] Group tempest-GroupSnapshotsV319Test-Group-1201449705: created successfully Aug 10 13:01:48 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-05e7f711-84c4-4580-91d8-e3347a5e1d7c tempest-GroupSnapshotsV319Test-491837196 None] Create group completed successfully. Aug 10 13:01:50 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-643ea2cd-ee56-4904-9931-c1d29456d6b4 tempest-GroupSnapshotsV319Test-491837196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:01:50 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-643ea2cd-ee56-4904-9931-c1d29456d6b4 tempest-GroupSnapshotsV319Test-491837196 None] Flow 'volume_create_manager' (c4c66d05-19c2-4f22-aaf6-cc081e11c452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:01:50 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-643ea2cd-ee56-4904-9931-c1d29456d6b4 tempest-GroupSnapshotsV319Test-491837196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04865433-5c40-40a0-a428-6b1a45e999d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:01:50 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-643ea2cd-ee56-4904-9931-c1d29456d6b4 tempest-GroupSnapshotsV319Test-491837196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04865433-5c40-40a0-a428-6b1a45e999d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1143489307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eee41316-6fdb-43ef-94e2-c044262a0434,host='devstack@QuobyteHD#QuobyteHD',id=0e19cc1a-0d77-4c60-b850-aa8e7f186474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48f800dcce034ba2885e40dd12a77e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:01:50Z,use_quota=True,user_id='6350caadad3e4713b461f23acb6b0666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81502cf9-2756-436b-b4c9-88de247e41a5),volume_type_id=81502cf9-2756-436b-b4c9-88de247e41a5)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:01:50 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-643ea2cd-ee56-4904-9931-c1d29456d6b4 tempest-GroupSnapshotsV319Test-491837196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b77ace1-5000-45bf-b4fc-a85923f076d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:01:50 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-643ea2cd-ee56-4904-9931-c1d29456d6b4 tempest-GroupSnapshotsV319Test-491837196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b77ace1-5000-45bf-b4fc-a85923f076d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:01:50 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-643ea2cd-ee56-4904-9931-c1d29456d6b4 tempest-GroupSnapshotsV319Test-491837196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c84dbf49-6fee-477c-aab2-e24d75b4bd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:01:50 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-643ea2cd-ee56-4904-9931-c1d29456d6b4 tempest-GroupSnapshotsV319Test-491837196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c84dbf49-6fee-477c-aab2-e24d75b4bd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e19cc1a-0d77-4c60-b850-aa8e7f186474', 'volume_name': 'volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:01:50 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-643ea2cd-ee56-4904-9931-c1d29456d6b4 tempest-GroupSnapshotsV319Test-491837196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (634e7f7b-c8e8-410a-99b9-38c8386bfd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:01:50 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-643ea2cd-ee56-4904-9931-c1d29456d6b4 tempest-GroupSnapshotsV319Test-491837196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (634e7f7b-c8e8-410a-99b9-38c8386bfd1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:01:50 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-643ea2cd-ee56-4904-9931-c1d29456d6b4 tempest-GroupSnapshotsV319Test-491837196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64788d3b-4c17-470a-a012-b92d3f0b57c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:01:50 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-643ea2cd-ee56-4904-9931-c1d29456d6b4 tempest-GroupSnapshotsV319Test-491837196 None] Volume 0e19cc1a-0d77-4c60-b850-aa8e7f186474: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474', 'volume_size': 1} Aug 10 13:01:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-643ea2cd-ee56-4904-9931-c1d29456d6b4 tempest-GroupSnapshotsV319Test-491837196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:01:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-643ea2cd-ee56-4904-9931-c1d29456d6b4 tempest-GroupSnapshotsV319Test-491837196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:01:50 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-643ea2cd-ee56-4904-9931-c1d29456d6b4 tempest-GroupSnapshotsV319Test-491837196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=eee41316-6fdb-43ef-94e2-c044262a0434,created_at=2026-08-10T11:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1143489307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eee41316-6fdb-43ef-94e2-c044262a0434,host='devstack@QuobyteHD#QuobyteHD',id=0e19cc1a-0d77-4c60-b850-aa8e7f186474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48f800dcce034ba2885e40dd12a77e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:01:50Z,use_quota=True,user_id='6350caadad3e4713b461f23acb6b0666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81502cf9-2756-436b-b4c9-88de247e41a5),volume_type_id=81502cf9-2756-436b-b4c9-88de247e41a5)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:01:50 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-643ea2cd-ee56-4904-9931-c1d29456d6b4 tempest-GroupSnapshotsV319Test-491837196 None] Creating volume 0e19cc1a-0d77-4c60-b850-aa8e7f186474 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:01:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-643ea2cd-ee56-4904-9931-c1d29456d6b4 tempest-GroupSnapshotsV319Test-491837196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:01:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-643ea2cd-ee56-4904-9931-c1d29456d6b4 tempest-GroupSnapshotsV319Test-491837196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:01:50 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-643ea2cd-ee56-4904-9931-c1d29456d6b4 tempest-GroupSnapshotsV319Test-491837196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:01:50 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-643ea2cd-ee56-4904-9931-c1d29456d6b4 tempest-GroupSnapshotsV319Test-491837196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:01:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-643ea2cd-ee56-4904-9931-c1d29456d6b4 tempest-GroupSnapshotsV319Test-491837196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:01:50 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-643ea2cd-ee56-4904-9931-c1d29456d6b4 tempest-GroupSnapshotsV319Test-491837196 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:01:50 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-643ea2cd-ee56-4904-9931-c1d29456d6b4 tempest-GroupSnapshotsV319Test-491837196 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:01:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-643ea2cd-ee56-4904-9931-c1d29456d6b4 tempest-GroupSnapshotsV319Test-491837196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:01:50 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474 1073741824 Aug 10 13:01:50 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:01:50 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Aug 10 13:01:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-643ea2cd-ee56-4904-9931-c1d29456d6b4 tempest-GroupSnapshotsV319Test-491837196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474 1073741824" returned: 0 in 0.407s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:01:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-643ea2cd-ee56-4904-9931-c1d29456d6b4 tempest-GroupSnapshotsV319Test-491837196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:01:50 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474 Aug 10 13:01:50 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:01:51 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Aug 10 13:01:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-643ea2cd-ee56-4904-9931-c1d29456d6b4 tempest-GroupSnapshotsV319Test-491837196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474" returned: 0 in 0.241s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:01:51 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-643ea2cd-ee56-4904-9931-c1d29456d6b4 tempest-GroupSnapshotsV319Test-491837196 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:01:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-643ea2cd-ee56-4904-9931-c1d29456d6b4 tempest-GroupSnapshotsV319Test-491837196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:01:51 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-643ea2cd-ee56-4904-9931-c1d29456d6b4 tempest-GroupSnapshotsV319Test-491837196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64788d3b-4c17-470a-a012-b92d3f0b57c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:01:51 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-643ea2cd-ee56-4904-9931-c1d29456d6b4 tempest-GroupSnapshotsV319Test-491837196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc32c821-ef20-49fc-834a-d50ace4ee1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:01:51 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-643ea2cd-ee56-4904-9931-c1d29456d6b4 tempest-GroupSnapshotsV319Test-491837196 None] Volume volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474 (0e19cc1a-0d77-4c60-b850-aa8e7f186474): created successfully Aug 10 13:01:51 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-643ea2cd-ee56-4904-9931-c1d29456d6b4 tempest-GroupSnapshotsV319Test-491837196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc32c821-ef20-49fc-834a-d50ace4ee1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:01:51 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-643ea2cd-ee56-4904-9931-c1d29456d6b4 tempest-GroupSnapshotsV319Test-491837196 None] Flow 'volume_create_manager' (c4c66d05-19c2-4f22-aaf6-cc081e11c452) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:01:51 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-643ea2cd-ee56-4904-9931-c1d29456d6b4 tempest-GroupSnapshotsV319Test-491837196 None] Created volume successfully. Aug 10 13:01:51 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-c42b307c-3da4-4a45-8bd5-e87f468f4568 tempest-GroupSnapshotsV319Test-491837196 None] GroupSnapshot e22fdced-0399-4950-a4d8-281c304e5656: creating. Aug 10 13:01:51 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c42b307c-3da4-4a45-8bd5-e87f468f4568 tempest-GroupSnapshotsV319Test-491837196 None] Group snapshot e22fdced-0399-4950-a4d8-281c304e5656: creating. {{(pid=89096) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 10 13:01:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c42b307c-3da4-4a45-8bd5-e87f468f4568 tempest-GroupSnapshotsV319Test-491837196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:01:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c42b307c-3da4-4a45-8bd5-e87f468f4568 tempest-GroupSnapshotsV319Test-491837196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:01:51 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-c42b307c-3da4-4a45-8bd5-e87f468f4568 tempest-GroupSnapshotsV319Test-491837196 None] Creating offline snapshot f0833bf4-309e-4403-a749-6c355de4ac08 of volume 0e19cc1a-0d77-4c60-b850-aa8e7f186474 {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 13:01:51 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[448a9f43-8bf0-4101-ad57-e84e5f6975cb]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:01:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c42b307c-3da4-4a45-8bd5-e87f468f4568 tempest-GroupSnapshotsV319Test-491837196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:01:51 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474 Aug 10 13:01:51 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:01:52 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Aug 10 13:01:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c42b307c-3da4-4a45-8bd5-e87f468f4568 tempest-GroupSnapshotsV319Test-491837196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474" returned: 0 in 0.360s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:01:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c42b307c-3da4-4a45-8bd5-e87f468f4568 tempest-GroupSnapshotsV319Test-491837196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474.f0833bf4-309e-4403-a749-6c355de4ac08 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:01:52 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474.f0833bf4-309e-4403-a749-6c355de4ac08 1G Aug 10 13:01:52 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:01:52 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Aug 10 13:01:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c42b307c-3da4-4a45-8bd5-e87f468f4568 tempest-GroupSnapshotsV319Test-491837196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474.f0833bf4-309e-4403-a749-6c355de4ac08 1G" returned: 0 in 0.391s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:01:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c42b307c-3da4-4a45-8bd5-e87f468f4568 tempest-GroupSnapshotsV319Test-491837196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474.f0833bf4-309e-4403-a749-6c355de4ac08 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:01:52 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474.f0833bf4-309e-4403-a749-6c355de4ac08 Aug 10 13:01:52 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:01:52 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Aug 10 13:01:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c42b307c-3da4-4a45-8bd5-e87f468f4568 tempest-GroupSnapshotsV319Test-491837196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474.f0833bf4-309e-4403-a749-6c355de4ac08" returned: 0 in 0.297s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:01:52 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-c42b307c-3da4-4a45-8bd5-e87f468f4568 tempest-GroupSnapshotsV319Test-491837196 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474.f0833bf4-309e-4403-a749-6c355de4ac08 is being set with open permissions: ugo+rw: NotImplementedError Aug 10 13:01:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c42b307c-3da4-4a45-8bd5-e87f468f4568 tempest-GroupSnapshotsV319Test-491837196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474.f0833bf4-309e-4403-a749-6c355de4ac08 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:01:52 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474.f0833bf4-309e-4403-a749-6c355de4ac08 Aug 10 13:01:52 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:01:53 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Aug 10 13:01:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c42b307c-3da4-4a45-8bd5-e87f468f4568 tempest-GroupSnapshotsV319Test-491837196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474.f0833bf4-309e-4403-a749-6c355de4ac08" returned: 0 in 0.245s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:01:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c42b307c-3da4-4a45-8bd5-e87f468f4568 tempest-GroupSnapshotsV319Test-491837196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:01:53 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474.info Aug 10 13:01:53 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:01:53 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Aug 10 13:01:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c42b307c-3da4-4a45-8bd5-e87f468f4568 tempest-GroupSnapshotsV319Test-491837196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474.info" returned: 0 in 0.236s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:01:53 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-c42b307c-3da4-4a45-8bd5-e87f468f4568 tempest-GroupSnapshotsV319Test-491837196 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474.info is being set with open permissions: ugo+rw: NotImplementedError Aug 10 13:01:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c42b307c-3da4-4a45-8bd5-e87f468f4568 tempest-GroupSnapshotsV319Test-491837196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:01:53 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474.info Aug 10 13:01:53 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:01:53 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Aug 10 13:01:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c42b307c-3da4-4a45-8bd5-e87f468f4568 tempest-GroupSnapshotsV319Test-491837196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474.info" returned: 0 in 0.248s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:01:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c42b307c-3da4-4a45-8bd5-e87f468f4568 tempest-GroupSnapshotsV319Test-491837196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.853s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:01:53 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-c42b307c-3da4-4a45-8bd5-e87f468f4568 tempest-GroupSnapshotsV319Test-491837196 None] group_snapshot e22fdced-0399-4950-a4d8-281c304e5656: created successfully Aug 10 13:01:54 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-f5c71505-28dd-4214-b404-501125e3e26b tempest-GroupSnapshotsV319Test-491837196 None] group_snapshot e22fdced-0399-4950-a4d8-281c304e5656: deleting Aug 10 13:01:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f5c71505-28dd-4214-b404-501125e3e26b tempest-GroupSnapshotsV319Test-491837196 None] group_snapshot e22fdced-0399-4950-a4d8-281c304e5656: deleting {{(pid=89096) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 10 13:01:54 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f5c71505-28dd-4214-b404-501125e3e26b tempest-GroupSnapshotsV319Test-491837196 None] Acquiring lock "cinder-quobyte-0e19cc1a-0d77-4c60-b850-aa8e7f186474" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:01:54 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f5c71505-28dd-4214-b404-501125e3e26b tempest-GroupSnapshotsV319Test-491837196 None] Lock "cinder-quobyte-0e19cc1a-0d77-4c60-b850-aa8e7f186474" acquired by "delete_snapshot" :: waited 0.014s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:01:54 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f5c71505-28dd-4214-b404-501125e3e26b tempest-GroupSnapshotsV319Test-491837196 None] Acquiring lock "cinder-quobyte-f0833bf4-309e-4403-a749-6c355de4ac08" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:01:54 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f5c71505-28dd-4214-b404-501125e3e26b tempest-GroupSnapshotsV319Test-491837196 None] Lock "cinder-quobyte-f0833bf4-309e-4403-a749-6c355de4ac08" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:01:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-f5c71505-28dd-4214-b404-501125e3e26b tempest-GroupSnapshotsV319Test-491837196 None] Deleting offline snapshot f0833bf4-309e-4403-a749-6c355de4ac08 of volume 0e19cc1a-0d77-4c60-b850-aa8e7f186474 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 13:01:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-f5c71505-28dd-4214-b404-501125e3e26b tempest-GroupSnapshotsV319Test-491837196 None] snapshot_file for this snap is: volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474.f0833bf4-309e-4403-a749-6c355de4ac08 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 13:01:54 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[0852b09b-2cf0-4341-a546-64b534065296]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:01:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f5c71505-28dd-4214-b404-501125e3e26b tempest-GroupSnapshotsV319Test-491837196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474.f0833bf4-309e-4403-a749-6c355de4ac08 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:01:54 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474.f0833bf4-309e-4403-a749-6c355de4ac08 Aug 10 13:01:54 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:01:54 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Aug 10 13:01:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f5c71505-28dd-4214-b404-501125e3e26b tempest-GroupSnapshotsV319Test-491837196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474.f0833bf4-309e-4403-a749-6c355de4ac08" returned: 0 in 0.353s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:01:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-f5c71505-28dd-4214-b404-501125e3e26b tempest-GroupSnapshotsV319Test-491837196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 13:01:54 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[93262a9a-645d-46f0-b496-8f5c69754b4d]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:01:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f5c71505-28dd-4214-b404-501125e3e26b tempest-GroupSnapshotsV319Test-491837196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:01:54 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474 Aug 10 13:01:54 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:01:54 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Aug 10 13:01:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f5c71505-28dd-4214-b404-501125e3e26b tempest-GroupSnapshotsV319Test-491837196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474" returned: 0 in 0.339s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:01:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f5c71505-28dd-4214-b404-501125e3e26b tempest-GroupSnapshotsV319Test-491837196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474.f0833bf4-309e-4403-a749-6c355de4ac08 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:01:54 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474.f0833bf4-309e-4403-a749-6c355de4ac08 Aug 10 13:01:54 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:01:55 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Aug 10 13:01:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f5c71505-28dd-4214-b404-501125e3e26b tempest-GroupSnapshotsV319Test-491837196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474.f0833bf4-309e-4403-a749-6c355de4ac08" returned: 0 in 0.319s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:01:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f5c71505-28dd-4214-b404-501125e3e26b tempest-GroupSnapshotsV319Test-491837196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474.f0833bf4-309e-4403-a749-6c355de4ac08 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:01:55 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474.f0833bf4-309e-4403-a749-6c355de4ac08 Aug 10 13:01:55 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:01:55 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Aug 10 13:01:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f5c71505-28dd-4214-b404-501125e3e26b tempest-GroupSnapshotsV319Test-491837196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474.f0833bf4-309e-4403-a749-6c355de4ac08" returned: 0 in 0.249s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:01:55 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f5c71505-28dd-4214-b404-501125e3e26b tempest-GroupSnapshotsV319Test-491837196 None] Lock "cinder-quobyte-f0833bf4-309e-4403-a749-6c355de4ac08" released by "_delete_snapshot" :: held 1.354s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:01:55 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f5c71505-28dd-4214-b404-501125e3e26b tempest-GroupSnapshotsV319Test-491837196 None] Lock "cinder-quobyte-0e19cc1a-0d77-4c60-b850-aa8e7f186474" released by "delete_snapshot" :: held 1.375s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:01:55 devstack cinder-volume[89096]: WARNING cinder.quota [None req-f5c71505-28dd-4214-b404-501125e3e26b tempest-GroupSnapshotsV319Test-491837196 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1943946511 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1943946511, it is now deprecated. Please use the default quota class for default quota. Aug 10 13:01:55 devstack cinder-volume[89096]: WARNING cinder.quota [None req-f5c71505-28dd-4214-b404-501125e3e26b tempest-GroupSnapshotsV319Test-491837196 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1943946511 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1943946511, it is now deprecated. Please use the default quota class for default quota. Aug 10 13:01:55 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-f5c71505-28dd-4214-b404-501125e3e26b tempest-GroupSnapshotsV319Test-491837196 None] Created reservations ['41dd0ec3-9911-4fdc-8499-fb319d58ee0b', 'f9730e12-9c3b-4575-a0d1-053ec416152f', '5d280c39-01eb-4e6d-8fca-0db6dbc8e7a0', '1a1faeec-d197-4eec-81d4-2bf4643676cf'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:01:55 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-f5c71505-28dd-4214-b404-501125e3e26b tempest-GroupSnapshotsV319Test-491837196 None] group_snapshot e22fdced-0399-4950-a4d8-281c304e5656: deleted successfully Aug 10 13:01:56 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-18a5164a-2003-4f9c-9bcc-f80bc7431fea tempest-GroupSnapshotsV319Test-491837196 None] Acquiring lock "cinder-quobyte-0e19cc1a-0d77-4c60-b850-aa8e7f186474" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:01:56 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-18a5164a-2003-4f9c-9bcc-f80bc7431fea tempest-GroupSnapshotsV319Test-491837196 None] Lock "cinder-quobyte-0e19cc1a-0d77-4c60-b850-aa8e7f186474" acquired by "delete_volume" :: waited 0.015s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:01:56 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[853e5b25-7f76-4a4e-bffb-f0832288cb1e]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:01:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-18a5164a-2003-4f9c-9bcc-f80bc7431fea tempest-GroupSnapshotsV319Test-491837196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:01:56 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474 Aug 10 13:01:56 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:01:57 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Aug 10 13:01:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-18a5164a-2003-4f9c-9bcc-f80bc7431fea tempest-GroupSnapshotsV319Test-491837196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474" returned: 0 in 0.348s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:01:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-18a5164a-2003-4f9c-9bcc-f80bc7431fea tempest-GroupSnapshotsV319Test-491837196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:01:57 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474 Aug 10 13:01:57 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:01:57 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Aug 10 13:01:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-18a5164a-2003-4f9c-9bcc-f80bc7431fea tempest-GroupSnapshotsV319Test-491837196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0e19cc1a-0d77-4c60-b850-aa8e7f186474" returned: 0 in 0.235s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:01:57 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-18a5164a-2003-4f9c-9bcc-f80bc7431fea tempest-GroupSnapshotsV319Test-491837196 None] Lock "cinder-quobyte-0e19cc1a-0d77-4c60-b850-aa8e7f186474" released by "delete_volume" :: held 0.643s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:01:57 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-18a5164a-2003-4f9c-9bcc-f80bc7431fea tempest-GroupSnapshotsV319Test-491837196 None] Created reservations ['c3687727-a612-4f33-8f79-87e64332708b'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:01:57 devstack cinder-volume[89096]: WARNING cinder.quota [None req-18a5164a-2003-4f9c-9bcc-f80bc7431fea tempest-GroupSnapshotsV319Test-491837196 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1943946511 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1943946511, it is now deprecated. Please use the default quota class for default quota. Aug 10 13:01:57 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-18a5164a-2003-4f9c-9bcc-f80bc7431fea tempest-GroupSnapshotsV319Test-491837196 None] Created reservations ['512b05d3-da8f-40f5-a08e-6946516bcdd8', '9d1408ef-d10c-4061-afe2-c42b5c2545ee', '89de48b4-2f7d-410c-a4db-9bd7c68a6e2b', '68c1076e-47f0-4662-adb5-e0591ec59b3a'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:01:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-18a5164a-2003-4f9c-9bcc-f80bc7431fea tempest-GroupSnapshotsV319Test-491837196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:01:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-18a5164a-2003-4f9c-9bcc-f80bc7431fea tempest-GroupSnapshotsV319Test-491837196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:01:57 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-18a5164a-2003-4f9c-9bcc-f80bc7431fea tempest-GroupSnapshotsV319Test-491837196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:01:57 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-18a5164a-2003-4f9c-9bcc-f80bc7431fea tempest-GroupSnapshotsV319Test-491837196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:01:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-18a5164a-2003-4f9c-9bcc-f80bc7431fea tempest-GroupSnapshotsV319Test-491837196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:01:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-18a5164a-2003-4f9c-9bcc-f80bc7431fea tempest-GroupSnapshotsV319Test-491837196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:01:57 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:01:57 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:01:57 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Aug 10 13:01:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-18a5164a-2003-4f9c-9bcc-f80bc7431fea tempest-GroupSnapshotsV319Test-491837196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.237s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:01:57 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-18a5164a-2003-4f9c-9bcc-f80bc7431fea tempest-GroupSnapshotsV319Test-491837196 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:01:57 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-18a5164a-2003-4f9c-9bcc-f80bc7431fea tempest-GroupSnapshotsV319Test-491837196 None] Delete group completed successfully. Aug 10 13:02:03 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 13:02:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:02:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:02:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:02:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:02:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:02:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:02:03 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:02:03 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:02:04 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Aug 10 13:02:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.256s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:02:04 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:02:04 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager._thread_info {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 13:02:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread count: 28 {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 13:02:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread info: [<_MainThread(MainThread, started 130607683133568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Aug 10 13:02:07 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-c2c040a0-ee03-4845-ad4b-694a5433fe62 tempest-GroupsTest-1167715629 None] Group tempest-Group1-329717267: creating Aug 10 13:02:07 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-c2c040a0-ee03-4845-ad4b-694a5433fe62 tempest-GroupsTest-1167715629 None] Group tempest-Group1-329717267: created successfully Aug 10 13:02:07 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-c2c040a0-ee03-4845-ad4b-694a5433fe62 tempest-GroupsTest-1167715629 None] Create group completed successfully. Aug 10 13:02:08 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-2cc332cb-da24-472f-ab96-d4d2b2c0502d tempest-GroupsTest-1167715629 None] Group tempest-Group2-1170665106: creating Aug 10 13:02:08 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-2cc332cb-da24-472f-ab96-d4d2b2c0502d tempest-GroupsTest-1167715629 None] Group tempest-Group2-1170665106: created successfully Aug 10 13:02:08 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-2cc332cb-da24-472f-ab96-d4d2b2c0502d tempest-GroupsTest-1167715629 None] Create group completed successfully. Aug 10 13:02:09 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-07f0c872-472b-441f-9ded-b24225ac7602 tempest-GroupsTest-1167715629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:02:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-07f0c872-472b-441f-9ded-b24225ac7602 tempest-GroupsTest-1167715629 None] Flow 'volume_create_manager' (cc4eab6c-0625-496b-94a9-263ecbba1d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:02:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-07f0c872-472b-441f-9ded-b24225ac7602 tempest-GroupsTest-1167715629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6146429-8a30-4008-9163-dd9c43816d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:02:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-07f0c872-472b-441f-9ded-b24225ac7602 tempest-GroupsTest-1167715629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6146429-8a30-4008-9163-dd9c43816d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1166819203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=704c826d-2ffd-4202-904d-b6d550b6d4ef,host='devstack@QuobyteHD#QuobyteHD',id=52da6df0-b596-4bb8-8952-3d11aec9282d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c99e2423f004d6aa0eb2b2fe4df200f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:02:10Z,use_quota=True,user_id='3ee2ffe1cb844366b8882af403e3a421',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a0335d0-aa87-46f7-9f45-7dd91e77dd24),volume_type_id=8a0335d0-aa87-46f7-9f45-7dd91e77dd24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:02:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-07f0c872-472b-441f-9ded-b24225ac7602 tempest-GroupsTest-1167715629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d94cb72-3375-4775-b3bf-946cb482ecff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:02:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-07f0c872-472b-441f-9ded-b24225ac7602 tempest-GroupsTest-1167715629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d94cb72-3375-4775-b3bf-946cb482ecff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:02:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-07f0c872-472b-441f-9ded-b24225ac7602 tempest-GroupsTest-1167715629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6172e8f-2a2b-40ef-a92c-4f585d424844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:02:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-07f0c872-472b-441f-9ded-b24225ac7602 tempest-GroupsTest-1167715629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6172e8f-2a2b-40ef-a92c-4f585d424844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52da6df0-b596-4bb8-8952-3d11aec9282d', 'volume_name': 'volume-52da6df0-b596-4bb8-8952-3d11aec9282d', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:02:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-07f0c872-472b-441f-9ded-b24225ac7602 tempest-GroupsTest-1167715629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7484a08e-9e77-4742-8861-66b42b002eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:02:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-07f0c872-472b-441f-9ded-b24225ac7602 tempest-GroupsTest-1167715629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7484a08e-9e77-4742-8861-66b42b002eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:02:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-07f0c872-472b-441f-9ded-b24225ac7602 tempest-GroupsTest-1167715629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff42d018-4888-4f75-b3c5-55d63c23d91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:02:09 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-07f0c872-472b-441f-9ded-b24225ac7602 tempest-GroupsTest-1167715629 None] Volume 52da6df0-b596-4bb8-8952-3d11aec9282d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52da6df0-b596-4bb8-8952-3d11aec9282d', 'volume_size': 1} Aug 10 13:02:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-07f0c872-472b-441f-9ded-b24225ac7602 tempest-GroupsTest-1167715629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:02:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-07f0c872-472b-441f-9ded-b24225ac7602 tempest-GroupsTest-1167715629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:02:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-07f0c872-472b-441f-9ded-b24225ac7602 tempest-GroupsTest-1167715629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=704c826d-2ffd-4202-904d-b6d550b6d4ef,created_at=2026-08-10T11:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1166819203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=704c826d-2ffd-4202-904d-b6d550b6d4ef,host='devstack@QuobyteHD#QuobyteHD',id=52da6df0-b596-4bb8-8952-3d11aec9282d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c99e2423f004d6aa0eb2b2fe4df200f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:02:10Z,use_quota=True,user_id='3ee2ffe1cb844366b8882af403e3a421',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a0335d0-aa87-46f7-9f45-7dd91e77dd24),volume_type_id=8a0335d0-aa87-46f7-9f45-7dd91e77dd24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:02:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-07f0c872-472b-441f-9ded-b24225ac7602 tempest-GroupsTest-1167715629 None] Creating volume 52da6df0-b596-4bb8-8952-3d11aec9282d {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:02:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-07f0c872-472b-441f-9ded-b24225ac7602 tempest-GroupsTest-1167715629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:02:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-07f0c872-472b-441f-9ded-b24225ac7602 tempest-GroupsTest-1167715629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:02:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-07f0c872-472b-441f-9ded-b24225ac7602 tempest-GroupsTest-1167715629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:02:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-07f0c872-472b-441f-9ded-b24225ac7602 tempest-GroupsTest-1167715629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:02:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-07f0c872-472b-441f-9ded-b24225ac7602 tempest-GroupsTest-1167715629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:02:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-07f0c872-472b-441f-9ded-b24225ac7602 tempest-GroupsTest-1167715629 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:02:09 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-07f0c872-472b-441f-9ded-b24225ac7602 tempest-GroupsTest-1167715629 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:02:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-07f0c872-472b-441f-9ded-b24225ac7602 tempest-GroupsTest-1167715629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-52da6df0-b596-4bb8-8952-3d11aec9282d 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:02:09 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-52da6df0-b596-4bb8-8952-3d11aec9282d 1073741824 Aug 10 13:02:09 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:02:10 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Aug 10 13:02:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-07f0c872-472b-441f-9ded-b24225ac7602 tempest-GroupsTest-1167715629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-52da6df0-b596-4bb8-8952-3d11aec9282d 1073741824" returned: 0 in 0.393s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:02:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-07f0c872-472b-441f-9ded-b24225ac7602 tempest-GroupsTest-1167715629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-52da6df0-b596-4bb8-8952-3d11aec9282d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:02:10 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-52da6df0-b596-4bb8-8952-3d11aec9282d Aug 10 13:02:10 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:02:10 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Aug 10 13:02:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-07f0c872-472b-441f-9ded-b24225ac7602 tempest-GroupsTest-1167715629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-52da6df0-b596-4bb8-8952-3d11aec9282d" returned: 0 in 0.234s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:02:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-07f0c872-472b-441f-9ded-b24225ac7602 tempest-GroupsTest-1167715629 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:02:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-07f0c872-472b-441f-9ded-b24225ac7602 tempest-GroupsTest-1167715629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:02:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-07f0c872-472b-441f-9ded-b24225ac7602 tempest-GroupsTest-1167715629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff42d018-4888-4f75-b3c5-55d63c23d91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52da6df0-b596-4bb8-8952-3d11aec9282d', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:02:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-07f0c872-472b-441f-9ded-b24225ac7602 tempest-GroupsTest-1167715629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1802f577-55be-43b1-a37a-bbdba9f61982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:02:10 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-07f0c872-472b-441f-9ded-b24225ac7602 tempest-GroupsTest-1167715629 None] Volume volume-52da6df0-b596-4bb8-8952-3d11aec9282d (52da6df0-b596-4bb8-8952-3d11aec9282d): created successfully Aug 10 13:02:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-07f0c872-472b-441f-9ded-b24225ac7602 tempest-GroupsTest-1167715629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1802f577-55be-43b1-a37a-bbdba9f61982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:02:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-07f0c872-472b-441f-9ded-b24225ac7602 tempest-GroupsTest-1167715629 None] Flow 'volume_create_manager' (cc4eab6c-0625-496b-94a9-263ecbba1d93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:02:10 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-07f0c872-472b-441f-9ded-b24225ac7602 tempest-GroupsTest-1167715629 None] Created volume successfully. Aug 10 13:02:11 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-96218a39-1165-4e73-bac6-709d4d8da38c tempest-GroupsTest-1167715629 None] Acquiring lock "cinder-quobyte-52da6df0-b596-4bb8-8952-3d11aec9282d" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:02:11 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-96218a39-1165-4e73-bac6-709d4d8da38c tempest-GroupsTest-1167715629 None] Lock "cinder-quobyte-52da6df0-b596-4bb8-8952-3d11aec9282d" acquired by "delete_volume" :: waited 0.016s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:02:11 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57efd68-f122-44c2-8ae2-94f649697092]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:02:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-96218a39-1165-4e73-bac6-709d4d8da38c tempest-GroupsTest-1167715629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-52da6df0-b596-4bb8-8952-3d11aec9282d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:02:11 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-52da6df0-b596-4bb8-8952-3d11aec9282d Aug 10 13:02:11 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:02:11 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Aug 10 13:02:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-96218a39-1165-4e73-bac6-709d4d8da38c tempest-GroupsTest-1167715629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-52da6df0-b596-4bb8-8952-3d11aec9282d" returned: 0 in 0.346s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:02:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-96218a39-1165-4e73-bac6-709d4d8da38c tempest-GroupsTest-1167715629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-52da6df0-b596-4bb8-8952-3d11aec9282d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:02:11 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-52da6df0-b596-4bb8-8952-3d11aec9282d Aug 10 13:02:11 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:02:12 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Aug 10 13:02:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-96218a39-1165-4e73-bac6-709d4d8da38c tempest-GroupsTest-1167715629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-52da6df0-b596-4bb8-8952-3d11aec9282d" returned: 0 in 0.243s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:02:12 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-96218a39-1165-4e73-bac6-709d4d8da38c tempest-GroupsTest-1167715629 None] Lock "cinder-quobyte-52da6df0-b596-4bb8-8952-3d11aec9282d" released by "delete_volume" :: held 0.626s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:02:12 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-96218a39-1165-4e73-bac6-709d4d8da38c tempest-GroupsTest-1167715629 None] Created reservations ['cb5961c1-be80-4ebb-ba92-45e288daef9b'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:02:12 devstack cinder-volume[89096]: WARNING cinder.quota [None req-96218a39-1165-4e73-bac6-709d4d8da38c tempest-GroupsTest-1167715629 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-931875558 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-931875558, it is now deprecated. Please use the default quota class for default quota. Aug 10 13:02:12 devstack cinder-volume[89096]: WARNING cinder.quota [None req-96218a39-1165-4e73-bac6-709d4d8da38c tempest-GroupsTest-1167715629 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-931875558 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-931875558, it is now deprecated. Please use the default quota class for default quota. Aug 10 13:02:12 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-96218a39-1165-4e73-bac6-709d4d8da38c tempest-GroupsTest-1167715629 None] Created reservations ['3abdc3b4-6d7f-47cc-b7ac-a6c73240eb2f', 'a5223bf0-b1af-4eb2-9828-f172c8ea366b', 'd5c074a5-37c6-4cc7-aff0-6793b91d89e2', '7b9e8289-be03-4ed6-9d5d-5f0bbe928e8e'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:02:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-96218a39-1165-4e73-bac6-709d4d8da38c tempest-GroupsTest-1167715629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:02:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-96218a39-1165-4e73-bac6-709d4d8da38c tempest-GroupsTest-1167715629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:02:12 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-96218a39-1165-4e73-bac6-709d4d8da38c tempest-GroupsTest-1167715629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:02:12 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-96218a39-1165-4e73-bac6-709d4d8da38c tempest-GroupsTest-1167715629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:02:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-96218a39-1165-4e73-bac6-709d4d8da38c tempest-GroupsTest-1167715629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:02:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-96218a39-1165-4e73-bac6-709d4d8da38c tempest-GroupsTest-1167715629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:02:12 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:02:12 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:02:12 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Aug 10 13:02:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-96218a39-1165-4e73-bac6-709d4d8da38c tempest-GroupsTest-1167715629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.236s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:02:12 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-96218a39-1165-4e73-bac6-709d4d8da38c tempest-GroupsTest-1167715629 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:02:12 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-96218a39-1165-4e73-bac6-709d4d8da38c tempest-GroupsTest-1167715629 None] Delete group completed successfully. Aug 10 13:02:12 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-01adadf8-4e5f-4198-8496-a614be39f182 tempest-GroupsTest-1167715629 None] Created reservations ['48a45f5f-2835-49e4-9335-e69f91972008'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:02:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-01adadf8-4e5f-4198-8496-a614be39f182 tempest-GroupsTest-1167715629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:02:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-01adadf8-4e5f-4198-8496-a614be39f182 tempest-GroupsTest-1167715629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:02:12 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-01adadf8-4e5f-4198-8496-a614be39f182 tempest-GroupsTest-1167715629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:02:12 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-01adadf8-4e5f-4198-8496-a614be39f182 tempest-GroupsTest-1167715629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:02:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-01adadf8-4e5f-4198-8496-a614be39f182 tempest-GroupsTest-1167715629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:02:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-01adadf8-4e5f-4198-8496-a614be39f182 tempest-GroupsTest-1167715629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:02:12 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:02:12 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:02:13 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Aug 10 13:02:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-01adadf8-4e5f-4198-8496-a614be39f182 tempest-GroupsTest-1167715629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.240s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:02:13 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-01adadf8-4e5f-4198-8496-a614be39f182 tempest-GroupsTest-1167715629 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:02:13 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-01adadf8-4e5f-4198-8496-a614be39f182 tempest-GroupsTest-1167715629 None] Delete group completed successfully. Aug 10 13:02:14 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-81e91242-7527-4d11-99d9-913e41cd0265 tempest-GroupsTest-1167715629 None] Group tempest-GroupsTest-Group-1174701753: creating Aug 10 13:02:14 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-81e91242-7527-4d11-99d9-913e41cd0265 tempest-GroupsTest-1167715629 None] Group tempest-GroupsTest-Group-1174701753: created successfully Aug 10 13:02:14 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-81e91242-7527-4d11-99d9-913e41cd0265 tempest-GroupsTest-1167715629 None] Create group completed successfully. Aug 10 13:02:16 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e045756-f73e-4d98-a51f-ffa24452ab5a tempest-GroupsTest-1167715629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:02:16 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1e045756-f73e-4d98-a51f-ffa24452ab5a tempest-GroupsTest-1167715629 None] Flow 'volume_create_manager' (77e7d11c-9c3c-473a-956d-a777608466ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:02:16 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1e045756-f73e-4d98-a51f-ffa24452ab5a tempest-GroupsTest-1167715629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55300a43-02c0-4a8f-8299-9ea95ea3ae42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:02:16 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1e045756-f73e-4d98-a51f-ffa24452ab5a tempest-GroupsTest-1167715629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55300a43-02c0-4a8f-8299-9ea95ea3ae42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1745568646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=70b14b09-05e6-4a29-b78f-67f87f4455eb,host='devstack@QuobyteHD#QuobyteHD',id=f3394bb6-91e8-437b-b88a-4561f6ea9758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c99e2423f004d6aa0eb2b2fe4df200f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:02:16Z,use_quota=True,user_id='3ee2ffe1cb844366b8882af403e3a421',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2b49341-c6b5-4f0b-bc6c-d14057d8e606),volume_type_id=a2b49341-c6b5-4f0b-bc6c-d14057d8e606)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:02:16 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1e045756-f73e-4d98-a51f-ffa24452ab5a tempest-GroupsTest-1167715629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e8ce3ea-6f26-443c-9c3b-75b72866439d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:02:16 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1e045756-f73e-4d98-a51f-ffa24452ab5a tempest-GroupsTest-1167715629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e8ce3ea-6f26-443c-9c3b-75b72866439d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:02:16 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1e045756-f73e-4d98-a51f-ffa24452ab5a tempest-GroupsTest-1167715629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d319a815-235c-4de4-9564-e13af1a30e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:02:16 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1e045756-f73e-4d98-a51f-ffa24452ab5a tempest-GroupsTest-1167715629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d319a815-235c-4de4-9564-e13af1a30e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3394bb6-91e8-437b-b88a-4561f6ea9758', 'volume_name': 'volume-f3394bb6-91e8-437b-b88a-4561f6ea9758', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:02:16 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1e045756-f73e-4d98-a51f-ffa24452ab5a tempest-GroupsTest-1167715629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (171e24ef-2821-4856-a58b-f19ce861a069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:02:16 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1e045756-f73e-4d98-a51f-ffa24452ab5a tempest-GroupsTest-1167715629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (171e24ef-2821-4856-a58b-f19ce861a069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:02:16 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1e045756-f73e-4d98-a51f-ffa24452ab5a tempest-GroupsTest-1167715629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50f2d59a-4bb8-4c60-a9f2-ae17a3a01092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:02:16 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-1e045756-f73e-4d98-a51f-ffa24452ab5a tempest-GroupsTest-1167715629 None] Volume f3394bb6-91e8-437b-b88a-4561f6ea9758: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3394bb6-91e8-437b-b88a-4561f6ea9758', 'volume_size': 1} Aug 10 13:02:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1e045756-f73e-4d98-a51f-ffa24452ab5a tempest-GroupsTest-1167715629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:02:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1e045756-f73e-4d98-a51f-ffa24452ab5a tempest-GroupsTest-1167715629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:02:16 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1e045756-f73e-4d98-a51f-ffa24452ab5a tempest-GroupsTest-1167715629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=70b14b09-05e6-4a29-b78f-67f87f4455eb,created_at=2026-08-10T11:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1745568646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=70b14b09-05e6-4a29-b78f-67f87f4455eb,host='devstack@QuobyteHD#QuobyteHD',id=f3394bb6-91e8-437b-b88a-4561f6ea9758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c99e2423f004d6aa0eb2b2fe4df200f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:02:16Z,use_quota=True,user_id='3ee2ffe1cb844366b8882af403e3a421',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2b49341-c6b5-4f0b-bc6c-d14057d8e606),volume_type_id=a2b49341-c6b5-4f0b-bc6c-d14057d8e606)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:02:16 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-1e045756-f73e-4d98-a51f-ffa24452ab5a tempest-GroupsTest-1167715629 None] Creating volume f3394bb6-91e8-437b-b88a-4561f6ea9758 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:02:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1e045756-f73e-4d98-a51f-ffa24452ab5a tempest-GroupsTest-1167715629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:02:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1e045756-f73e-4d98-a51f-ffa24452ab5a tempest-GroupsTest-1167715629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:02:16 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1e045756-f73e-4d98-a51f-ffa24452ab5a tempest-GroupsTest-1167715629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:02:16 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1e045756-f73e-4d98-a51f-ffa24452ab5a tempest-GroupsTest-1167715629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:02:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1e045756-f73e-4d98-a51f-ffa24452ab5a tempest-GroupsTest-1167715629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:02:16 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1e045756-f73e-4d98-a51f-ffa24452ab5a tempest-GroupsTest-1167715629 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:02:16 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-1e045756-f73e-4d98-a51f-ffa24452ab5a tempest-GroupsTest-1167715629 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:02:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1e045756-f73e-4d98-a51f-ffa24452ab5a tempest-GroupsTest-1167715629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f3394bb6-91e8-437b-b88a-4561f6ea9758 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:02:16 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f3394bb6-91e8-437b-b88a-4561f6ea9758 1073741824 Aug 10 13:02:16 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:02:16 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Aug 10 13:02:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1e045756-f73e-4d98-a51f-ffa24452ab5a tempest-GroupsTest-1167715629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f3394bb6-91e8-437b-b88a-4561f6ea9758 1073741824" returned: 0 in 0.402s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:02:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1e045756-f73e-4d98-a51f-ffa24452ab5a tempest-GroupsTest-1167715629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f3394bb6-91e8-437b-b88a-4561f6ea9758 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:02:16 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f3394bb6-91e8-437b-b88a-4561f6ea9758 Aug 10 13:02:16 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:02:16 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Aug 10 13:02:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1e045756-f73e-4d98-a51f-ffa24452ab5a tempest-GroupsTest-1167715629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f3394bb6-91e8-437b-b88a-4561f6ea9758" returned: 0 in 0.247s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:02:16 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1e045756-f73e-4d98-a51f-ffa24452ab5a tempest-GroupsTest-1167715629 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:02:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1e045756-f73e-4d98-a51f-ffa24452ab5a tempest-GroupsTest-1167715629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:02:16 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1e045756-f73e-4d98-a51f-ffa24452ab5a tempest-GroupsTest-1167715629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50f2d59a-4bb8-4c60-a9f2-ae17a3a01092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3394bb6-91e8-437b-b88a-4561f6ea9758', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:02:16 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1e045756-f73e-4d98-a51f-ffa24452ab5a tempest-GroupsTest-1167715629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8e40b5c-2185-4cf5-9a1c-34976650ce57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:02:16 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-1e045756-f73e-4d98-a51f-ffa24452ab5a tempest-GroupsTest-1167715629 None] Volume volume-f3394bb6-91e8-437b-b88a-4561f6ea9758 (f3394bb6-91e8-437b-b88a-4561f6ea9758): created successfully Aug 10 13:02:16 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1e045756-f73e-4d98-a51f-ffa24452ab5a tempest-GroupsTest-1167715629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8e40b5c-2185-4cf5-9a1c-34976650ce57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:02:16 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1e045756-f73e-4d98-a51f-ffa24452ab5a tempest-GroupsTest-1167715629 None] Flow 'volume_create_manager' (77e7d11c-9c3c-473a-956d-a777608466ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:02:16 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-1e045756-f73e-4d98-a51f-ffa24452ab5a tempest-GroupsTest-1167715629 None] Created volume successfully. Aug 10 13:02:17 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-82587e97-9aa8-4cfc-839f-67149dac4224 tempest-GroupsTest-1167715629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:02:17 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-82587e97-9aa8-4cfc-839f-67149dac4224 tempest-GroupsTest-1167715629 None] Flow 'volume_create_manager' (f9550709-8d8c-4e29-9e6a-cf6cb79ac735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:02:17 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-82587e97-9aa8-4cfc-839f-67149dac4224 tempest-GroupsTest-1167715629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (614b9642-aa50-4b31-b4eb-a1a7b7a10669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:02:17 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-82587e97-9aa8-4cfc-839f-67149dac4224 tempest-GroupsTest-1167715629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (614b9642-aa50-4b31-b4eb-a1a7b7a10669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1564730579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=70b14b09-05e6-4a29-b78f-67f87f4455eb,host='devstack@QuobyteHD#QuobyteHD',id=1d9b5372-82ca-41cc-9307-a23b93b28811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c99e2423f004d6aa0eb2b2fe4df200f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:02:18Z,use_quota=True,user_id='3ee2ffe1cb844366b8882af403e3a421',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2b49341-c6b5-4f0b-bc6c-d14057d8e606),volume_type_id=a2b49341-c6b5-4f0b-bc6c-d14057d8e606)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:02:17 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-82587e97-9aa8-4cfc-839f-67149dac4224 tempest-GroupsTest-1167715629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1862799-5233-43d8-b436-cb43b6863d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:02:17 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-82587e97-9aa8-4cfc-839f-67149dac4224 tempest-GroupsTest-1167715629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1862799-5233-43d8-b436-cb43b6863d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:02:17 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-82587e97-9aa8-4cfc-839f-67149dac4224 tempest-GroupsTest-1167715629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd374950-7ad4-496f-8e69-fc7baa686c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:02:17 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-82587e97-9aa8-4cfc-839f-67149dac4224 tempest-GroupsTest-1167715629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd374950-7ad4-496f-8e69-fc7baa686c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d9b5372-82ca-41cc-9307-a23b93b28811', 'volume_name': 'volume-1d9b5372-82ca-41cc-9307-a23b93b28811', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:02:17 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-82587e97-9aa8-4cfc-839f-67149dac4224 tempest-GroupsTest-1167715629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d1c3b65-a686-4c03-bd1e-9461ac7fba2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:02:17 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-82587e97-9aa8-4cfc-839f-67149dac4224 tempest-GroupsTest-1167715629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d1c3b65-a686-4c03-bd1e-9461ac7fba2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:02:17 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-82587e97-9aa8-4cfc-839f-67149dac4224 tempest-GroupsTest-1167715629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92596afd-371b-406e-b800-b979ac9dd55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:02:17 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-82587e97-9aa8-4cfc-839f-67149dac4224 tempest-GroupsTest-1167715629 None] Volume 1d9b5372-82ca-41cc-9307-a23b93b28811: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d9b5372-82ca-41cc-9307-a23b93b28811', 'volume_size': 1} Aug 10 13:02:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-82587e97-9aa8-4cfc-839f-67149dac4224 tempest-GroupsTest-1167715629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:02:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-82587e97-9aa8-4cfc-839f-67149dac4224 tempest-GroupsTest-1167715629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:02:17 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-82587e97-9aa8-4cfc-839f-67149dac4224 tempest-GroupsTest-1167715629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=70b14b09-05e6-4a29-b78f-67f87f4455eb,created_at=2026-08-10T11:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1564730579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=70b14b09-05e6-4a29-b78f-67f87f4455eb,host='devstack@QuobyteHD#QuobyteHD',id=1d9b5372-82ca-41cc-9307-a23b93b28811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c99e2423f004d6aa0eb2b2fe4df200f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:02:18Z,use_quota=True,user_id='3ee2ffe1cb844366b8882af403e3a421',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2b49341-c6b5-4f0b-bc6c-d14057d8e606),volume_type_id=a2b49341-c6b5-4f0b-bc6c-d14057d8e606)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:02:17 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-82587e97-9aa8-4cfc-839f-67149dac4224 tempest-GroupsTest-1167715629 None] Creating volume 1d9b5372-82ca-41cc-9307-a23b93b28811 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:02:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-82587e97-9aa8-4cfc-839f-67149dac4224 tempest-GroupsTest-1167715629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:02:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-82587e97-9aa8-4cfc-839f-67149dac4224 tempest-GroupsTest-1167715629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:02:17 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-82587e97-9aa8-4cfc-839f-67149dac4224 tempest-GroupsTest-1167715629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:02:17 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-82587e97-9aa8-4cfc-839f-67149dac4224 tempest-GroupsTest-1167715629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:02:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-82587e97-9aa8-4cfc-839f-67149dac4224 tempest-GroupsTest-1167715629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:02:17 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-82587e97-9aa8-4cfc-839f-67149dac4224 tempest-GroupsTest-1167715629 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:02:17 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-82587e97-9aa8-4cfc-839f-67149dac4224 tempest-GroupsTest-1167715629 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:02:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-82587e97-9aa8-4cfc-839f-67149dac4224 tempest-GroupsTest-1167715629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1d9b5372-82ca-41cc-9307-a23b93b28811 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:02:17 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1d9b5372-82ca-41cc-9307-a23b93b28811 1073741824 Aug 10 13:02:17 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:02:18 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Aug 10 13:02:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-82587e97-9aa8-4cfc-839f-67149dac4224 tempest-GroupsTest-1167715629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1d9b5372-82ca-41cc-9307-a23b93b28811 1073741824" returned: 0 in 0.393s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:02:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-82587e97-9aa8-4cfc-839f-67149dac4224 tempest-GroupsTest-1167715629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1d9b5372-82ca-41cc-9307-a23b93b28811 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:02:18 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1d9b5372-82ca-41cc-9307-a23b93b28811 Aug 10 13:02:18 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:02:18 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Aug 10 13:02:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-82587e97-9aa8-4cfc-839f-67149dac4224 tempest-GroupsTest-1167715629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1d9b5372-82ca-41cc-9307-a23b93b28811" returned: 0 in 0.232s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:02:18 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-82587e97-9aa8-4cfc-839f-67149dac4224 tempest-GroupsTest-1167715629 None] <== create_volume: return (665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:02:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-82587e97-9aa8-4cfc-839f-67149dac4224 tempest-GroupsTest-1167715629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.667s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:02:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-82587e97-9aa8-4cfc-839f-67149dac4224 tempest-GroupsTest-1167715629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92596afd-371b-406e-b800-b979ac9dd55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d9b5372-82ca-41cc-9307-a23b93b28811', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:02:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-82587e97-9aa8-4cfc-839f-67149dac4224 tempest-GroupsTest-1167715629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46afbd07-4ec6-4b1d-8259-dc4c79b5a886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:02:18 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-82587e97-9aa8-4cfc-839f-67149dac4224 tempest-GroupsTest-1167715629 None] Volume volume-1d9b5372-82ca-41cc-9307-a23b93b28811 (1d9b5372-82ca-41cc-9307-a23b93b28811): created successfully Aug 10 13:02:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-82587e97-9aa8-4cfc-839f-67149dac4224 tempest-GroupsTest-1167715629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46afbd07-4ec6-4b1d-8259-dc4c79b5a886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:02:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-82587e97-9aa8-4cfc-839f-67149dac4224 tempest-GroupsTest-1167715629 None] Flow 'volume_create_manager' (f9550709-8d8c-4e29-9e6a-cf6cb79ac735) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:02:18 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-82587e97-9aa8-4cfc-839f-67149dac4224 tempest-GroupsTest-1167715629 None] Created volume successfully. Aug 10 13:02:18 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-44eafd9b-d45c-4b16-a0ea-ab650f3517e9 tempest-GroupsTest-1167715629 None] Update group completed successfully. Aug 10 13:02:20 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-e443d02c-05c8-4c54-b32b-34a25c4e6a12 tempest-GroupsTest-1167715629 None] Update group completed successfully. Aug 10 13:02:21 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-91323677-7e28-407b-9953-b8a28f1d96d0 tempest-GroupsTest-1167715629 None] Acquiring lock "cinder-quobyte-1d9b5372-82ca-41cc-9307-a23b93b28811" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:02:21 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-91323677-7e28-407b-9953-b8a28f1d96d0 tempest-GroupsTest-1167715629 None] Lock "cinder-quobyte-1d9b5372-82ca-41cc-9307-a23b93b28811" acquired by "delete_volume" :: waited 0.019s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:02:21 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[53637a7a-7736-4a0b-94ea-8a91ce82e888]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:02:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-91323677-7e28-407b-9953-b8a28f1d96d0 tempest-GroupsTest-1167715629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1d9b5372-82ca-41cc-9307-a23b93b28811 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:02:22 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1d9b5372-82ca-41cc-9307-a23b93b28811 Aug 10 13:02:22 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:02:22 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Aug 10 13:02:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-91323677-7e28-407b-9953-b8a28f1d96d0 tempest-GroupsTest-1167715629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1d9b5372-82ca-41cc-9307-a23b93b28811" returned: 0 in 0.343s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:02:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-91323677-7e28-407b-9953-b8a28f1d96d0 tempest-GroupsTest-1167715629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1d9b5372-82ca-41cc-9307-a23b93b28811 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:02:22 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1d9b5372-82ca-41cc-9307-a23b93b28811 Aug 10 13:02:22 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:02:22 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Aug 10 13:02:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-91323677-7e28-407b-9953-b8a28f1d96d0 tempest-GroupsTest-1167715629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1d9b5372-82ca-41cc-9307-a23b93b28811" returned: 0 in 0.240s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:02:22 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-91323677-7e28-407b-9953-b8a28f1d96d0 tempest-GroupsTest-1167715629 None] Lock "cinder-quobyte-1d9b5372-82ca-41cc-9307-a23b93b28811" released by "delete_volume" :: held 0.625s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:02:22 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-91323677-7e28-407b-9953-b8a28f1d96d0 tempest-GroupsTest-1167715629 None] Acquiring lock "cinder-quobyte-f3394bb6-91e8-437b-b88a-4561f6ea9758" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:02:22 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-91323677-7e28-407b-9953-b8a28f1d96d0 tempest-GroupsTest-1167715629 None] Lock "cinder-quobyte-f3394bb6-91e8-437b-b88a-4561f6ea9758" acquired by "delete_volume" :: waited 0.012s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:02:22 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[b944bd1d-6ce5-41e5-8474-4f85d929ea86]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:02:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-91323677-7e28-407b-9953-b8a28f1d96d0 tempest-GroupsTest-1167715629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f3394bb6-91e8-437b-b88a-4561f6ea9758 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:02:22 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f3394bb6-91e8-437b-b88a-4561f6ea9758 Aug 10 13:02:22 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:02:22 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Aug 10 13:02:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-91323677-7e28-407b-9953-b8a28f1d96d0 tempest-GroupsTest-1167715629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f3394bb6-91e8-437b-b88a-4561f6ea9758" returned: 0 in 0.353s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:02:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-91323677-7e28-407b-9953-b8a28f1d96d0 tempest-GroupsTest-1167715629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f3394bb6-91e8-437b-b88a-4561f6ea9758 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:02:22 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f3394bb6-91e8-437b-b88a-4561f6ea9758 Aug 10 13:02:22 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:02:23 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Aug 10 13:02:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-91323677-7e28-407b-9953-b8a28f1d96d0 tempest-GroupsTest-1167715629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f3394bb6-91e8-437b-b88a-4561f6ea9758" returned: 0 in 0.248s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:02:23 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-91323677-7e28-407b-9953-b8a28f1d96d0 tempest-GroupsTest-1167715629 None] Lock "cinder-quobyte-f3394bb6-91e8-437b-b88a-4561f6ea9758" released by "delete_volume" :: held 0.636s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:02:23 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-91323677-7e28-407b-9953-b8a28f1d96d0 tempest-GroupsTest-1167715629 None] Created reservations ['954b645b-0046-403a-bddf-d1f09d9d20bc'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:02:23 devstack cinder-volume[89096]: WARNING cinder.quota [None req-91323677-7e28-407b-9953-b8a28f1d96d0 tempest-GroupsTest-1167715629 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-311874812 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-311874812, it is now deprecated. Please use the default quota class for default quota. Aug 10 13:02:23 devstack cinder-volume[89096]: WARNING cinder.quota [None req-91323677-7e28-407b-9953-b8a28f1d96d0 tempest-GroupsTest-1167715629 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-311874812 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-311874812, it is now deprecated. Please use the default quota class for default quota. Aug 10 13:02:23 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-91323677-7e28-407b-9953-b8a28f1d96d0 tempest-GroupsTest-1167715629 None] Created reservations ['09d5652d-ea22-45c1-9852-628066526aa6', 'eecffbca-d3b3-4c15-8cc2-c72fc77c80b2', '8bc9addf-3a02-4854-97f3-65c5945b3c4c', '8d651a0b-4a31-4b7e-bfd6-c03d8518ee87'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:02:23 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-91323677-7e28-407b-9953-b8a28f1d96d0 tempest-GroupsTest-1167715629 None] Created reservations ['89f4b2e4-8cef-4b35-bccc-0ef44e436ea4', '76e89c32-413b-4a34-b784-46defb37830f', '45ef03c8-6edd-432e-9d87-ab3646ffa8c3', '46586eea-ce6d-4297-b251-0d9f49b8ee1a'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:02:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-91323677-7e28-407b-9953-b8a28f1d96d0 tempest-GroupsTest-1167715629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:02:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-91323677-7e28-407b-9953-b8a28f1d96d0 tempest-GroupsTest-1167715629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:02:23 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-91323677-7e28-407b-9953-b8a28f1d96d0 tempest-GroupsTest-1167715629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:02:23 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-91323677-7e28-407b-9953-b8a28f1d96d0 tempest-GroupsTest-1167715629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:02:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-91323677-7e28-407b-9953-b8a28f1d96d0 tempest-GroupsTest-1167715629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:02:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-91323677-7e28-407b-9953-b8a28f1d96d0 tempest-GroupsTest-1167715629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:02:23 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:02:23 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:02:23 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Aug 10 13:02:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-91323677-7e28-407b-9953-b8a28f1d96d0 tempest-GroupsTest-1167715629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.240s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:02:23 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-91323677-7e28-407b-9953-b8a28f1d96d0 tempest-GroupsTest-1167715629 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:02:23 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-91323677-7e28-407b-9953-b8a28f1d96d0 tempest-GroupsTest-1167715629 None] Delete group completed successfully. Aug 10 13:02:33 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=66,cinder:UPDATE=62,cinder:INSERT=17,cinder:DELETE=1 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 13:02:33 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=65,cinder:UPDATE=75,cinder:INSERT=12,cinder:DELETE=3 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 13:02:34 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-64b86241-153c-4bf5-ae41-18cb028467aa tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:02:34 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-64b86241-153c-4bf5-ae41-18cb028467aa tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Flow 'volume_create_manager' (9a496073-a608-4660-a2f5-cc119708a735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:02:34 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-64b86241-153c-4bf5-ae41-18cb028467aa tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad0f6535-a17f-4cc5-81af-97c4b328732c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:02:34 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-64b86241-153c-4bf5-ae41-18cb028467aa tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad0f6535-a17f-4cc5-81af-97c4b328732c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1835543686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96c1a337-9237-498c-ac11-1381abce766a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de43dcb5f3ae4107ab444a306dc789c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:02:35Z,use_quota=True,user_id='a730612e78324860af1e543bfa28a718',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:02:34 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-64b86241-153c-4bf5-ae41-18cb028467aa tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28cb176e-0184-4cf5-be03-0606e6b89784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:02:34 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-64b86241-153c-4bf5-ae41-18cb028467aa tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28cb176e-0184-4cf5-be03-0606e6b89784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:02:34 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-64b86241-153c-4bf5-ae41-18cb028467aa tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be78428d-3ab8-4189-bd45-6fc2cf2cd189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:02:34 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-64b86241-153c-4bf5-ae41-18cb028467aa tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be78428d-3ab8-4189-bd45-6fc2cf2cd189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96c1a337-9237-498c-ac11-1381abce766a', 'volume_name': 'volume-96c1a337-9237-498c-ac11-1381abce766a', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:02:34 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-64b86241-153c-4bf5-ae41-18cb028467aa tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (844b8d7e-179c-43fe-a60c-254920eff68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:02:34 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-64b86241-153c-4bf5-ae41-18cb028467aa tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (844b8d7e-179c-43fe-a60c-254920eff68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:02:34 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-64b86241-153c-4bf5-ae41-18cb028467aa tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (989334bc-92e7-4165-a39e-392211e923a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:02:34 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-64b86241-153c-4bf5-ae41-18cb028467aa tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Volume 96c1a337-9237-498c-ac11-1381abce766a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96c1a337-9237-498c-ac11-1381abce766a', 'volume_size': 1} Aug 10 13:02:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-64b86241-153c-4bf5-ae41-18cb028467aa tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:02:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-64b86241-153c-4bf5-ae41-18cb028467aa tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:02:34 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-64b86241-153c-4bf5-ae41-18cb028467aa tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1835543686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96c1a337-9237-498c-ac11-1381abce766a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de43dcb5f3ae4107ab444a306dc789c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:02:35Z,use_quota=True,user_id='a730612e78324860af1e543bfa28a718',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:02:34 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-64b86241-153c-4bf5-ae41-18cb028467aa tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Creating volume 96c1a337-9237-498c-ac11-1381abce766a {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:02:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-64b86241-153c-4bf5-ae41-18cb028467aa tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:02:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-64b86241-153c-4bf5-ae41-18cb028467aa tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:02:34 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-64b86241-153c-4bf5-ae41-18cb028467aa tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:02:34 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-64b86241-153c-4bf5-ae41-18cb028467aa tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:02:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-64b86241-153c-4bf5-ae41-18cb028467aa tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:02:34 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-64b86241-153c-4bf5-ae41-18cb028467aa tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:02:34 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-64b86241-153c-4bf5-ae41-18cb028467aa tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:02:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-64b86241-153c-4bf5-ae41-18cb028467aa tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:02:34 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a 1073741824 Aug 10 13:02:34 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:02:35 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Aug 10 13:02:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-64b86241-153c-4bf5-ae41-18cb028467aa tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a 1073741824" returned: 0 in 0.400s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:02:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-64b86241-153c-4bf5-ae41-18cb028467aa tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:02:35 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a Aug 10 13:02:35 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:02:35 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Aug 10 13:02:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-64b86241-153c-4bf5-ae41-18cb028467aa tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a" returned: 0 in 0.238s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:02:35 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-64b86241-153c-4bf5-ae41-18cb028467aa tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:02:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-64b86241-153c-4bf5-ae41-18cb028467aa tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:02:35 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-64b86241-153c-4bf5-ae41-18cb028467aa tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (989334bc-92e7-4165-a39e-392211e923a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96c1a337-9237-498c-ac11-1381abce766a', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:02:35 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-64b86241-153c-4bf5-ae41-18cb028467aa tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e7a151d-a177-4b1e-9abb-c1bc07383cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:02:35 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-64b86241-153c-4bf5-ae41-18cb028467aa tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Volume volume-96c1a337-9237-498c-ac11-1381abce766a (96c1a337-9237-498c-ac11-1381abce766a): created successfully Aug 10 13:02:35 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-64b86241-153c-4bf5-ae41-18cb028467aa tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e7a151d-a177-4b1e-9abb-c1bc07383cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:02:35 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-64b86241-153c-4bf5-ae41-18cb028467aa tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Flow 'volume_create_manager' (9a496073-a608-4660-a2f5-cc119708a735) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:02:35 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-64b86241-153c-4bf5-ae41-18cb028467aa tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Created volume successfully. Aug 10 13:02:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-73711a16-db1a-45a7-9936-88e69650669f tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:02:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-73711a16-db1a-45a7-9936-88e69650669f tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:02:35 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-73711a16-db1a-45a7-9936-88e69650669f tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Creating offline snapshot d9591659-7e2f-4ad9-a82b-39e586307f90 of volume 96c1a337-9237-498c-ac11-1381abce766a {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 13:02:35 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d2dd9e-ae27-4bcc-a506-0718b6566416]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:02:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-73711a16-db1a-45a7-9936-88e69650669f tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:02:35 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a Aug 10 13:02:35 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:02:36 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Aug 10 13:02:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-73711a16-db1a-45a7-9936-88e69650669f tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a" returned: 0 in 0.348s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:02:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-73711a16-db1a-45a7-9936-88e69650669f tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a.d9591659-7e2f-4ad9-a82b-39e586307f90 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:02:36 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a.d9591659-7e2f-4ad9-a82b-39e586307f90 1G Aug 10 13:02:36 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:02:36 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Aug 10 13:02:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-73711a16-db1a-45a7-9936-88e69650669f tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a.d9591659-7e2f-4ad9-a82b-39e586307f90 1G" returned: 0 in 0.380s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:02:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-73711a16-db1a-45a7-9936-88e69650669f tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96c1a337-9237-498c-ac11-1381abce766a -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a.d9591659-7e2f-4ad9-a82b-39e586307f90 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:02:36 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96c1a337-9237-498c-ac11-1381abce766a -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a.d9591659-7e2f-4ad9-a82b-39e586307f90 Aug 10 13:02:36 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:02:36 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Aug 10 13:02:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-73711a16-db1a-45a7-9936-88e69650669f tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96c1a337-9237-498c-ac11-1381abce766a -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a.d9591659-7e2f-4ad9-a82b-39e586307f90" returned: 0 in 0.278s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:02:36 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-73711a16-db1a-45a7-9936-88e69650669f tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a.d9591659-7e2f-4ad9-a82b-39e586307f90 is being set with open permissions: ugo+rw Aug 10 13:02:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-73711a16-db1a-45a7-9936-88e69650669f tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a.d9591659-7e2f-4ad9-a82b-39e586307f90 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:02:36 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a.d9591659-7e2f-4ad9-a82b-39e586307f90 Aug 10 13:02:36 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:02:37 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Aug 10 13:02:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-73711a16-db1a-45a7-9936-88e69650669f tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a.d9591659-7e2f-4ad9-a82b-39e586307f90" returned: 0 in 0.233s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:02:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-73711a16-db1a-45a7-9936-88e69650669f tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:02:37 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a.info Aug 10 13:02:37 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:02:37 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Aug 10 13:02:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-73711a16-db1a-45a7-9936-88e69650669f tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a.info" returned: 0 in 0.237s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:02:37 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-73711a16-db1a-45a7-9936-88e69650669f tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a.info is being set with open permissions: ugo+rw Aug 10 13:02:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-73711a16-db1a-45a7-9936-88e69650669f tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:02:37 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a.info Aug 10 13:02:37 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:02:37 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Aug 10 13:02:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-73711a16-db1a-45a7-9936-88e69650669f tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a.info" returned: 0 in 0.237s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:02:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-73711a16-db1a-45a7-9936-88e69650669f tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.792s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:02:37 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-73711a16-db1a-45a7-9936-88e69650669f tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Create snapshot completed successfully Aug 10 13:02:38 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-60cd06b6-1750-49bb-9283-c87621b08c57 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Acquiring lock "cinder-d9591659-7e2f-4ad9-a82b-39e586307f90-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:02:38 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-60cd06b6-1750-49bb-9283-c87621b08c57 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Lock "cinder-d9591659-7e2f-4ad9-a82b-39e586307f90-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:02:38 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-60cd06b6-1750-49bb-9283-c87621b08c57 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Acquiring lock "cinder-quobyte-96c1a337-9237-498c-ac11-1381abce766a" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:02:38 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-60cd06b6-1750-49bb-9283-c87621b08c57 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Lock "cinder-quobyte-96c1a337-9237-498c-ac11-1381abce766a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:02:38 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-60cd06b6-1750-49bb-9283-c87621b08c57 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Acquiring lock "cinder-quobyte-d9591659-7e2f-4ad9-a82b-39e586307f90" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:02:38 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-60cd06b6-1750-49bb-9283-c87621b08c57 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Lock "cinder-quobyte-d9591659-7e2f-4ad9-a82b-39e586307f90" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:02:38 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-60cd06b6-1750-49bb-9283-c87621b08c57 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Deleting offline snapshot d9591659-7e2f-4ad9-a82b-39e586307f90 of volume 96c1a337-9237-498c-ac11-1381abce766a {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 13:02:38 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-60cd06b6-1750-49bb-9283-c87621b08c57 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] snapshot_file for this snap is: volume-96c1a337-9237-498c-ac11-1381abce766a.d9591659-7e2f-4ad9-a82b-39e586307f90 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 13:02:38 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf1611b-679d-4f18-ba8c-994fef0678ae]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:02:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-60cd06b6-1750-49bb-9283-c87621b08c57 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a.d9591659-7e2f-4ad9-a82b-39e586307f90 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:02:38 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a.d9591659-7e2f-4ad9-a82b-39e586307f90 Aug 10 13:02:38 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:02:38 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Aug 10 13:02:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-60cd06b6-1750-49bb-9283-c87621b08c57 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a.d9591659-7e2f-4ad9-a82b-39e586307f90" returned: 0 in 0.354s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:02:38 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-60cd06b6-1750-49bb-9283-c87621b08c57 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96c1a337-9237-498c-ac11-1381abce766a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 13:02:38 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[661ecdfc-2e71-4f19-83bf-9ba873ad158f]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:02:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-60cd06b6-1750-49bb-9283-c87621b08c57 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:02:38 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a Aug 10 13:02:38 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:02:39 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Aug 10 13:02:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-60cd06b6-1750-49bb-9283-c87621b08c57 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a" returned: 0 in 0.336s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:02:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-60cd06b6-1750-49bb-9283-c87621b08c57 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a.d9591659-7e2f-4ad9-a82b-39e586307f90 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:02:39 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a.d9591659-7e2f-4ad9-a82b-39e586307f90 Aug 10 13:02:39 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:02:39 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Aug 10 13:02:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-60cd06b6-1750-49bb-9283-c87621b08c57 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a.d9591659-7e2f-4ad9-a82b-39e586307f90" returned: 0 in 0.324s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:02:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-60cd06b6-1750-49bb-9283-c87621b08c57 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a.d9591659-7e2f-4ad9-a82b-39e586307f90 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:02:39 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a.d9591659-7e2f-4ad9-a82b-39e586307f90 Aug 10 13:02:39 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:02:39 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Aug 10 13:02:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-60cd06b6-1750-49bb-9283-c87621b08c57 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a.d9591659-7e2f-4ad9-a82b-39e586307f90" returned: 0 in 0.244s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:02:39 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-60cd06b6-1750-49bb-9283-c87621b08c57 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Lock "cinder-quobyte-d9591659-7e2f-4ad9-a82b-39e586307f90" released by "_delete_snapshot" :: held 1.356s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:02:39 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-60cd06b6-1750-49bb-9283-c87621b08c57 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Lock "cinder-quobyte-96c1a337-9237-498c-ac11-1381abce766a" released by "delete_snapshot" :: held 1.376s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:02:39 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-60cd06b6-1750-49bb-9283-c87621b08c57 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Created reservations ['301c564c-fb76-44e7-9df4-ae21924be418', '32d2205c-2694-485d-ae01-6be4f4c7ff7e', 'fd47ce1e-67f8-474e-813a-0842b4f49e5b', '075daa74-2215-44b8-bf05-aa7afd6ce43d'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:02:39 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-60cd06b6-1750-49bb-9283-c87621b08c57 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Delete snapshot completed successfully. Aug 10 13:02:39 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-60cd06b6-1750-49bb-9283-c87621b08c57 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Lock "cinder-d9591659-7e2f-4ad9-a82b-39e586307f90-delete_snapshot" released by "delete_snapshot" :: held 1.503s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:02:40 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c7ef03c2-c661-415b-bbb0-75cd831afb20 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Acquiring lock "cinder-96c1a337-9237-498c-ac11-1381abce766a-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:02:40 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c7ef03c2-c661-415b-bbb0-75cd831afb20 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Lock "cinder-96c1a337-9237-498c-ac11-1381abce766a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:02:40 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c7ef03c2-c661-415b-bbb0-75cd831afb20 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Acquiring lock "cinder-quobyte-96c1a337-9237-498c-ac11-1381abce766a" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:02:40 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c7ef03c2-c661-415b-bbb0-75cd831afb20 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Lock "cinder-quobyte-96c1a337-9237-498c-ac11-1381abce766a" acquired by "delete_volume" :: waited 0.017s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:02:40 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a17efaa-80e1-490a-8d81-3c6b5aa18e1a]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:02:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c7ef03c2-c661-415b-bbb0-75cd831afb20 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:02:40 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a Aug 10 13:02:40 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:02:40 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Aug 10 13:02:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c7ef03c2-c661-415b-bbb0-75cd831afb20 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a" returned: 0 in 0.345s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:02:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c7ef03c2-c661-415b-bbb0-75cd831afb20 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:02:40 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a Aug 10 13:02:40 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:02:41 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Aug 10 13:02:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c7ef03c2-c661-415b-bbb0-75cd831afb20 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-96c1a337-9237-498c-ac11-1381abce766a" returned: 0 in 0.238s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:02:41 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c7ef03c2-c661-415b-bbb0-75cd831afb20 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Lock "cinder-quobyte-96c1a337-9237-498c-ac11-1381abce766a" released by "delete_volume" :: held 0.639s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:02:41 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-c7ef03c2-c661-415b-bbb0-75cd831afb20 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Created reservations ['8d8c908d-a104-4c38-a1fc-f7c6ec951bd5', '048cc44b-e3db-4213-8fd6-58981a164d00', '259f5cda-8bfe-480c-928d-282d1a1d70d2', '1d66e32c-24a7-4317-870a-87430db52301'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:02:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c7ef03c2-c661-415b-bbb0-75cd831afb20 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:02:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c7ef03c2-c661-415b-bbb0-75cd831afb20 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:02:41 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c7ef03c2-c661-415b-bbb0-75cd831afb20 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:02:41 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c7ef03c2-c661-415b-bbb0-75cd831afb20 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:02:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c7ef03c2-c661-415b-bbb0-75cd831afb20 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:02:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c7ef03c2-c661-415b-bbb0-75cd831afb20 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:02:41 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:02:41 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:02:41 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Aug 10 13:02:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c7ef03c2-c661-415b-bbb0-75cd831afb20 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.242s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:02:41 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-c7ef03c2-c661-415b-bbb0-75cd831afb20 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:02:41 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-c7ef03c2-c661-415b-bbb0-75cd831afb20 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Deleted volume successfully. Aug 10 13:02:41 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c7ef03c2-c661-415b-bbb0-75cd831afb20 tempest-VolumeSnapshotQuotasNegativeTestJSON-620775658 None] Lock "cinder-96c1a337-9237-498c-ac11-1381abce766a-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:02:47 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ee28513-4cfe-4518-83cf-2a6564505db8 tempest-VolumeTypesAccessTest-1037936764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:02:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6ee28513-4cfe-4518-83cf-2a6564505db8 tempest-VolumeTypesAccessTest-1037936764 None] Flow 'volume_create_manager' (37d49932-a301-4c1e-ab49-42169dc2dfbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:02:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6ee28513-4cfe-4518-83cf-2a6564505db8 tempest-VolumeTypesAccessTest-1037936764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a77f163b-b0ba-4f10-88ac-da5713b612a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:02:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6ee28513-4cfe-4518-83cf-2a6564505db8 tempest-VolumeTypesAccessTest-1037936764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a77f163b-b0ba-4f10-88ac-da5713b612a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1379401354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe0e6fa5-871d-4dc9-924b-a32a48f504df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11de3bfd45949d7b21795dc4d8a3c2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:02:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:02:47Z,use_quota=True,user_id='e0df0f76ac2b432da0a6387a857c886f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da0e6aac-b5a0-4db2-839a-ccf7c531bd23),volume_type_id=da0e6aac-b5a0-4db2-839a-ccf7c531bd23)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:02:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6ee28513-4cfe-4518-83cf-2a6564505db8 tempest-VolumeTypesAccessTest-1037936764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ef017f-7496-41eb-8ca1-5e98a903e03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:02:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6ee28513-4cfe-4518-83cf-2a6564505db8 tempest-VolumeTypesAccessTest-1037936764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ef017f-7496-41eb-8ca1-5e98a903e03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:02:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6ee28513-4cfe-4518-83cf-2a6564505db8 tempest-VolumeTypesAccessTest-1037936764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5db7cacb-8c10-4f5f-949f-140cae921e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:02:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6ee28513-4cfe-4518-83cf-2a6564505db8 tempest-VolumeTypesAccessTest-1037936764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5db7cacb-8c10-4f5f-949f-140cae921e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe0e6fa5-871d-4dc9-924b-a32a48f504df', 'volume_name': 'volume-fe0e6fa5-871d-4dc9-924b-a32a48f504df', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:02:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6ee28513-4cfe-4518-83cf-2a6564505db8 tempest-VolumeTypesAccessTest-1037936764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fe8a4dd-dacd-4409-972a-b10d78289b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:02:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6ee28513-4cfe-4518-83cf-2a6564505db8 tempest-VolumeTypesAccessTest-1037936764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fe8a4dd-dacd-4409-972a-b10d78289b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:02:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6ee28513-4cfe-4518-83cf-2a6564505db8 tempest-VolumeTypesAccessTest-1037936764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8e36b4f-3eec-42b2-805a-84e2793f8ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:02:47 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-6ee28513-4cfe-4518-83cf-2a6564505db8 tempest-VolumeTypesAccessTest-1037936764 None] Volume fe0e6fa5-871d-4dc9-924b-a32a48f504df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe0e6fa5-871d-4dc9-924b-a32a48f504df', 'volume_size': 1} Aug 10 13:02:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6ee28513-4cfe-4518-83cf-2a6564505db8 tempest-VolumeTypesAccessTest-1037936764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:02:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6ee28513-4cfe-4518-83cf-2a6564505db8 tempest-VolumeTypesAccessTest-1037936764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:02:47 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6ee28513-4cfe-4518-83cf-2a6564505db8 tempest-VolumeTypesAccessTest-1037936764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1379401354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe0e6fa5-871d-4dc9-924b-a32a48f504df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11de3bfd45949d7b21795dc4d8a3c2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:02:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:02:47Z,use_quota=True,user_id='e0df0f76ac2b432da0a6387a857c886f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da0e6aac-b5a0-4db2-839a-ccf7c531bd23),volume_type_id=da0e6aac-b5a0-4db2-839a-ccf7c531bd23)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:02:47 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-6ee28513-4cfe-4518-83cf-2a6564505db8 tempest-VolumeTypesAccessTest-1037936764 None] Creating volume fe0e6fa5-871d-4dc9-924b-a32a48f504df {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:02:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6ee28513-4cfe-4518-83cf-2a6564505db8 tempest-VolumeTypesAccessTest-1037936764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:02:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6ee28513-4cfe-4518-83cf-2a6564505db8 tempest-VolumeTypesAccessTest-1037936764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:02:47 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6ee28513-4cfe-4518-83cf-2a6564505db8 tempest-VolumeTypesAccessTest-1037936764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:02:47 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6ee28513-4cfe-4518-83cf-2a6564505db8 tempest-VolumeTypesAccessTest-1037936764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:02:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6ee28513-4cfe-4518-83cf-2a6564505db8 tempest-VolumeTypesAccessTest-1037936764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:02:47 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6ee28513-4cfe-4518-83cf-2a6564505db8 tempest-VolumeTypesAccessTest-1037936764 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:02:47 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-6ee28513-4cfe-4518-83cf-2a6564505db8 tempest-VolumeTypesAccessTest-1037936764 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:02:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6ee28513-4cfe-4518-83cf-2a6564505db8 tempest-VolumeTypesAccessTest-1037936764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-fe0e6fa5-871d-4dc9-924b-a32a48f504df 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:02:47 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-fe0e6fa5-871d-4dc9-924b-a32a48f504df 1073741824 Aug 10 13:02:47 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:02:47 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Aug 10 13:02:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6ee28513-4cfe-4518-83cf-2a6564505db8 tempest-VolumeTypesAccessTest-1037936764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-fe0e6fa5-871d-4dc9-924b-a32a48f504df 1073741824" returned: 0 in 0.425s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:02:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6ee28513-4cfe-4518-83cf-2a6564505db8 tempest-VolumeTypesAccessTest-1037936764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-fe0e6fa5-871d-4dc9-924b-a32a48f504df {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:02:47 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-fe0e6fa5-871d-4dc9-924b-a32a48f504df Aug 10 13:02:47 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:02:47 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Aug 10 13:02:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6ee28513-4cfe-4518-83cf-2a6564505db8 tempest-VolumeTypesAccessTest-1037936764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-fe0e6fa5-871d-4dc9-924b-a32a48f504df" returned: 0 in 0.243s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:02:47 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6ee28513-4cfe-4518-83cf-2a6564505db8 tempest-VolumeTypesAccessTest-1037936764 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:02:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6ee28513-4cfe-4518-83cf-2a6564505db8 tempest-VolumeTypesAccessTest-1037936764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:02:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6ee28513-4cfe-4518-83cf-2a6564505db8 tempest-VolumeTypesAccessTest-1037936764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8e36b4f-3eec-42b2-805a-84e2793f8ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe0e6fa5-871d-4dc9-924b-a32a48f504df', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:02:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6ee28513-4cfe-4518-83cf-2a6564505db8 tempest-VolumeTypesAccessTest-1037936764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39946d9f-f1cb-4356-8348-339a0571ad6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:02:47 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-6ee28513-4cfe-4518-83cf-2a6564505db8 tempest-VolumeTypesAccessTest-1037936764 None] Volume volume-fe0e6fa5-871d-4dc9-924b-a32a48f504df (fe0e6fa5-871d-4dc9-924b-a32a48f504df): created successfully Aug 10 13:02:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6ee28513-4cfe-4518-83cf-2a6564505db8 tempest-VolumeTypesAccessTest-1037936764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39946d9f-f1cb-4356-8348-339a0571ad6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:02:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6ee28513-4cfe-4518-83cf-2a6564505db8 tempest-VolumeTypesAccessTest-1037936764 None] Flow 'volume_create_manager' (37d49932-a301-4c1e-ab49-42169dc2dfbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:02:47 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-6ee28513-4cfe-4518-83cf-2a6564505db8 tempest-VolumeTypesAccessTest-1037936764 None] Created volume successfully. Aug 10 13:02:48 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e59556d7-dbdd-481a-aab5-84cfd7afe8d7 tempest-VolumeTypesAccessTest-1037936764 None] Acquiring lock "cinder-fe0e6fa5-871d-4dc9-924b-a32a48f504df-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:02:48 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e59556d7-dbdd-481a-aab5-84cfd7afe8d7 tempest-VolumeTypesAccessTest-1037936764 None] Lock "cinder-fe0e6fa5-871d-4dc9-924b-a32a48f504df-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:02:48 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e59556d7-dbdd-481a-aab5-84cfd7afe8d7 tempest-VolumeTypesAccessTest-1037936764 None] Acquiring lock "cinder-quobyte-fe0e6fa5-871d-4dc9-924b-a32a48f504df" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:02:48 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e59556d7-dbdd-481a-aab5-84cfd7afe8d7 tempest-VolumeTypesAccessTest-1037936764 None] Lock "cinder-quobyte-fe0e6fa5-871d-4dc9-924b-a32a48f504df" acquired by "delete_volume" :: waited 0.014s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:02:48 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e0d78c-57a2-4ba2-84d8-83d8e1c6ba85]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:02:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e59556d7-dbdd-481a-aab5-84cfd7afe8d7 tempest-VolumeTypesAccessTest-1037936764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-fe0e6fa5-871d-4dc9-924b-a32a48f504df {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:02:48 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-fe0e6fa5-871d-4dc9-924b-a32a48f504df Aug 10 13:02:48 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:02:48 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Aug 10 13:02:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e59556d7-dbdd-481a-aab5-84cfd7afe8d7 tempest-VolumeTypesAccessTest-1037936764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-fe0e6fa5-871d-4dc9-924b-a32a48f504df" returned: 0 in 0.342s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:02:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e59556d7-dbdd-481a-aab5-84cfd7afe8d7 tempest-VolumeTypesAccessTest-1037936764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-fe0e6fa5-871d-4dc9-924b-a32a48f504df {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:02:48 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-fe0e6fa5-871d-4dc9-924b-a32a48f504df Aug 10 13:02:48 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:02:48 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Aug 10 13:02:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e59556d7-dbdd-481a-aab5-84cfd7afe8d7 tempest-VolumeTypesAccessTest-1037936764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-fe0e6fa5-871d-4dc9-924b-a32a48f504df" returned: 0 in 0.247s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:02:48 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e59556d7-dbdd-481a-aab5-84cfd7afe8d7 tempest-VolumeTypesAccessTest-1037936764 None] Lock "cinder-quobyte-fe0e6fa5-871d-4dc9-924b-a32a48f504df" released by "delete_volume" :: held 0.628s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:02:48 devstack cinder-volume[89096]: WARNING cinder.quota [None req-e59556d7-dbdd-481a-aab5-84cfd7afe8d7 tempest-VolumeTypesAccessTest-1037936764 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-376065181 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-376065181, it is now deprecated. Please use the default quota class for default quota. Aug 10 13:02:48 devstack cinder-volume[89096]: WARNING cinder.quota [None req-e59556d7-dbdd-481a-aab5-84cfd7afe8d7 tempest-VolumeTypesAccessTest-1037936764 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-376065181 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-376065181, it is now deprecated. Please use the default quota class for default quota. Aug 10 13:02:48 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-e59556d7-dbdd-481a-aab5-84cfd7afe8d7 tempest-VolumeTypesAccessTest-1037936764 None] Created reservations ['cc2b5a00-3777-41e5-b4a2-b60104e18279', '33eda262-b8f8-4b1e-a56f-b620c4f259e7', '550d24f3-3550-4209-a1fc-d3f7232d5a92', 'e0cd6f20-fbf5-4637-9a73-bae9fa9d9fb7'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:02:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e59556d7-dbdd-481a-aab5-84cfd7afe8d7 tempest-VolumeTypesAccessTest-1037936764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:02:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e59556d7-dbdd-481a-aab5-84cfd7afe8d7 tempest-VolumeTypesAccessTest-1037936764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:02:48 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e59556d7-dbdd-481a-aab5-84cfd7afe8d7 tempest-VolumeTypesAccessTest-1037936764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:02:48 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e59556d7-dbdd-481a-aab5-84cfd7afe8d7 tempest-VolumeTypesAccessTest-1037936764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:02:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e59556d7-dbdd-481a-aab5-84cfd7afe8d7 tempest-VolumeTypesAccessTest-1037936764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:02:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e59556d7-dbdd-481a-aab5-84cfd7afe8d7 tempest-VolumeTypesAccessTest-1037936764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:02:49 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:02:49 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:02:49 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Aug 10 13:02:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e59556d7-dbdd-481a-aab5-84cfd7afe8d7 tempest-VolumeTypesAccessTest-1037936764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.239s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:02:49 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-e59556d7-dbdd-481a-aab5-84cfd7afe8d7 tempest-VolumeTypesAccessTest-1037936764 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:02:49 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-e59556d7-dbdd-481a-aab5-84cfd7afe8d7 tempest-VolumeTypesAccessTest-1037936764 None] Deleted volume successfully. Aug 10 13:02:49 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e59556d7-dbdd-481a-aab5-84cfd7afe8d7 tempest-VolumeTypesAccessTest-1037936764 None] Lock "cinder-fe0e6fa5-871d-4dc9-924b-a32a48f504df-delete_volume" released by "delete_volume" :: held 1.045s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:02:58 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:UPDATE=29,cinder:SELECT=22,cinder:INSERT=8,cinder:DELETE=1 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 13:02:59 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=24,cinder:UPDATE=29,cinder:DELETE=4,cinder:INSERT=7 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 13:03:01 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5de8658-3c7d-4540-8726-02504d9e4e0f tempest-SnapshotMetadataTestJSON-67575704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:03:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a5de8658-3c7d-4540-8726-02504d9e4e0f tempest-SnapshotMetadataTestJSON-67575704 None] Flow 'volume_create_manager' (bcdee133-f985-4330-b8a5-3487cc300b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:03:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a5de8658-3c7d-4540-8726-02504d9e4e0f tempest-SnapshotMetadataTestJSON-67575704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a95f1200-c54d-4c44-84c0-ce8c1701b76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a5de8658-3c7d-4540-8726-02504d9e4e0f tempest-SnapshotMetadataTestJSON-67575704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a95f1200-c54d-4c44-84c0-ce8c1701b76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-213044827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42bb2776c4b643f68ead7e2ac37b6d76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:03:01Z,use_quota=True,user_id='01399c9ad6aa4989bc70cc2cb37b0ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a5de8658-3c7d-4540-8726-02504d9e4e0f tempest-SnapshotMetadataTestJSON-67575704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae9626ce-7884-47c9-a95a-6fb352167561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a5de8658-3c7d-4540-8726-02504d9e4e0f tempest-SnapshotMetadataTestJSON-67575704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae9626ce-7884-47c9-a95a-6fb352167561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a5de8658-3c7d-4540-8726-02504d9e4e0f tempest-SnapshotMetadataTestJSON-67575704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (defa16ea-605d-415a-b8da-dd42a3e9edae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a5de8658-3c7d-4540-8726-02504d9e4e0f tempest-SnapshotMetadataTestJSON-67575704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (defa16ea-605d-415a-b8da-dd42a3e9edae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed', 'volume_name': 'volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a5de8658-3c7d-4540-8726-02504d9e4e0f tempest-SnapshotMetadataTestJSON-67575704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d3a63c-3364-4dc6-8721-88f0457af172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a5de8658-3c7d-4540-8726-02504d9e4e0f tempest-SnapshotMetadataTestJSON-67575704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d3a63c-3364-4dc6-8721-88f0457af172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a5de8658-3c7d-4540-8726-02504d9e4e0f tempest-SnapshotMetadataTestJSON-67575704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75c0e18d-d342-4b37-87cb-7e801887f00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:01 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-a5de8658-3c7d-4540-8726-02504d9e4e0f tempest-SnapshotMetadataTestJSON-67575704 None] Volume bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed', 'volume_size': 1} Aug 10 13:03:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a5de8658-3c7d-4540-8726-02504d9e4e0f tempest-SnapshotMetadataTestJSON-67575704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:03:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a5de8658-3c7d-4540-8726-02504d9e4e0f tempest-SnapshotMetadataTestJSON-67575704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:03:01 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a5de8658-3c7d-4540-8726-02504d9e4e0f tempest-SnapshotMetadataTestJSON-67575704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-213044827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42bb2776c4b643f68ead7e2ac37b6d76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:03:01Z,use_quota=True,user_id='01399c9ad6aa4989bc70cc2cb37b0ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:03:01 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-a5de8658-3c7d-4540-8726-02504d9e4e0f tempest-SnapshotMetadataTestJSON-67575704 None] Creating volume bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:03:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a5de8658-3c7d-4540-8726-02504d9e4e0f tempest-SnapshotMetadataTestJSON-67575704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:03:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a5de8658-3c7d-4540-8726-02504d9e4e0f tempest-SnapshotMetadataTestJSON-67575704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:03:01 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a5de8658-3c7d-4540-8726-02504d9e4e0f tempest-SnapshotMetadataTestJSON-67575704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:03:01 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a5de8658-3c7d-4540-8726-02504d9e4e0f tempest-SnapshotMetadataTestJSON-67575704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:03:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a5de8658-3c7d-4540-8726-02504d9e4e0f tempest-SnapshotMetadataTestJSON-67575704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:03:01 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a5de8658-3c7d-4540-8726-02504d9e4e0f tempest-SnapshotMetadataTestJSON-67575704 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:03:01 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-a5de8658-3c7d-4540-8726-02504d9e4e0f tempest-SnapshotMetadataTestJSON-67575704 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:03:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a5de8658-3c7d-4540-8726-02504d9e4e0f tempest-SnapshotMetadataTestJSON-67575704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:01 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed 1073741824 Aug 10 13:03:01 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:01 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a5de8658-3c7d-4540-8726-02504d9e4e0f tempest-SnapshotMetadataTestJSON-67575704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed 1073741824" returned: 0 in 0.406s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a5de8658-3c7d-4540-8726-02504d9e4e0f tempest-SnapshotMetadataTestJSON-67575704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:01 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed Aug 10 13:03:01 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:01 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a5de8658-3c7d-4540-8726-02504d9e4e0f tempest-SnapshotMetadataTestJSON-67575704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed" returned: 0 in 0.237s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:01 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a5de8658-3c7d-4540-8726-02504d9e4e0f tempest-SnapshotMetadataTestJSON-67575704 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:03:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a5de8658-3c7d-4540-8726-02504d9e4e0f tempest-SnapshotMetadataTestJSON-67575704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:03:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a5de8658-3c7d-4540-8726-02504d9e4e0f tempest-SnapshotMetadataTestJSON-67575704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75c0e18d-d342-4b37-87cb-7e801887f00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a5de8658-3c7d-4540-8726-02504d9e4e0f tempest-SnapshotMetadataTestJSON-67575704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be2568db-68d0-4702-ac15-806dbf12a92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:01 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-a5de8658-3c7d-4540-8726-02504d9e4e0f tempest-SnapshotMetadataTestJSON-67575704 None] Volume volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed (bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed): created successfully Aug 10 13:03:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a5de8658-3c7d-4540-8726-02504d9e4e0f tempest-SnapshotMetadataTestJSON-67575704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be2568db-68d0-4702-ac15-806dbf12a92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a5de8658-3c7d-4540-8726-02504d9e4e0f tempest-SnapshotMetadataTestJSON-67575704 None] Flow 'volume_create_manager' (bcdee133-f985-4330-b8a5-3487cc300b42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:03:01 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-a5de8658-3c7d-4540-8726-02504d9e4e0f tempest-SnapshotMetadataTestJSON-67575704 None] Created volume successfully. Aug 10 13:03:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-49330b83-38a2-4755-a07c-292d549ddee0 tempest-SnapshotMetadataTestJSON-67575704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:03:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-49330b83-38a2-4755-a07c-292d549ddee0 tempest-SnapshotMetadataTestJSON-67575704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:03:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-49330b83-38a2-4755-a07c-292d549ddee0 tempest-SnapshotMetadataTestJSON-67575704 None] Creating offline snapshot e4d33168-e9fb-42f3-a1b4-f55607d8eac9 of volume bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 13:03:02 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab065fb-82ac-42e7-a153-dcba985c6854]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:03:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-49330b83-38a2-4755-a07c-292d549ddee0 tempest-SnapshotMetadataTestJSON-67575704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:02 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed Aug 10 13:03:02 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:02 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-49330b83-38a2-4755-a07c-292d549ddee0 tempest-SnapshotMetadataTestJSON-67575704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed" returned: 0 in 0.347s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-49330b83-38a2-4755-a07c-292d549ddee0 tempest-SnapshotMetadataTestJSON-67575704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed.e4d33168-e9fb-42f3-a1b4-f55607d8eac9 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:02 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed.e4d33168-e9fb-42f3-a1b4-f55607d8eac9 1G Aug 10 13:03:02 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:03 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-49330b83-38a2-4755-a07c-292d549ddee0 tempest-SnapshotMetadataTestJSON-67575704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed.e4d33168-e9fb-42f3-a1b4-f55607d8eac9 1G" returned: 0 in 0.369s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-49330b83-38a2-4755-a07c-292d549ddee0 tempest-SnapshotMetadataTestJSON-67575704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed.e4d33168-e9fb-42f3-a1b4-f55607d8eac9 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:03 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed.e4d33168-e9fb-42f3-a1b4-f55607d8eac9 Aug 10 13:03:03 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:03 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-49330b83-38a2-4755-a07c-292d549ddee0 tempest-SnapshotMetadataTestJSON-67575704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed.e4d33168-e9fb-42f3-a1b4-f55607d8eac9" returned: 0 in 0.284s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:03 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-49330b83-38a2-4755-a07c-292d549ddee0 tempest-SnapshotMetadataTestJSON-67575704 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed.e4d33168-e9fb-42f3-a1b4-f55607d8eac9 is being set with open permissions: ugo+rw Aug 10 13:03:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-49330b83-38a2-4755-a07c-292d549ddee0 tempest-SnapshotMetadataTestJSON-67575704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed.e4d33168-e9fb-42f3-a1b4-f55607d8eac9 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:03 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed.e4d33168-e9fb-42f3-a1b4-f55607d8eac9 Aug 10 13:03:03 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:03 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-49330b83-38a2-4755-a07c-292d549ddee0 tempest-SnapshotMetadataTestJSON-67575704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed.e4d33168-e9fb-42f3-a1b4-f55607d8eac9" returned: 0 in 0.256s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-49330b83-38a2-4755-a07c-292d549ddee0 tempest-SnapshotMetadataTestJSON-67575704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:03 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed.info Aug 10 13:03:03 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:03 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 13:03:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:03:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:03:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:03:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:03:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:03:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:03 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-49330b83-38a2-4755-a07c-292d549ddee0 tempest-SnapshotMetadataTestJSON-67575704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed.info" returned: 0 in 0.253s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:03 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-49330b83-38a2-4755-a07c-292d549ddee0 tempest-SnapshotMetadataTestJSON-67575704 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed.info is being set with open permissions: ugo+rw Aug 10 13:03:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-49330b83-38a2-4755-a07c-292d549ddee0 tempest-SnapshotMetadataTestJSON-67575704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:03 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:03:03 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:03 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed.info Aug 10 13:03:03 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:04 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.256s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:04 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:03:04 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-49330b83-38a2-4755-a07c-292d549ddee0 tempest-SnapshotMetadataTestJSON-67575704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed.info" returned: 0 in 0.240s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-49330b83-38a2-4755-a07c-292d549ddee0 tempest-SnapshotMetadataTestJSON-67575704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.840s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:03:04 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager._thread_info {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 13:03:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread count: 28 {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 13:03:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread info: [<_MainThread(MainThread, started 130607683133568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Aug 10 13:03:04 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-49330b83-38a2-4755-a07c-292d549ddee0 tempest-SnapshotMetadataTestJSON-67575704 None] Create snapshot completed successfully Aug 10 13:03:05 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-566ce97a-6c87-4269-8c4c-47be4eb92026 tempest-SnapshotMetadataTestJSON-67575704 None] Acquiring lock "cinder-e4d33168-e9fb-42f3-a1b4-f55607d8eac9-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:03:05 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-566ce97a-6c87-4269-8c4c-47be4eb92026 tempest-SnapshotMetadataTestJSON-67575704 None] Lock "cinder-e4d33168-e9fb-42f3-a1b4-f55607d8eac9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:03:05 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-566ce97a-6c87-4269-8c4c-47be4eb92026 tempest-SnapshotMetadataTestJSON-67575704 None] Acquiring lock "cinder-quobyte-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:03:05 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-566ce97a-6c87-4269-8c4c-47be4eb92026 tempest-SnapshotMetadataTestJSON-67575704 None] Lock "cinder-quobyte-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed" acquired by "delete_snapshot" :: waited 0.015s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:03:05 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-566ce97a-6c87-4269-8c4c-47be4eb92026 tempest-SnapshotMetadataTestJSON-67575704 None] Acquiring lock "cinder-quobyte-e4d33168-e9fb-42f3-a1b4-f55607d8eac9" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:03:05 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-566ce97a-6c87-4269-8c4c-47be4eb92026 tempest-SnapshotMetadataTestJSON-67575704 None] Lock "cinder-quobyte-e4d33168-e9fb-42f3-a1b4-f55607d8eac9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:03:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-566ce97a-6c87-4269-8c4c-47be4eb92026 tempest-SnapshotMetadataTestJSON-67575704 None] Deleting offline snapshot e4d33168-e9fb-42f3-a1b4-f55607d8eac9 of volume bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 13:03:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-566ce97a-6c87-4269-8c4c-47be4eb92026 tempest-SnapshotMetadataTestJSON-67575704 None] snapshot_file for this snap is: volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed.e4d33168-e9fb-42f3-a1b4-f55607d8eac9 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 13:03:05 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b53d60c-5e5d-437e-a8f0-8575cc56345d]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:03:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-566ce97a-6c87-4269-8c4c-47be4eb92026 tempest-SnapshotMetadataTestJSON-67575704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed.e4d33168-e9fb-42f3-a1b4-f55607d8eac9 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:05 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed.e4d33168-e9fb-42f3-a1b4-f55607d8eac9 Aug 10 13:03:05 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:05 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-566ce97a-6c87-4269-8c4c-47be4eb92026 tempest-SnapshotMetadataTestJSON-67575704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed.e4d33168-e9fb-42f3-a1b4-f55607d8eac9" returned: 0 in 0.352s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-566ce97a-6c87-4269-8c4c-47be4eb92026 tempest-SnapshotMetadataTestJSON-67575704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 13:03:05 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[034685eb-2873-41ee-a546-7b12b610b293]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:03:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-566ce97a-6c87-4269-8c4c-47be4eb92026 tempest-SnapshotMetadataTestJSON-67575704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:05 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed Aug 10 13:03:05 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:05 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-566ce97a-6c87-4269-8c4c-47be4eb92026 tempest-SnapshotMetadataTestJSON-67575704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed" returned: 0 in 0.337s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-566ce97a-6c87-4269-8c4c-47be4eb92026 tempest-SnapshotMetadataTestJSON-67575704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed.e4d33168-e9fb-42f3-a1b4-f55607d8eac9 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:05 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed.e4d33168-e9fb-42f3-a1b4-f55607d8eac9 Aug 10 13:03:05 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:06 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-566ce97a-6c87-4269-8c4c-47be4eb92026 tempest-SnapshotMetadataTestJSON-67575704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed.e4d33168-e9fb-42f3-a1b4-f55607d8eac9" returned: 0 in 0.337s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-566ce97a-6c87-4269-8c4c-47be4eb92026 tempest-SnapshotMetadataTestJSON-67575704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed.e4d33168-e9fb-42f3-a1b4-f55607d8eac9 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:06 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed.e4d33168-e9fb-42f3-a1b4-f55607d8eac9 Aug 10 13:03:06 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:06 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-566ce97a-6c87-4269-8c4c-47be4eb92026 tempest-SnapshotMetadataTestJSON-67575704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed.e4d33168-e9fb-42f3-a1b4-f55607d8eac9" returned: 0 in 0.239s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:06 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-566ce97a-6c87-4269-8c4c-47be4eb92026 tempest-SnapshotMetadataTestJSON-67575704 None] Lock "cinder-quobyte-e4d33168-e9fb-42f3-a1b4-f55607d8eac9" released by "_delete_snapshot" :: held 1.366s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:03:06 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-566ce97a-6c87-4269-8c4c-47be4eb92026 tempest-SnapshotMetadataTestJSON-67575704 None] Lock "cinder-quobyte-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed" released by "delete_snapshot" :: held 1.387s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:03:06 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-566ce97a-6c87-4269-8c4c-47be4eb92026 tempest-SnapshotMetadataTestJSON-67575704 None] Created reservations ['2ffec75b-9b29-47ae-8bb4-f6c52c04e067', 'd300eb9c-c8d2-4d1c-8e37-09cb19aed665', '212f3c57-02bc-4def-816e-bfd2a0c6af17', 'b1054795-c036-497f-b78e-00b964d71f83'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:03:06 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-566ce97a-6c87-4269-8c4c-47be4eb92026 tempest-SnapshotMetadataTestJSON-67575704 None] Delete snapshot completed successfully. Aug 10 13:03:06 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-566ce97a-6c87-4269-8c4c-47be4eb92026 tempest-SnapshotMetadataTestJSON-67575704 None] Lock "cinder-e4d33168-e9fb-42f3-a1b4-f55607d8eac9-delete_snapshot" released by "delete_snapshot" :: held 1.510s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:03:07 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-fb73b058-ee77-4eb4-b9de-3a2b53a2fcaf tempest-SnapshotMetadataTestJSON-67575704 None] Acquiring lock "cinder-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:03:07 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-fb73b058-ee77-4eb4-b9de-3a2b53a2fcaf tempest-SnapshotMetadataTestJSON-67575704 None] Lock "cinder-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:03:07 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-fb73b058-ee77-4eb4-b9de-3a2b53a2fcaf tempest-SnapshotMetadataTestJSON-67575704 None] Acquiring lock "cinder-quobyte-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:03:07 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-fb73b058-ee77-4eb4-b9de-3a2b53a2fcaf tempest-SnapshotMetadataTestJSON-67575704 None] Lock "cinder-quobyte-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed" acquired by "delete_volume" :: waited 0.014s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:03:07 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e61bd9-f0f9-4f39-bf08-c918d64d333c]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:03:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fb73b058-ee77-4eb4-b9de-3a2b53a2fcaf tempest-SnapshotMetadataTestJSON-67575704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:07 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed Aug 10 13:03:07 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:07 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fb73b058-ee77-4eb4-b9de-3a2b53a2fcaf tempest-SnapshotMetadataTestJSON-67575704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed" returned: 0 in 0.349s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fb73b058-ee77-4eb4-b9de-3a2b53a2fcaf tempest-SnapshotMetadataTestJSON-67575704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:07 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed Aug 10 13:03:07 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:07 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fb73b058-ee77-4eb4-b9de-3a2b53a2fcaf tempest-SnapshotMetadataTestJSON-67575704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed" returned: 0 in 0.233s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:07 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-fb73b058-ee77-4eb4-b9de-3a2b53a2fcaf tempest-SnapshotMetadataTestJSON-67575704 None] Lock "cinder-quobyte-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed" released by "delete_volume" :: held 0.634s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:03:07 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-fb73b058-ee77-4eb4-b9de-3a2b53a2fcaf tempest-SnapshotMetadataTestJSON-67575704 None] Created reservations ['1edc37bb-d26a-4490-8b57-e4392b32ccc3', '9279c4b6-69c7-44a7-9805-ae06ce7f5401', '7c2c36ac-4dba-4e00-b653-e7bf16132ac2', '162cd7b0-b021-4871-a593-3ed3a4d87ba5'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:03:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-fb73b058-ee77-4eb4-b9de-3a2b53a2fcaf tempest-SnapshotMetadataTestJSON-67575704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:03:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-fb73b058-ee77-4eb4-b9de-3a2b53a2fcaf tempest-SnapshotMetadataTestJSON-67575704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:03:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-fb73b058-ee77-4eb4-b9de-3a2b53a2fcaf tempest-SnapshotMetadataTestJSON-67575704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:03:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-fb73b058-ee77-4eb4-b9de-3a2b53a2fcaf tempest-SnapshotMetadataTestJSON-67575704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:03:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-fb73b058-ee77-4eb4-b9de-3a2b53a2fcaf tempest-SnapshotMetadataTestJSON-67575704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:03:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fb73b058-ee77-4eb4-b9de-3a2b53a2fcaf tempest-SnapshotMetadataTestJSON-67575704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:08 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:03:08 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:08 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fb73b058-ee77-4eb4-b9de-3a2b53a2fcaf tempest-SnapshotMetadataTestJSON-67575704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.242s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:08 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-fb73b058-ee77-4eb4-b9de-3a2b53a2fcaf tempest-SnapshotMetadataTestJSON-67575704 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:03:08 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-fb73b058-ee77-4eb4-b9de-3a2b53a2fcaf tempest-SnapshotMetadataTestJSON-67575704 None] Deleted volume successfully. Aug 10 13:03:08 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-fb73b058-ee77-4eb4-b9de-3a2b53a2fcaf tempest-SnapshotMetadataTestJSON-67575704 None] Lock "cinder-bf3fbbc4-2b0e-4d6d-ba6b-3043e7dd0aed-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:03:10 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-23fd4b62-0800-4084-92d0-789a95daebad tempest-VolumesDeleteCascade-956128722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:03:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-23fd4b62-0800-4084-92d0-789a95daebad tempest-VolumesDeleteCascade-956128722 None] Flow 'volume_create_manager' (b6fc98ca-9e4a-48ed-9c4d-75db5453c79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:03:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-23fd4b62-0800-4084-92d0-789a95daebad tempest-VolumesDeleteCascade-956128722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e5ce2f-fdff-4b2d-b8e9-fe15f3f9a5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-23fd4b62-0800-4084-92d0-789a95daebad tempest-VolumesDeleteCascade-956128722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e5ce2f-fdff-4b2d-b8e9-fe15f3f9a5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-998115006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d772181a-f979-4208-8625-50a8cffd71ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3614bddb1f942bba6edb79452554a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:03:11Z,use_quota=True,user_id='9da8bcfd710a4e809a12bc4aabd9d33b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-23fd4b62-0800-4084-92d0-789a95daebad tempest-VolumesDeleteCascade-956128722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (294e9e9b-188d-4cca-954b-b902e9127d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-23fd4b62-0800-4084-92d0-789a95daebad tempest-VolumesDeleteCascade-956128722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (294e9e9b-188d-4cca-954b-b902e9127d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-23fd4b62-0800-4084-92d0-789a95daebad tempest-VolumesDeleteCascade-956128722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fd22771-e16d-4ee2-a091-de7e1eeb6fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-23fd4b62-0800-4084-92d0-789a95daebad tempest-VolumesDeleteCascade-956128722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fd22771-e16d-4ee2-a091-de7e1eeb6fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd772181a-f979-4208-8625-50a8cffd71ad', 'volume_name': 'volume-d772181a-f979-4208-8625-50a8cffd71ad', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-23fd4b62-0800-4084-92d0-789a95daebad tempest-VolumesDeleteCascade-956128722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cac498e-c558-42d3-9cc4-0dafcb8845b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-23fd4b62-0800-4084-92d0-789a95daebad tempest-VolumesDeleteCascade-956128722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cac498e-c558-42d3-9cc4-0dafcb8845b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-23fd4b62-0800-4084-92d0-789a95daebad tempest-VolumesDeleteCascade-956128722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28407532-4cff-4271-af36-4895e1d2761e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:11 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-23fd4b62-0800-4084-92d0-789a95daebad tempest-VolumesDeleteCascade-956128722 None] Volume d772181a-f979-4208-8625-50a8cffd71ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d772181a-f979-4208-8625-50a8cffd71ad', 'volume_size': 1} Aug 10 13:03:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-23fd4b62-0800-4084-92d0-789a95daebad tempest-VolumesDeleteCascade-956128722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:03:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-23fd4b62-0800-4084-92d0-789a95daebad tempest-VolumesDeleteCascade-956128722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:03:11 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-23fd4b62-0800-4084-92d0-789a95daebad tempest-VolumesDeleteCascade-956128722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-998115006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d772181a-f979-4208-8625-50a8cffd71ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3614bddb1f942bba6edb79452554a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:03:11Z,use_quota=True,user_id='9da8bcfd710a4e809a12bc4aabd9d33b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:03:11 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-23fd4b62-0800-4084-92d0-789a95daebad tempest-VolumesDeleteCascade-956128722 None] Creating volume d772181a-f979-4208-8625-50a8cffd71ad {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:03:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-23fd4b62-0800-4084-92d0-789a95daebad tempest-VolumesDeleteCascade-956128722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:03:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-23fd4b62-0800-4084-92d0-789a95daebad tempest-VolumesDeleteCascade-956128722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:03:11 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-23fd4b62-0800-4084-92d0-789a95daebad tempest-VolumesDeleteCascade-956128722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:03:11 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-23fd4b62-0800-4084-92d0-789a95daebad tempest-VolumesDeleteCascade-956128722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:03:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-23fd4b62-0800-4084-92d0-789a95daebad tempest-VolumesDeleteCascade-956128722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:03:11 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-23fd4b62-0800-4084-92d0-789a95daebad tempest-VolumesDeleteCascade-956128722 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:03:11 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-23fd4b62-0800-4084-92d0-789a95daebad tempest-VolumesDeleteCascade-956128722 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:03:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-23fd4b62-0800-4084-92d0-789a95daebad tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:11 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad 1073741824 Aug 10 13:03:11 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:11 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-23fd4b62-0800-4084-92d0-789a95daebad tempest-VolumesDeleteCascade-956128722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad 1073741824" returned: 0 in 0.418s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-23fd4b62-0800-4084-92d0-789a95daebad tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:11 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad Aug 10 13:03:11 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:11 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-23fd4b62-0800-4084-92d0-789a95daebad tempest-VolumesDeleteCascade-956128722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad" returned: 0 in 0.240s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:11 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-23fd4b62-0800-4084-92d0-789a95daebad tempest-VolumesDeleteCascade-956128722 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:03:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-23fd4b62-0800-4084-92d0-789a95daebad tempest-VolumesDeleteCascade-956128722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:03:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-23fd4b62-0800-4084-92d0-789a95daebad tempest-VolumesDeleteCascade-956128722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28407532-4cff-4271-af36-4895e1d2761e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d772181a-f979-4208-8625-50a8cffd71ad', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-23fd4b62-0800-4084-92d0-789a95daebad tempest-VolumesDeleteCascade-956128722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c37cb37-7974-4d99-9e78-1cf210ee5e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:11 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-23fd4b62-0800-4084-92d0-789a95daebad tempest-VolumesDeleteCascade-956128722 None] Volume volume-d772181a-f979-4208-8625-50a8cffd71ad (d772181a-f979-4208-8625-50a8cffd71ad): created successfully Aug 10 13:03:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-23fd4b62-0800-4084-92d0-789a95daebad tempest-VolumesDeleteCascade-956128722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c37cb37-7974-4d99-9e78-1cf210ee5e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-23fd4b62-0800-4084-92d0-789a95daebad tempest-VolumesDeleteCascade-956128722 None] Flow 'volume_create_manager' (b6fc98ca-9e4a-48ed-9c4d-75db5453c79b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:03:11 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-23fd4b62-0800-4084-92d0-789a95daebad tempest-VolumesDeleteCascade-956128722 None] Created volume successfully. Aug 10 13:03:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-05bf7e26-bb4a-4739-a9b4-fcb1a7281434 tempest-VolumesDeleteCascade-956128722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:03:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-05bf7e26-bb4a-4739-a9b4-fcb1a7281434 tempest-VolumesDeleteCascade-956128722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:03:12 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-05bf7e26-bb4a-4739-a9b4-fcb1a7281434 tempest-VolumesDeleteCascade-956128722 None] Creating offline snapshot 9a759c5b-06c7-4d9f-8bae-a9687500c741 of volume d772181a-f979-4208-8625-50a8cffd71ad {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 13:03:12 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc87b9a-ae3c-4594-8f5b-49d31dd4b277]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:03:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-05bf7e26-bb4a-4739-a9b4-fcb1a7281434 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:12 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad Aug 10 13:03:12 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:12 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-05bf7e26-bb4a-4739-a9b4-fcb1a7281434 tempest-VolumesDeleteCascade-956128722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad" returned: 0 in 0.351s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-05bf7e26-bb4a-4739-a9b4-fcb1a7281434 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.9a759c5b-06c7-4d9f-8bae-a9687500c741 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:12 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.9a759c5b-06c7-4d9f-8bae-a9687500c741 1G Aug 10 13:03:12 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:12 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-05bf7e26-bb4a-4739-a9b4-fcb1a7281434 tempest-VolumesDeleteCascade-956128722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.9a759c5b-06c7-4d9f-8bae-a9687500c741 1G" returned: 0 in 0.379s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-05bf7e26-bb4a-4739-a9b4-fcb1a7281434 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d772181a-f979-4208-8625-50a8cffd71ad -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.9a759c5b-06c7-4d9f-8bae-a9687500c741 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:12 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d772181a-f979-4208-8625-50a8cffd71ad -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.9a759c5b-06c7-4d9f-8bae-a9687500c741 Aug 10 13:03:12 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:13 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-05bf7e26-bb4a-4739-a9b4-fcb1a7281434 tempest-VolumesDeleteCascade-956128722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d772181a-f979-4208-8625-50a8cffd71ad -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.9a759c5b-06c7-4d9f-8bae-a9687500c741" returned: 0 in 0.284s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:13 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-05bf7e26-bb4a-4739-a9b4-fcb1a7281434 tempest-VolumesDeleteCascade-956128722 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.9a759c5b-06c7-4d9f-8bae-a9687500c741 is being set with open permissions: ugo+rw Aug 10 13:03:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-05bf7e26-bb4a-4739-a9b4-fcb1a7281434 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.9a759c5b-06c7-4d9f-8bae-a9687500c741 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:13 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.9a759c5b-06c7-4d9f-8bae-a9687500c741 Aug 10 13:03:13 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:13 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-05bf7e26-bb4a-4739-a9b4-fcb1a7281434 tempest-VolumesDeleteCascade-956128722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.9a759c5b-06c7-4d9f-8bae-a9687500c741" returned: 0 in 0.237s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-05bf7e26-bb4a-4739-a9b4-fcb1a7281434 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:13 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.info Aug 10 13:03:13 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:13 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-05bf7e26-bb4a-4739-a9b4-fcb1a7281434 tempest-VolumesDeleteCascade-956128722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.info" returned: 0 in 0.244s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:13 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-05bf7e26-bb4a-4739-a9b4-fcb1a7281434 tempest-VolumesDeleteCascade-956128722 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.info is being set with open permissions: ugo+rw Aug 10 13:03:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-05bf7e26-bb4a-4739-a9b4-fcb1a7281434 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:13 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.info Aug 10 13:03:13 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:13 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-05bf7e26-bb4a-4739-a9b4-fcb1a7281434 tempest-VolumesDeleteCascade-956128722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.info" returned: 0 in 0.231s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-05bf7e26-bb4a-4739-a9b4-fcb1a7281434 tempest-VolumesDeleteCascade-956128722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.806s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:03:13 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-05bf7e26-bb4a-4739-a9b4-fcb1a7281434 tempest-VolumesDeleteCascade-956128722 None] Create snapshot completed successfully Aug 10 13:03:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b10831ff-e1ea-43ca-8712-d8e8f3132c66 tempest-VolumesDeleteCascade-956128722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:03:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b10831ff-e1ea-43ca-8712-d8e8f3132c66 tempest-VolumesDeleteCascade-956128722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:03:14 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-b10831ff-e1ea-43ca-8712-d8e8f3132c66 tempest-VolumesDeleteCascade-956128722 None] Creating offline snapshot 10a0af53-6fa0-4a30-891b-01e650067006 of volume d772181a-f979-4208-8625-50a8cffd71ad {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 13:03:14 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12241c5-c698-4707-a324-eb0c849b0e78]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:03:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b10831ff-e1ea-43ca-8712-d8e8f3132c66 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.9a759c5b-06c7-4d9f-8bae-a9687500c741 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:14 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.9a759c5b-06c7-4d9f-8bae-a9687500c741 Aug 10 13:03:14 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:14 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b10831ff-e1ea-43ca-8712-d8e8f3132c66 tempest-VolumesDeleteCascade-956128722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.9a759c5b-06c7-4d9f-8bae-a9687500c741" returned: 0 in 0.352s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:14 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-b10831ff-e1ea-43ca-8712-d8e8f3132c66 tempest-VolumesDeleteCascade-956128722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d772181a-f979-4208-8625-50a8cffd71ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 13:03:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b10831ff-e1ea-43ca-8712-d8e8f3132c66 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.9a759c5b-06c7-4d9f-8bae-a9687500c741,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.10a0af53-6fa0-4a30-891b-01e650067006 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:14 devstack sudo[106314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.9a759c5b-06c7-4d9f-8bae-a9687500c741,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.10a0af53-6fa0-4a30-891b-01e650067006 1G Aug 10 13:03:14 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:15 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b10831ff-e1ea-43ca-8712-d8e8f3132c66 tempest-VolumesDeleteCascade-956128722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.9a759c5b-06c7-4d9f-8bae-a9687500c741,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.10a0af53-6fa0-4a30-891b-01e650067006 1G" returned: 0 in 0.396s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b10831ff-e1ea-43ca-8712-d8e8f3132c66 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d772181a-f979-4208-8625-50a8cffd71ad.9a759c5b-06c7-4d9f-8bae-a9687500c741 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.10a0af53-6fa0-4a30-891b-01e650067006 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:15 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d772181a-f979-4208-8625-50a8cffd71ad.9a759c5b-06c7-4d9f-8bae-a9687500c741 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.10a0af53-6fa0-4a30-891b-01e650067006 Aug 10 13:03:15 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:15 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b10831ff-e1ea-43ca-8712-d8e8f3132c66 tempest-VolumesDeleteCascade-956128722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d772181a-f979-4208-8625-50a8cffd71ad.9a759c5b-06c7-4d9f-8bae-a9687500c741 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.10a0af53-6fa0-4a30-891b-01e650067006" returned: 0 in 0.279s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:15 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-b10831ff-e1ea-43ca-8712-d8e8f3132c66 tempest-VolumesDeleteCascade-956128722 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.10a0af53-6fa0-4a30-891b-01e650067006 is being set with open permissions: ugo+rw Aug 10 13:03:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b10831ff-e1ea-43ca-8712-d8e8f3132c66 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.10a0af53-6fa0-4a30-891b-01e650067006 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:15 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.10a0af53-6fa0-4a30-891b-01e650067006 Aug 10 13:03:15 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:15 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b10831ff-e1ea-43ca-8712-d8e8f3132c66 tempest-VolumesDeleteCascade-956128722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.10a0af53-6fa0-4a30-891b-01e650067006" returned: 0 in 0.246s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b10831ff-e1ea-43ca-8712-d8e8f3132c66 tempest-VolumesDeleteCascade-956128722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.365s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:03:15 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-b10831ff-e1ea-43ca-8712-d8e8f3132c66 tempest-VolumesDeleteCascade-956128722 None] Create snapshot completed successfully Aug 10 13:03:16 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Acquiring lock "cinder-d772181a-f979-4208-8625-50a8cffd71ad-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:03:16 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Lock "cinder-d772181a-f979-4208-8625-50a8cffd71ad-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:03:16 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Performing cascade delete. {{(pid=89096) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 10 13:03:16 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Acquiring lock "cinder-10a0af53-6fa0-4a30-891b-01e650067006-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:03:16 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Lock "cinder-10a0af53-6fa0-4a30-891b-01e650067006-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:03:16 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Acquiring lock "cinder-quobyte-d772181a-f979-4208-8625-50a8cffd71ad" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:03:16 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Lock "cinder-quobyte-d772181a-f979-4208-8625-50a8cffd71ad" acquired by "delete_snapshot" :: waited 0.013s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:03:16 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Acquiring lock "cinder-quobyte-10a0af53-6fa0-4a30-891b-01e650067006" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:03:16 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Lock "cinder-quobyte-10a0af53-6fa0-4a30-891b-01e650067006" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:03:16 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Deleting offline snapshot 10a0af53-6fa0-4a30-891b-01e650067006 of volume d772181a-f979-4208-8625-50a8cffd71ad {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 13:03:16 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] snapshot_file for this snap is: volume-d772181a-f979-4208-8625-50a8cffd71ad.10a0af53-6fa0-4a30-891b-01e650067006 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 13:03:16 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a3cfa4-c134-4774-a4dc-e5c5a2c57350]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:03:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.10a0af53-6fa0-4a30-891b-01e650067006 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:16 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.10a0af53-6fa0-4a30-891b-01e650067006 Aug 10 13:03:16 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:17 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.10a0af53-6fa0-4a30-891b-01e650067006" returned: 0 in 0.360s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:17 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d772181a-f979-4208-8625-50a8cffd71ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 13:03:17 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c5d09b-55ac-4e86-abd0-e7d0c6ef1cef]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:03:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.9a759c5b-06c7-4d9f-8bae-a9687500c741 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:17 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.9a759c5b-06c7-4d9f-8bae-a9687500c741 Aug 10 13:03:17 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:17 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.9a759c5b-06c7-4d9f-8bae-a9687500c741" returned: 0 in 0.343s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:17 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d772181a-f979-4208-8625-50a8cffd71ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 13:03:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.10a0af53-6fa0-4a30-891b-01e650067006 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:17 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.10a0af53-6fa0-4a30-891b-01e650067006 Aug 10 13:03:17 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:17 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.10a0af53-6fa0-4a30-891b-01e650067006" returned: 0 in 0.374s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.10a0af53-6fa0-4a30-891b-01e650067006 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:17 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.10a0af53-6fa0-4a30-891b-01e650067006 Aug 10 13:03:17 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:18 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.10a0af53-6fa0-4a30-891b-01e650067006" returned: 0 in 0.238s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:18 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Lock "cinder-quobyte-10a0af53-6fa0-4a30-891b-01e650067006" released by "_delete_snapshot" :: held 1.405s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:03:18 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Lock "cinder-quobyte-d772181a-f979-4208-8625-50a8cffd71ad" released by "delete_snapshot" :: held 1.428s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:03:18 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Created reservations ['9e1271b2-4834-453f-8727-d3320804e765', '9cda7042-9780-451c-b19a-bdb7fbc62489', '1ca28341-d52b-477d-80fd-26a31e90165e', '79c271a5-acca-4494-8146-6c0f0d1dd2bd'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:03:18 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Delete snapshot completed successfully. Aug 10 13:03:18 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Lock "cinder-10a0af53-6fa0-4a30-891b-01e650067006-delete_snapshot" released by "delete_snapshot" :: held 1.567s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:03:18 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Acquiring lock "cinder-9a759c5b-06c7-4d9f-8bae-a9687500c741-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:03:18 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Lock "cinder-9a759c5b-06c7-4d9f-8bae-a9687500c741-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:03:18 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Acquiring lock "cinder-quobyte-d772181a-f979-4208-8625-50a8cffd71ad" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:03:18 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Lock "cinder-quobyte-d772181a-f979-4208-8625-50a8cffd71ad" acquired by "delete_snapshot" :: waited 0.013s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:03:18 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Acquiring lock "cinder-quobyte-9a759c5b-06c7-4d9f-8bae-a9687500c741" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:03:18 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Lock "cinder-quobyte-9a759c5b-06c7-4d9f-8bae-a9687500c741" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:03:18 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Deleting offline snapshot 9a759c5b-06c7-4d9f-8bae-a9687500c741 of volume d772181a-f979-4208-8625-50a8cffd71ad {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 13:03:18 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] snapshot_file for this snap is: volume-d772181a-f979-4208-8625-50a8cffd71ad.9a759c5b-06c7-4d9f-8bae-a9687500c741 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 13:03:18 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7da5ab-7967-4415-95dd-fd324e430e88]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:03:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.9a759c5b-06c7-4d9f-8bae-a9687500c741 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:18 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.9a759c5b-06c7-4d9f-8bae-a9687500c741 Aug 10 13:03:18 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:18 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.9a759c5b-06c7-4d9f-8bae-a9687500c741" returned: 0 in 0.362s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:18 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d772181a-f979-4208-8625-50a8cffd71ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 13:03:18 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[3409d861-fb49-4d0a-bfda-4a89a64a6f7a]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:03:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:18 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad Aug 10 13:03:18 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:19 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad" returned: 0 in 0.344s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.9a759c5b-06c7-4d9f-8bae-a9687500c741 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:19 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.9a759c5b-06c7-4d9f-8bae-a9687500c741 Aug 10 13:03:19 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:19 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.9a759c5b-06c7-4d9f-8bae-a9687500c741" returned: 0 in 0.322s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.9a759c5b-06c7-4d9f-8bae-a9687500c741 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:19 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.9a759c5b-06c7-4d9f-8bae-a9687500c741 Aug 10 13:03:19 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:19 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad.9a759c5b-06c7-4d9f-8bae-a9687500c741" returned: 0 in 0.249s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:19 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Lock "cinder-quobyte-9a759c5b-06c7-4d9f-8bae-a9687500c741" released by "_delete_snapshot" :: held 1.362s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:03:19 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Lock "cinder-quobyte-d772181a-f979-4208-8625-50a8cffd71ad" released by "delete_snapshot" :: held 1.381s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:03:19 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Created reservations ['e02e8f34-9022-4297-bdd2-d71b6c3dc5c8', '1fb4d9ff-4af2-498e-b0d5-42bc6f22390e', '6d246f55-2dd6-4347-9111-cd7d6285a2e9', 'db1a0c66-aafa-410e-9c77-b7f3f31a9bb9'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:03:19 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Delete snapshot completed successfully. Aug 10 13:03:19 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Lock "cinder-9a759c5b-06c7-4d9f-8bae-a9687500c741-delete_snapshot" released by "delete_snapshot" :: held 1.515s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:03:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Snapshots deleted, issuing volume delete {{(pid=89096) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 10 13:03:19 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Acquiring lock "cinder-quobyte-d772181a-f979-4208-8625-50a8cffd71ad" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:03:19 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Lock "cinder-quobyte-d772181a-f979-4208-8625-50a8cffd71ad" acquired by "delete_volume" :: waited 0.015s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:03:19 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[6290dac7-891a-4759-8962-627f20472b96]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:03:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:19 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad Aug 10 13:03:19 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:20 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad" returned: 0 in 0.359s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:20 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad Aug 10 13:03:20 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:20 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d772181a-f979-4208-8625-50a8cffd71ad" returned: 0 in 0.277s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:20 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Lock "cinder-quobyte-d772181a-f979-4208-8625-50a8cffd71ad" released by "delete_volume" :: held 0.701s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:03:20 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Created reservations ['954d158f-3fe5-4ec4-b03e-b02c48785446', '98ecc1e1-27c1-4864-9f23-694ab21b492d', 'd69b744a-cb7f-41b4-bc48-62b00d155b33', '6b2bfe40-f3eb-4d12-bca0-802c7794b4a1'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:03:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:03:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:03:20 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:03:20 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:03:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:03:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:20 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:03:20 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:20 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.256s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:20 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:03:20 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Deleted volume successfully. Aug 10 13:03:20 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b02e4f5f-4da5-4cb8-a064-99977c1d4703 tempest-VolumesDeleteCascade-956128722 None] Lock "cinder-d772181a-f979-4208-8625-50a8cffd71ad-delete_volume" released by "delete_volume" :: held 4.296s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:03:21 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-b469f982-54bd-485d-90c3-0bf28be867da tempest-VolumesDeleteCascade-956128722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:03:21 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b469f982-54bd-485d-90c3-0bf28be867da tempest-VolumesDeleteCascade-956128722 None] Flow 'volume_create_manager' (fdb69b2d-fbc7-420b-8260-42ab0cd10e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:03:21 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b469f982-54bd-485d-90c3-0bf28be867da tempest-VolumesDeleteCascade-956128722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (667634d0-8f42-4c99-baef-c4ad7ea5da3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:21 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b469f982-54bd-485d-90c3-0bf28be867da tempest-VolumesDeleteCascade-956128722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (667634d0-8f42-4c99-baef-c4ad7ea5da3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1939247631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aee6b5c8-7006-4d9b-894b-044a244382a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3614bddb1f942bba6edb79452554a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:03:21Z,use_quota=True,user_id='9da8bcfd710a4e809a12bc4aabd9d33b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:21 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b469f982-54bd-485d-90c3-0bf28be867da tempest-VolumesDeleteCascade-956128722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (493eb7f6-0fb3-411b-afa6-7081c94c293c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:21 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b469f982-54bd-485d-90c3-0bf28be867da tempest-VolumesDeleteCascade-956128722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (493eb7f6-0fb3-411b-afa6-7081c94c293c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:21 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b469f982-54bd-485d-90c3-0bf28be867da tempest-VolumesDeleteCascade-956128722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b72a34f9-20b6-49cb-9278-c2d274689611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:21 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b469f982-54bd-485d-90c3-0bf28be867da tempest-VolumesDeleteCascade-956128722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b72a34f9-20b6-49cb-9278-c2d274689611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aee6b5c8-7006-4d9b-894b-044a244382a2', 'volume_name': 'volume-aee6b5c8-7006-4d9b-894b-044a244382a2', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:21 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b469f982-54bd-485d-90c3-0bf28be867da tempest-VolumesDeleteCascade-956128722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d324f0e4-dfea-4189-9bd4-8ab3ea92fb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:21 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b469f982-54bd-485d-90c3-0bf28be867da tempest-VolumesDeleteCascade-956128722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d324f0e4-dfea-4189-9bd4-8ab3ea92fb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:21 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b469f982-54bd-485d-90c3-0bf28be867da tempest-VolumesDeleteCascade-956128722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8e099a1-4d7d-497e-90d6-37f4390a8cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:21 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-b469f982-54bd-485d-90c3-0bf28be867da tempest-VolumesDeleteCascade-956128722 None] Volume aee6b5c8-7006-4d9b-894b-044a244382a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aee6b5c8-7006-4d9b-894b-044a244382a2', 'volume_size': 1} Aug 10 13:03:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b469f982-54bd-485d-90c3-0bf28be867da tempest-VolumesDeleteCascade-956128722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:03:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b469f982-54bd-485d-90c3-0bf28be867da tempest-VolumesDeleteCascade-956128722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:03:21 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b469f982-54bd-485d-90c3-0bf28be867da tempest-VolumesDeleteCascade-956128722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1939247631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aee6b5c8-7006-4d9b-894b-044a244382a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3614bddb1f942bba6edb79452554a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:03:21Z,use_quota=True,user_id='9da8bcfd710a4e809a12bc4aabd9d33b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:03:21 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-b469f982-54bd-485d-90c3-0bf28be867da tempest-VolumesDeleteCascade-956128722 None] Creating volume aee6b5c8-7006-4d9b-894b-044a244382a2 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:03:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b469f982-54bd-485d-90c3-0bf28be867da tempest-VolumesDeleteCascade-956128722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:03:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b469f982-54bd-485d-90c3-0bf28be867da tempest-VolumesDeleteCascade-956128722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:03:21 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b469f982-54bd-485d-90c3-0bf28be867da tempest-VolumesDeleteCascade-956128722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:03:21 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b469f982-54bd-485d-90c3-0bf28be867da tempest-VolumesDeleteCascade-956128722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:03:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b469f982-54bd-485d-90c3-0bf28be867da tempest-VolumesDeleteCascade-956128722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:03:21 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b469f982-54bd-485d-90c3-0bf28be867da tempest-VolumesDeleteCascade-956128722 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:03:21 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-b469f982-54bd-485d-90c3-0bf28be867da tempest-VolumesDeleteCascade-956128722 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:03:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b469f982-54bd-485d-90c3-0bf28be867da tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:21 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2 1073741824 Aug 10 13:03:21 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:21 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b469f982-54bd-485d-90c3-0bf28be867da tempest-VolumesDeleteCascade-956128722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2 1073741824" returned: 0 in 0.394s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b469f982-54bd-485d-90c3-0bf28be867da tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:22 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2 Aug 10 13:03:22 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:22 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b469f982-54bd-485d-90c3-0bf28be867da tempest-VolumesDeleteCascade-956128722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2" returned: 0 in 0.235s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:22 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b469f982-54bd-485d-90c3-0bf28be867da tempest-VolumesDeleteCascade-956128722 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:03:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b469f982-54bd-485d-90c3-0bf28be867da tempest-VolumesDeleteCascade-956128722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:03:22 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b469f982-54bd-485d-90c3-0bf28be867da tempest-VolumesDeleteCascade-956128722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8e099a1-4d7d-497e-90d6-37f4390a8cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aee6b5c8-7006-4d9b-894b-044a244382a2', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:22 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b469f982-54bd-485d-90c3-0bf28be867da tempest-VolumesDeleteCascade-956128722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c6a126-e367-4b44-a045-56832192d4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:22 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-b469f982-54bd-485d-90c3-0bf28be867da tempest-VolumesDeleteCascade-956128722 None] Volume volume-aee6b5c8-7006-4d9b-894b-044a244382a2 (aee6b5c8-7006-4d9b-894b-044a244382a2): created successfully Aug 10 13:03:22 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b469f982-54bd-485d-90c3-0bf28be867da tempest-VolumesDeleteCascade-956128722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c6a126-e367-4b44-a045-56832192d4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:22 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b469f982-54bd-485d-90c3-0bf28be867da tempest-VolumesDeleteCascade-956128722 None] Flow 'volume_create_manager' (fdb69b2d-fbc7-420b-8260-42ab0cd10e71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:03:22 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-b469f982-54bd-485d-90c3-0bf28be867da tempest-VolumesDeleteCascade-956128722 None] Created volume successfully. Aug 10 13:03:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-656368b8-44c5-4299-92aa-d32f5b397589 tempest-VolumesDeleteCascade-956128722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:03:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-656368b8-44c5-4299-92aa-d32f5b397589 tempest-VolumesDeleteCascade-956128722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:03:22 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-656368b8-44c5-4299-92aa-d32f5b397589 tempest-VolumesDeleteCascade-956128722 None] Creating offline snapshot 68a87b03-ae9d-4bce-9034-2e6e5d2571a0 of volume aee6b5c8-7006-4d9b-894b-044a244382a2 {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 13:03:22 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6e374d-31b8-4a33-8719-6ffdd9fb9f70]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:03:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-656368b8-44c5-4299-92aa-d32f5b397589 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:22 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2 Aug 10 13:03:22 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:23 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-656368b8-44c5-4299-92aa-d32f5b397589 tempest-VolumesDeleteCascade-956128722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2" returned: 0 in 0.352s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-656368b8-44c5-4299-92aa-d32f5b397589 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2.68a87b03-ae9d-4bce-9034-2e6e5d2571a0 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:23 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2.68a87b03-ae9d-4bce-9034-2e6e5d2571a0 1G Aug 10 13:03:23 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:23 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-656368b8-44c5-4299-92aa-d32f5b397589 tempest-VolumesDeleteCascade-956128722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2.68a87b03-ae9d-4bce-9034-2e6e5d2571a0 1G" returned: 0 in 0.384s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-656368b8-44c5-4299-92aa-d32f5b397589 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aee6b5c8-7006-4d9b-894b-044a244382a2 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2.68a87b03-ae9d-4bce-9034-2e6e5d2571a0 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:23 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aee6b5c8-7006-4d9b-894b-044a244382a2 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2.68a87b03-ae9d-4bce-9034-2e6e5d2571a0 Aug 10 13:03:23 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:23 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-656368b8-44c5-4299-92aa-d32f5b397589 tempest-VolumesDeleteCascade-956128722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aee6b5c8-7006-4d9b-894b-044a244382a2 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2.68a87b03-ae9d-4bce-9034-2e6e5d2571a0" returned: 0 in 0.284s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:23 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-656368b8-44c5-4299-92aa-d32f5b397589 tempest-VolumesDeleteCascade-956128722 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2.68a87b03-ae9d-4bce-9034-2e6e5d2571a0 is being set with open permissions: ugo+rw Aug 10 13:03:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-656368b8-44c5-4299-92aa-d32f5b397589 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2.68a87b03-ae9d-4bce-9034-2e6e5d2571a0 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:23 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2.68a87b03-ae9d-4bce-9034-2e6e5d2571a0 Aug 10 13:03:23 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:23 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-656368b8-44c5-4299-92aa-d32f5b397589 tempest-VolumesDeleteCascade-956128722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2.68a87b03-ae9d-4bce-9034-2e6e5d2571a0" returned: 0 in 0.234s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-656368b8-44c5-4299-92aa-d32f5b397589 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:24 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2.info Aug 10 13:03:24 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:24 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-656368b8-44c5-4299-92aa-d32f5b397589 tempest-VolumesDeleteCascade-956128722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2.info" returned: 0 in 0.240s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:24 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-656368b8-44c5-4299-92aa-d32f5b397589 tempest-VolumesDeleteCascade-956128722 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2.info is being set with open permissions: ugo+rw Aug 10 13:03:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-656368b8-44c5-4299-92aa-d32f5b397589 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:24 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2.info Aug 10 13:03:24 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:24 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-656368b8-44c5-4299-92aa-d32f5b397589 tempest-VolumesDeleteCascade-956128722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2.info" returned: 0 in 0.248s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-656368b8-44c5-4299-92aa-d32f5b397589 tempest-VolumesDeleteCascade-956128722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.825s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:03:24 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-656368b8-44c5-4299-92aa-d32f5b397589 tempest-VolumesDeleteCascade-956128722 None] Create snapshot completed successfully Aug 10 13:03:25 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:03:25 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Flow 'volume_create_manager' (afceed3d-6c51-41f0-a0b8-160d6306b51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:03:25 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57e756f7-f743-45e6-b8d3-a8562e193bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:25 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57e756f7-f743-45e6-b8d3-a8562e193bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-746984368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=135fbcc3-b2a2-4534-bc3f-cbdfc8d04cda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3614bddb1f942bba6edb79452554a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=68a87b03-ae9d-4bce-9034-2e6e5d2571a0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:03:25Z,use_quota=True,user_id='9da8bcfd710a4e809a12bc4aabd9d33b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:25 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e625d7-4f14-4220-9200-0dee9bbeb28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:25 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e625d7-4f14-4220-9200-0dee9bbeb28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:25 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3884ec1-cd06-4e82-8547-80bef9a3ff92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:25 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3884ec1-cd06-4e82-8547-80bef9a3ff92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '135fbcc3-b2a2-4534-bc3f-cbdfc8d04cda', 'volume_name': 'volume-135fbcc3-b2a2-4534-bc3f-cbdfc8d04cda', 'volume_size': 1, 'snapshot_id': '68a87b03-ae9d-4bce-9034-2e6e5d2571a0'}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:25 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea7d0c7f-cad0-4d8a-9c73-e350dd362302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:25 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea7d0c7f-cad0-4d8a-9c73-e350dd362302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:25 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1537ec38-3a02-4717-8d82-d426d156547a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:25 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Volume 135fbcc3-b2a2-4534-bc3f-cbdfc8d04cda: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-135fbcc3-b2a2-4534-bc3f-cbdfc8d04cda', 'volume_size': 1, 'snapshot_id': '68a87b03-ae9d-4bce-9034-2e6e5d2571a0'} Aug 10 13:03:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:03:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:03:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Acquiring lock "cinder-quobyte-68a87b03-ae9d-4bce-9034-2e6e5d2571a0-135fbcc3-b2a2-4534-bc3f-cbdfc8d04cda" by "_create_volume_from_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:03:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Lock "cinder-quobyte-68a87b03-ae9d-4bce-9034-2e6e5d2571a0-135fbcc3-b2a2-4534-bc3f-cbdfc8d04cda" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:03:25 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Creating volume 135fbcc3-b2a2-4534-bc3f-cbdfc8d04cda from snapshot 68a87b03-ae9d-4bce-9034-2e6e5d2571a0 {{(pid=89096) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 10 13:03:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:03:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:03:25 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:03:25 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:03:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:03:25 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:03:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Acquiring lock "cinder-quobyte-135fbcc3-b2a2-4534-bc3f-cbdfc8d04cda" by "_copy_volume_from_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:03:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Lock "cinder-quobyte-135fbcc3-b2a2-4534-bc3f-cbdfc8d04cda" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:03:25 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] snapshot: 68a87b03-ae9d-4bce-9034-2e6e5d2571a0, volume: 135fbcc3-b2a2-4534-bc3f-cbdfc8d04cda, {{(pid=89096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 10 13:03:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:03:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:03:25 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:03:25 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:03:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:03:25 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[112481bb-bb58-47e4-8ab3-25e0b096d126]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:03:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2.68a87b03-ae9d-4bce-9034-2e6e5d2571a0 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:25 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2.68a87b03-ae9d-4bce-9034-2e6e5d2571a0 Aug 10 13:03:25 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:25 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2.68a87b03-ae9d-4bce-9034-2e6e5d2571a0" returned: 0 in 0.365s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:25 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aee6b5c8-7006-4d9b-894b-044a244382a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 13:03:25 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[46dccca5-9173-4da8-a475-2c223e137edf]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:03:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:25 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2 Aug 10 13:03:25 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:26 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2" returned: 0 in 0.348s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:26 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2 {{(pid=89096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 10 13:03:26 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Creating direct copy from snapshot {{(pid=89096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 10 13:03:26 devstack cinder-volume[89096]: DEBUG cinder.utils [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Path /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-135fbcc3-b2a2-4534-bc3f-cbdfc8d04cda not found in is_blk_device check {{(pid=89096) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 10 13:03:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-135fbcc3-b2a2-4534-bc3f-cbdfc8d04cda {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:26 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-135fbcc3-b2a2-4534-bc3f-cbdfc8d04cda Aug 10 13:03:26 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:30 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-135fbcc3-b2a2-4534-bc3f-cbdfc8d04cda" returned: 0 in 3.869s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:30 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Image conversion details: src /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2, size 1024.00 MB, duration 3.87 sec, destination /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-135fbcc3-b2a2-4534-bc3f-cbdfc8d04cda {{(pid=89096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 13:03:30 devstack cinder-volume[89096]: INFO cinder.image.image_utils [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Converted 1024.00 MB image at 264.56 MB/s Aug 10 13:03:30 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-135fbcc3-b2a2-4534-bc3f-cbdfc8d04cda is being set with open permissions: ugo+rw Aug 10 13:03:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-135fbcc3-b2a2-4534-bc3f-cbdfc8d04cda {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:30 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-135fbcc3-b2a2-4534-bc3f-cbdfc8d04cda Aug 10 13:03:30 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:30 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-135fbcc3-b2a2-4534-bc3f-cbdfc8d04cda" returned: 0 in 0.225s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:30 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Lock "cinder-quobyte-135fbcc3-b2a2-4534-bc3f-cbdfc8d04cda" released by "_copy_volume_from_snapshot" :: held 4.885s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:03:30 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Lock "cinder-quobyte-68a87b03-ae9d-4bce-9034-2e6e5d2571a0-135fbcc3-b2a2-4534-bc3f-cbdfc8d04cda" released by "_create_volume_from_snapshot" :: held 4.943s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:03:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.958s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:03:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1537ec38-3a02-4717-8d82-d426d156547a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-135fbcc3-b2a2-4534-bc3f-cbdfc8d04cda', 'volume_size': 1, 'snapshot_id': '68a87b03-ae9d-4bce-9034-2e6e5d2571a0'}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70aa46bf-8025-4185-965b-e6cfd8f40690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:30 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Volume volume-135fbcc3-b2a2-4534-bc3f-cbdfc8d04cda (135fbcc3-b2a2-4534-bc3f-cbdfc8d04cda): created successfully Aug 10 13:03:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70aa46bf-8025-4185-965b-e6cfd8f40690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Flow 'volume_create_manager' (afceed3d-6c51-41f0-a0b8-160d6306b51b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:03:30 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-24f3f9b9-9799-48aa-b82a-d7727c4ac8e2 tempest-VolumesDeleteCascade-956128722 None] Created volume successfully. Aug 10 13:03:30 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] Acquiring lock "cinder-aee6b5c8-7006-4d9b-894b-044a244382a2-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:03:30 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] Lock "cinder-aee6b5c8-7006-4d9b-894b-044a244382a2-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:03:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] Performing cascade delete. {{(pid=89096) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 10 13:03:30 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] Acquiring lock "cinder-68a87b03-ae9d-4bce-9034-2e6e5d2571a0-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:03:30 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] Lock "cinder-68a87b03-ae9d-4bce-9034-2e6e5d2571a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:03:30 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] Acquiring lock "cinder-quobyte-aee6b5c8-7006-4d9b-894b-044a244382a2" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:03:30 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] Lock "cinder-quobyte-aee6b5c8-7006-4d9b-894b-044a244382a2" acquired by "delete_snapshot" :: waited 0.012s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:03:30 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] Acquiring lock "cinder-quobyte-68a87b03-ae9d-4bce-9034-2e6e5d2571a0" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:03:30 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] Lock "cinder-quobyte-68a87b03-ae9d-4bce-9034-2e6e5d2571a0" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:03:30 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] Deleting offline snapshot 68a87b03-ae9d-4bce-9034-2e6e5d2571a0 of volume aee6b5c8-7006-4d9b-894b-044a244382a2 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 13:03:30 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] snapshot_file for this snap is: volume-aee6b5c8-7006-4d9b-894b-044a244382a2.68a87b03-ae9d-4bce-9034-2e6e5d2571a0 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 13:03:30 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5213d9-390c-47c8-8567-c64981b67a20]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:03:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2.68a87b03-ae9d-4bce-9034-2e6e5d2571a0 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:31 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2.68a87b03-ae9d-4bce-9034-2e6e5d2571a0 Aug 10 13:03:31 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:31 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2.68a87b03-ae9d-4bce-9034-2e6e5d2571a0" returned: 0 in 0.340s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:31 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aee6b5c8-7006-4d9b-894b-044a244382a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 13:03:31 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[93354ba5-1877-489e-aed7-183bae494bdf]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:03:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:31 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2 Aug 10 13:03:31 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:31 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2" returned: 0 in 0.506s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2.68a87b03-ae9d-4bce-9034-2e6e5d2571a0 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:31 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2.68a87b03-ae9d-4bce-9034-2e6e5d2571a0 Aug 10 13:03:31 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:32 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2.68a87b03-ae9d-4bce-9034-2e6e5d2571a0" returned: 0 in 0.319s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2.68a87b03-ae9d-4bce-9034-2e6e5d2571a0 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:32 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2.68a87b03-ae9d-4bce-9034-2e6e5d2571a0 Aug 10 13:03:32 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:32 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2.68a87b03-ae9d-4bce-9034-2e6e5d2571a0" returned: 0 in 0.241s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:32 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] Lock "cinder-quobyte-68a87b03-ae9d-4bce-9034-2e6e5d2571a0" released by "_delete_snapshot" :: held 1.488s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:03:32 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] Lock "cinder-quobyte-aee6b5c8-7006-4d9b-894b-044a244382a2" released by "delete_snapshot" :: held 1.509s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:03:32 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] Created reservations ['a2afac3a-a7d2-4a9a-a695-bd7f4401142f', '9bf833e0-ea16-4082-8886-267ed500410b', '9080def8-400f-462e-a773-b4672acd4f2a', '23a608f5-54cc-4e09-bc83-95e657ec94b2'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:03:32 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] Delete snapshot completed successfully. Aug 10 13:03:32 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] Lock "cinder-68a87b03-ae9d-4bce-9034-2e6e5d2571a0-delete_snapshot" released by "delete_snapshot" :: held 1.653s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:03:32 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] Snapshots deleted, issuing volume delete {{(pid=89096) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 10 13:03:32 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] Acquiring lock "cinder-quobyte-aee6b5c8-7006-4d9b-894b-044a244382a2" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:03:32 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] Lock "cinder-quobyte-aee6b5c8-7006-4d9b-894b-044a244382a2" acquired by "delete_volume" :: waited 0.014s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:03:32 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[44bf4673-80b4-4588-bc88-654435bcb875]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:03:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:32 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2 Aug 10 13:03:32 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:33 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2" returned: 0 in 0.375s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:33 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2 Aug 10 13:03:33 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:33 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aee6b5c8-7006-4d9b-894b-044a244382a2" returned: 0 in 0.242s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:33 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] Lock "cinder-quobyte-aee6b5c8-7006-4d9b-894b-044a244382a2" released by "delete_volume" :: held 0.671s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:03:33 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] Created reservations ['881a27b5-884f-45d6-a033-82c641b1132b', '9257185f-3075-433b-98e2-8fafcfa59f22', '8cea1914-39ef-4acb-a40b-763ae7c9ec5a', 'a4a5f4fc-2e04-470e-b983-c84ad6fa75b0'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:03:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:03:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:03:33 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:03:33 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:03:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:03:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:33 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:03:33 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:33 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.239s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:33 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:03:33 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] Deleted volume successfully. Aug 10 13:03:33 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b14d3af6-f4e6-4538-b4ea-385f5cc024d2 tempest-VolumesDeleteCascade-956128722 None] Lock "cinder-aee6b5c8-7006-4d9b-894b-044a244382a2-delete_volume" released by "delete_volume" :: held 2.766s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:03:34 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-31f47719-c429-4320-81ca-38bfa3635e72 tempest-VolumesDeleteCascade-956128722 None] Acquiring lock "cinder-135fbcc3-b2a2-4534-bc3f-cbdfc8d04cda-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:03:34 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-31f47719-c429-4320-81ca-38bfa3635e72 tempest-VolumesDeleteCascade-956128722 None] Lock "cinder-135fbcc3-b2a2-4534-bc3f-cbdfc8d04cda-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:03:34 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-31f47719-c429-4320-81ca-38bfa3635e72 tempest-VolumesDeleteCascade-956128722 None] Acquiring lock "cinder-quobyte-135fbcc3-b2a2-4534-bc3f-cbdfc8d04cda" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:03:34 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-31f47719-c429-4320-81ca-38bfa3635e72 tempest-VolumesDeleteCascade-956128722 None] Lock "cinder-quobyte-135fbcc3-b2a2-4534-bc3f-cbdfc8d04cda" acquired by "delete_volume" :: waited 0.013s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:03:34 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1eaec7a-b56b-4d10-8a7f-0094dfa56842]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:03:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-31f47719-c429-4320-81ca-38bfa3635e72 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-135fbcc3-b2a2-4534-bc3f-cbdfc8d04cda {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:34 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-135fbcc3-b2a2-4534-bc3f-cbdfc8d04cda Aug 10 13:03:34 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:34 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-31f47719-c429-4320-81ca-38bfa3635e72 tempest-VolumesDeleteCascade-956128722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-135fbcc3-b2a2-4534-bc3f-cbdfc8d04cda" returned: 0 in 0.345s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-31f47719-c429-4320-81ca-38bfa3635e72 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-135fbcc3-b2a2-4534-bc3f-cbdfc8d04cda {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:34 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-135fbcc3-b2a2-4534-bc3f-cbdfc8d04cda Aug 10 13:03:34 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:34 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-31f47719-c429-4320-81ca-38bfa3635e72 tempest-VolumesDeleteCascade-956128722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-135fbcc3-b2a2-4534-bc3f-cbdfc8d04cda" returned: 0 in 0.233s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:34 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-31f47719-c429-4320-81ca-38bfa3635e72 tempest-VolumesDeleteCascade-956128722 None] Lock "cinder-quobyte-135fbcc3-b2a2-4534-bc3f-cbdfc8d04cda" released by "delete_volume" :: held 0.616s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:03:34 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-31f47719-c429-4320-81ca-38bfa3635e72 tempest-VolumesDeleteCascade-956128722 None] Created reservations ['40708f16-19b5-4f63-9cd8-fbb7b8f568b1', '4e1274ce-c1b7-4b69-8eea-a931b8a8948c', 'bacd8f5d-27a0-442f-872d-085bd820f387', 'a20be42e-0d63-488a-8d61-42b04b6065bf'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:03:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-31f47719-c429-4320-81ca-38bfa3635e72 tempest-VolumesDeleteCascade-956128722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:03:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-31f47719-c429-4320-81ca-38bfa3635e72 tempest-VolumesDeleteCascade-956128722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:03:34 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-31f47719-c429-4320-81ca-38bfa3635e72 tempest-VolumesDeleteCascade-956128722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:03:34 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-31f47719-c429-4320-81ca-38bfa3635e72 tempest-VolumesDeleteCascade-956128722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:03:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-31f47719-c429-4320-81ca-38bfa3635e72 tempest-VolumesDeleteCascade-956128722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:03:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-31f47719-c429-4320-81ca-38bfa3635e72 tempest-VolumesDeleteCascade-956128722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:35 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:03:35 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:35 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-31f47719-c429-4320-81ca-38bfa3635e72 tempest-VolumesDeleteCascade-956128722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.229s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:35 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-31f47719-c429-4320-81ca-38bfa3635e72 tempest-VolumesDeleteCascade-956128722 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:03:35 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-31f47719-c429-4320-81ca-38bfa3635e72 tempest-VolumesDeleteCascade-956128722 None] Deleted volume successfully. Aug 10 13:03:35 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-31f47719-c429-4320-81ca-38bfa3635e72 tempest-VolumesDeleteCascade-956128722 None] Lock "cinder-135fbcc3-b2a2-4534-bc3f-cbdfc8d04cda-delete_volume" released by "delete_volume" :: held 1.023s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:03:37 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-d43d48ee-3bf2-42bb-a043-f96a28f2bd12 tempest-VolumesGetTest-378927818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:03:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d43d48ee-3bf2-42bb-a043-f96a28f2bd12 tempest-VolumesGetTest-378927818 None] Flow 'volume_create_manager' (315da787-92be-432f-9a22-a9eeba82a673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:03:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d43d48ee-3bf2-42bb-a043-f96a28f2bd12 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (162772c7-37d8-4d85-8210-5acfaf443bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d43d48ee-3bf2-42bb-a043-f96a28f2bd12 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (162772c7-37d8-4d85-8210-5acfaf443bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1295863701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9942b72-f3cb-463a-a930-6406add5ba84,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f8f9e2dd2a2e4b06abadb728c3b16527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:03:38Z,use_quota=True,user_id='7d313d8e29bd49ceb79d9199403d8fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d43d48ee-3bf2-42bb-a043-f96a28f2bd12 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (857e7e13-4332-4c0b-814e-266fc088e727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d43d48ee-3bf2-42bb-a043-f96a28f2bd12 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (857e7e13-4332-4c0b-814e-266fc088e727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d43d48ee-3bf2-42bb-a043-f96a28f2bd12 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5638eb13-a84f-4e40-8bd9-32e014932d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d43d48ee-3bf2-42bb-a043-f96a28f2bd12 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5638eb13-a84f-4e40-8bd9-32e014932d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9942b72-f3cb-463a-a930-6406add5ba84', 'volume_name': 'volume-f9942b72-f3cb-463a-a930-6406add5ba84', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d43d48ee-3bf2-42bb-a043-f96a28f2bd12 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7525f2fc-41c9-4167-8c7a-9172bf4011a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d43d48ee-3bf2-42bb-a043-f96a28f2bd12 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7525f2fc-41c9-4167-8c7a-9172bf4011a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d43d48ee-3bf2-42bb-a043-f96a28f2bd12 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b3ffdd-78e2-48f8-98bc-c10c49514c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:38 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-d43d48ee-3bf2-42bb-a043-f96a28f2bd12 tempest-VolumesGetTest-378927818 None] Volume f9942b72-f3cb-463a-a930-6406add5ba84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9942b72-f3cb-463a-a930-6406add5ba84', 'volume_size': 1} Aug 10 13:03:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d43d48ee-3bf2-42bb-a043-f96a28f2bd12 tempest-VolumesGetTest-378927818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:03:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d43d48ee-3bf2-42bb-a043-f96a28f2bd12 tempest-VolumesGetTest-378927818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:03:38 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-d43d48ee-3bf2-42bb-a043-f96a28f2bd12 tempest-VolumesGetTest-378927818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1295863701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9942b72-f3cb-463a-a930-6406add5ba84,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f8f9e2dd2a2e4b06abadb728c3b16527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:03:38Z,use_quota=True,user_id='7d313d8e29bd49ceb79d9199403d8fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:03:38 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-d43d48ee-3bf2-42bb-a043-f96a28f2bd12 tempest-VolumesGetTest-378927818 None] Creating volume f9942b72-f3cb-463a-a930-6406add5ba84 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:03:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d43d48ee-3bf2-42bb-a043-f96a28f2bd12 tempest-VolumesGetTest-378927818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:03:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d43d48ee-3bf2-42bb-a043-f96a28f2bd12 tempest-VolumesGetTest-378927818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:03:38 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-d43d48ee-3bf2-42bb-a043-f96a28f2bd12 tempest-VolumesGetTest-378927818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:03:38 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-d43d48ee-3bf2-42bb-a043-f96a28f2bd12 tempest-VolumesGetTest-378927818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:03:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d43d48ee-3bf2-42bb-a043-f96a28f2bd12 tempest-VolumesGetTest-378927818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:03:38 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-d43d48ee-3bf2-42bb-a043-f96a28f2bd12 tempest-VolumesGetTest-378927818 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:03:38 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-d43d48ee-3bf2-42bb-a043-f96a28f2bd12 tempest-VolumesGetTest-378927818 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:03:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d43d48ee-3bf2-42bb-a043-f96a28f2bd12 tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f9942b72-f3cb-463a-a930-6406add5ba84 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:38 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f9942b72-f3cb-463a-a930-6406add5ba84 1073741824 Aug 10 13:03:38 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:38 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d43d48ee-3bf2-42bb-a043-f96a28f2bd12 tempest-VolumesGetTest-378927818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f9942b72-f3cb-463a-a930-6406add5ba84 1073741824" returned: 0 in 0.384s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d43d48ee-3bf2-42bb-a043-f96a28f2bd12 tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f9942b72-f3cb-463a-a930-6406add5ba84 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:38 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f9942b72-f3cb-463a-a930-6406add5ba84 Aug 10 13:03:38 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:38 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d43d48ee-3bf2-42bb-a043-f96a28f2bd12 tempest-VolumesGetTest-378927818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f9942b72-f3cb-463a-a930-6406add5ba84" returned: 0 in 0.230s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:38 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-d43d48ee-3bf2-42bb-a043-f96a28f2bd12 tempest-VolumesGetTest-378927818 None] <== create_volume: return (650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:03:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d43d48ee-3bf2-42bb-a043-f96a28f2bd12 tempest-VolumesGetTest-378927818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.652s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:03:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d43d48ee-3bf2-42bb-a043-f96a28f2bd12 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b3ffdd-78e2-48f8-98bc-c10c49514c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9942b72-f3cb-463a-a930-6406add5ba84', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d43d48ee-3bf2-42bb-a043-f96a28f2bd12 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (475548f2-72c7-4ece-9e30-a84ce953ee1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:38 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-d43d48ee-3bf2-42bb-a043-f96a28f2bd12 tempest-VolumesGetTest-378927818 None] Volume volume-f9942b72-f3cb-463a-a930-6406add5ba84 (f9942b72-f3cb-463a-a930-6406add5ba84): created successfully Aug 10 13:03:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d43d48ee-3bf2-42bb-a043-f96a28f2bd12 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (475548f2-72c7-4ece-9e30-a84ce953ee1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d43d48ee-3bf2-42bb-a043-f96a28f2bd12 tempest-VolumesGetTest-378927818 None] Flow 'volume_create_manager' (315da787-92be-432f-9a22-a9eeba82a673) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:03:38 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-d43d48ee-3bf2-42bb-a043-f96a28f2bd12 tempest-VolumesGetTest-378927818 None] Created volume successfully. Aug 10 13:03:39 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fbda12d-5654-488f-8ede-fa062dd6f035 tempest-VolumesGetTest-378927818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:03:39 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1fbda12d-5654-488f-8ede-fa062dd6f035 tempest-VolumesGetTest-378927818 None] Flow 'volume_create_manager' (4192aeb6-3176-4a36-9358-f2d0df79fafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:03:39 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1fbda12d-5654-488f-8ede-fa062dd6f035 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c30aeaaa-263f-4348-b000-f6be94e3c425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:39 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1fbda12d-5654-488f-8ede-fa062dd6f035 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c30aeaaa-263f-4348-b000-f6be94e3c425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:03:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-292253162',display_name='tempest-VolumesGetTest-Volume-882034526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=853b157b-5e0b-421f-b19f-55a7b497a705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8f9e2dd2a2e4b06abadb728c3b16527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:03:40Z,use_quota=True,user_id='7d313d8e29bd49ceb79d9199403d8fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:39 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1fbda12d-5654-488f-8ede-fa062dd6f035 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b75bd5-b044-4a1c-8016-e56fbaecbd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:39 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1fbda12d-5654-488f-8ede-fa062dd6f035 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b75bd5-b044-4a1c-8016-e56fbaecbd4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:39 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1fbda12d-5654-488f-8ede-fa062dd6f035 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88b848df-939f-4b59-96ec-11b56f19e44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:39 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1fbda12d-5654-488f-8ede-fa062dd6f035 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88b848df-939f-4b59-96ec-11b56f19e44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '853b157b-5e0b-421f-b19f-55a7b497a705', 'volume_name': 'volume-853b157b-5e0b-421f-b19f-55a7b497a705', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:39 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1fbda12d-5654-488f-8ede-fa062dd6f035 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7783d8a6-a4f8-4c89-b607-79862b708477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:39 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1fbda12d-5654-488f-8ede-fa062dd6f035 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7783d8a6-a4f8-4c89-b607-79862b708477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:39 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1fbda12d-5654-488f-8ede-fa062dd6f035 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e63fed29-2e40-43d8-9490-942a49c67c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:39 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-1fbda12d-5654-488f-8ede-fa062dd6f035 tempest-VolumesGetTest-378927818 None] Volume 853b157b-5e0b-421f-b19f-55a7b497a705: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-853b157b-5e0b-421f-b19f-55a7b497a705', 'volume_size': 1} Aug 10 13:03:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1fbda12d-5654-488f-8ede-fa062dd6f035 tempest-VolumesGetTest-378927818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:03:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1fbda12d-5654-488f-8ede-fa062dd6f035 tempest-VolumesGetTest-378927818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:03:39 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1fbda12d-5654-488f-8ede-fa062dd6f035 tempest-VolumesGetTest-378927818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:03:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-292253162',display_name='tempest-VolumesGetTest-Volume-882034526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=853b157b-5e0b-421f-b19f-55a7b497a705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8f9e2dd2a2e4b06abadb728c3b16527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:03:40Z,use_quota=True,user_id='7d313d8e29bd49ceb79d9199403d8fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:03:39 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-1fbda12d-5654-488f-8ede-fa062dd6f035 tempest-VolumesGetTest-378927818 None] Creating volume 853b157b-5e0b-421f-b19f-55a7b497a705 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:03:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1fbda12d-5654-488f-8ede-fa062dd6f035 tempest-VolumesGetTest-378927818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:03:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1fbda12d-5654-488f-8ede-fa062dd6f035 tempest-VolumesGetTest-378927818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:03:39 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1fbda12d-5654-488f-8ede-fa062dd6f035 tempest-VolumesGetTest-378927818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:03:39 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1fbda12d-5654-488f-8ede-fa062dd6f035 tempest-VolumesGetTest-378927818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:03:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1fbda12d-5654-488f-8ede-fa062dd6f035 tempest-VolumesGetTest-378927818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:03:39 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1fbda12d-5654-488f-8ede-fa062dd6f035 tempest-VolumesGetTest-378927818 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:03:39 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-1fbda12d-5654-488f-8ede-fa062dd6f035 tempest-VolumesGetTest-378927818 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:03:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1fbda12d-5654-488f-8ede-fa062dd6f035 tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-853b157b-5e0b-421f-b19f-55a7b497a705 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:39 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-853b157b-5e0b-421f-b19f-55a7b497a705 1073741824 Aug 10 13:03:39 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:40 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1fbda12d-5654-488f-8ede-fa062dd6f035 tempest-VolumesGetTest-378927818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-853b157b-5e0b-421f-b19f-55a7b497a705 1073741824" returned: 0 in 0.400s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1fbda12d-5654-488f-8ede-fa062dd6f035 tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-853b157b-5e0b-421f-b19f-55a7b497a705 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:40 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-853b157b-5e0b-421f-b19f-55a7b497a705 Aug 10 13:03:40 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:40 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1fbda12d-5654-488f-8ede-fa062dd6f035 tempest-VolumesGetTest-378927818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-853b157b-5e0b-421f-b19f-55a7b497a705" returned: 0 in 0.248s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:40 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1fbda12d-5654-488f-8ede-fa062dd6f035 tempest-VolumesGetTest-378927818 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:03:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1fbda12d-5654-488f-8ede-fa062dd6f035 tempest-VolumesGetTest-378927818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:03:40 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1fbda12d-5654-488f-8ede-fa062dd6f035 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e63fed29-2e40-43d8-9490-942a49c67c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-853b157b-5e0b-421f-b19f-55a7b497a705', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:40 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1fbda12d-5654-488f-8ede-fa062dd6f035 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53923f9a-72ec-41b5-b76f-78808f47e309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:40 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-1fbda12d-5654-488f-8ede-fa062dd6f035 tempest-VolumesGetTest-378927818 None] Volume volume-853b157b-5e0b-421f-b19f-55a7b497a705 (853b157b-5e0b-421f-b19f-55a7b497a705): created successfully Aug 10 13:03:40 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1fbda12d-5654-488f-8ede-fa062dd6f035 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53923f9a-72ec-41b5-b76f-78808f47e309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:40 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1fbda12d-5654-488f-8ede-fa062dd6f035 tempest-VolumesGetTest-378927818 None] Flow 'volume_create_manager' (4192aeb6-3176-4a36-9358-f2d0df79fafd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:03:40 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-1fbda12d-5654-488f-8ede-fa062dd6f035 tempest-VolumesGetTest-378927818 None] Created volume successfully. Aug 10 13:03:40 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ac999804-f8f7-4795-ae17-b0effd8117d4 tempest-VolumesGetTest-378927818 None] Acquiring lock "cinder-853b157b-5e0b-421f-b19f-55a7b497a705-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:03:40 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ac999804-f8f7-4795-ae17-b0effd8117d4 tempest-VolumesGetTest-378927818 None] Lock "cinder-853b157b-5e0b-421f-b19f-55a7b497a705-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:03:40 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ac999804-f8f7-4795-ae17-b0effd8117d4 tempest-VolumesGetTest-378927818 None] Acquiring lock "cinder-quobyte-853b157b-5e0b-421f-b19f-55a7b497a705" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:03:40 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ac999804-f8f7-4795-ae17-b0effd8117d4 tempest-VolumesGetTest-378927818 None] Lock "cinder-quobyte-853b157b-5e0b-421f-b19f-55a7b497a705" acquired by "delete_volume" :: waited 0.013s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:03:40 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78abeee-c5c8-4d0b-b8a9-ff10428754a9]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:03:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ac999804-f8f7-4795-ae17-b0effd8117d4 tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-853b157b-5e0b-421f-b19f-55a7b497a705 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:40 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-853b157b-5e0b-421f-b19f-55a7b497a705 Aug 10 13:03:40 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:41 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ac999804-f8f7-4795-ae17-b0effd8117d4 tempest-VolumesGetTest-378927818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-853b157b-5e0b-421f-b19f-55a7b497a705" returned: 0 in 0.353s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ac999804-f8f7-4795-ae17-b0effd8117d4 tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-853b157b-5e0b-421f-b19f-55a7b497a705 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:41 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-853b157b-5e0b-421f-b19f-55a7b497a705 Aug 10 13:03:41 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:41 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ac999804-f8f7-4795-ae17-b0effd8117d4 tempest-VolumesGetTest-378927818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-853b157b-5e0b-421f-b19f-55a7b497a705" returned: 0 in 0.243s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:41 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ac999804-f8f7-4795-ae17-b0effd8117d4 tempest-VolumesGetTest-378927818 None] Lock "cinder-quobyte-853b157b-5e0b-421f-b19f-55a7b497a705" released by "delete_volume" :: held 0.632s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:03:41 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-ac999804-f8f7-4795-ae17-b0effd8117d4 tempest-VolumesGetTest-378927818 None] Created reservations ['617e14e8-aad8-46a1-8e09-c168fc2030d4', '6977b7ae-c28e-4c20-9692-b3c58fbaf5e9', '774e127c-2701-4f45-a43e-36e8476bdba4', '6b05b87c-7fa0-4bb3-b40e-127359253cd9'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:03:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ac999804-f8f7-4795-ae17-b0effd8117d4 tempest-VolumesGetTest-378927818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:03:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ac999804-f8f7-4795-ae17-b0effd8117d4 tempest-VolumesGetTest-378927818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:03:41 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ac999804-f8f7-4795-ae17-b0effd8117d4 tempest-VolumesGetTest-378927818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:03:41 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ac999804-f8f7-4795-ae17-b0effd8117d4 tempest-VolumesGetTest-378927818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:03:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ac999804-f8f7-4795-ae17-b0effd8117d4 tempest-VolumesGetTest-378927818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:03:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ac999804-f8f7-4795-ae17-b0effd8117d4 tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:41 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:03:41 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:41 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ac999804-f8f7-4795-ae17-b0effd8117d4 tempest-VolumesGetTest-378927818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.241s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:41 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-ac999804-f8f7-4795-ae17-b0effd8117d4 tempest-VolumesGetTest-378927818 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:03:41 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-ac999804-f8f7-4795-ae17-b0effd8117d4 tempest-VolumesGetTest-378927818 None] Deleted volume successfully. Aug 10 13:03:41 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ac999804-f8f7-4795-ae17-b0effd8117d4 tempest-VolumesGetTest-378927818 None] Lock "cinder-853b157b-5e0b-421f-b19f-55a7b497a705-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:03:41 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-483a7fc7-4713-4037-b0d7-425b9920fb83 tempest-VolumesGetTest-378927818 None] Acquiring lock "cinder-f9942b72-f3cb-463a-a930-6406add5ba84-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:03:41 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-483a7fc7-4713-4037-b0d7-425b9920fb83 tempest-VolumesGetTest-378927818 None] Lock "cinder-f9942b72-f3cb-463a-a930-6406add5ba84-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:03:42 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-483a7fc7-4713-4037-b0d7-425b9920fb83 tempest-VolumesGetTest-378927818 None] Acquiring lock "cinder-quobyte-f9942b72-f3cb-463a-a930-6406add5ba84" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:03:42 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-483a7fc7-4713-4037-b0d7-425b9920fb83 tempest-VolumesGetTest-378927818 None] Lock "cinder-quobyte-f9942b72-f3cb-463a-a930-6406add5ba84" acquired by "delete_volume" :: waited 0.014s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:03:42 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f425f8-e167-44b4-89e2-5b14d34eb549]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:03:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-483a7fc7-4713-4037-b0d7-425b9920fb83 tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f9942b72-f3cb-463a-a930-6406add5ba84 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:42 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f9942b72-f3cb-463a-a930-6406add5ba84 Aug 10 13:03:42 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:42 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-483a7fc7-4713-4037-b0d7-425b9920fb83 tempest-VolumesGetTest-378927818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f9942b72-f3cb-463a-a930-6406add5ba84" returned: 0 in 0.350s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-483a7fc7-4713-4037-b0d7-425b9920fb83 tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f9942b72-f3cb-463a-a930-6406add5ba84 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:42 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f9942b72-f3cb-463a-a930-6406add5ba84 Aug 10 13:03:42 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:42 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-483a7fc7-4713-4037-b0d7-425b9920fb83 tempest-VolumesGetTest-378927818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f9942b72-f3cb-463a-a930-6406add5ba84" returned: 0 in 0.245s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:42 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-483a7fc7-4713-4037-b0d7-425b9920fb83 tempest-VolumesGetTest-378927818 None] Lock "cinder-quobyte-f9942b72-f3cb-463a-a930-6406add5ba84" released by "delete_volume" :: held 0.629s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:03:42 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-483a7fc7-4713-4037-b0d7-425b9920fb83 tempest-VolumesGetTest-378927818 None] Created reservations ['0bd1e682-4a55-4f76-b360-0ef190b90034', '891c65e3-95dd-432f-ae03-b1c3dfb1afb2', '48ce28db-3101-4fbe-abda-53dc53322346', '62951900-d5a2-419c-8dd7-2346056f4f42'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:03:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-483a7fc7-4713-4037-b0d7-425b9920fb83 tempest-VolumesGetTest-378927818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:03:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-483a7fc7-4713-4037-b0d7-425b9920fb83 tempest-VolumesGetTest-378927818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:03:42 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-483a7fc7-4713-4037-b0d7-425b9920fb83 tempest-VolumesGetTest-378927818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:03:42 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-483a7fc7-4713-4037-b0d7-425b9920fb83 tempest-VolumesGetTest-378927818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:03:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-483a7fc7-4713-4037-b0d7-425b9920fb83 tempest-VolumesGetTest-378927818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:03:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-483a7fc7-4713-4037-b0d7-425b9920fb83 tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:42 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:03:42 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:43 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-483a7fc7-4713-4037-b0d7-425b9920fb83 tempest-VolumesGetTest-378927818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.235s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:43 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-483a7fc7-4713-4037-b0d7-425b9920fb83 tempest-VolumesGetTest-378927818 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:03:43 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-483a7fc7-4713-4037-b0d7-425b9920fb83 tempest-VolumesGetTest-378927818 None] Deleted volume successfully. Aug 10 13:03:43 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-483a7fc7-4713-4037-b0d7-425b9920fb83 tempest-VolumesGetTest-378927818 None] Lock "cinder-f9942b72-f3cb-463a-a930-6406add5ba84-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:03:43 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-d52d25da-a21d-4b0f-b8e9-9c2d8fdf0cdc tempest-VolumesGetTest-378927818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:03:43 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d52d25da-a21d-4b0f-b8e9-9c2d8fdf0cdc tempest-VolumesGetTest-378927818 None] Flow 'volume_create_manager' (2152a3e6-c1de-4011-a893-405ccd5866f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:03:43 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d52d25da-a21d-4b0f-b8e9-9c2d8fdf0cdc tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f4932a-8083-437b-a6e4-ac337ff2d6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:43 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d52d25da-a21d-4b0f-b8e9-9c2d8fdf0cdc tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f4932a-8083-437b-a6e4-ac337ff2d6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-910192869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2c12151-f805-46b7-bdba-f0d6c7a62671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8f9e2dd2a2e4b06abadb728c3b16527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:03:44Z,use_quota=True,user_id='7d313d8e29bd49ceb79d9199403d8fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:43 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d52d25da-a21d-4b0f-b8e9-9c2d8fdf0cdc tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a093df69-343c-4976-a629-3aa736c4cbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:43 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d52d25da-a21d-4b0f-b8e9-9c2d8fdf0cdc tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a093df69-343c-4976-a629-3aa736c4cbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:43 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d52d25da-a21d-4b0f-b8e9-9c2d8fdf0cdc tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f82c5a7-48af-4ff0-8844-735d43c9a053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:43 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d52d25da-a21d-4b0f-b8e9-9c2d8fdf0cdc tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f82c5a7-48af-4ff0-8844-735d43c9a053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2c12151-f805-46b7-bdba-f0d6c7a62671', 'volume_name': 'volume-b2c12151-f805-46b7-bdba-f0d6c7a62671', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:43 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d52d25da-a21d-4b0f-b8e9-9c2d8fdf0cdc tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0c98236-2ea8-4ea4-a1ef-fb234c3dc850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:43 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d52d25da-a21d-4b0f-b8e9-9c2d8fdf0cdc tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0c98236-2ea8-4ea4-a1ef-fb234c3dc850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:43 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d52d25da-a21d-4b0f-b8e9-9c2d8fdf0cdc tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0beda1dd-727b-44f6-a392-3caed8b3b3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:43 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-d52d25da-a21d-4b0f-b8e9-9c2d8fdf0cdc tempest-VolumesGetTest-378927818 None] Volume b2c12151-f805-46b7-bdba-f0d6c7a62671: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2c12151-f805-46b7-bdba-f0d6c7a62671', 'volume_size': 1} Aug 10 13:03:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d52d25da-a21d-4b0f-b8e9-9c2d8fdf0cdc tempest-VolumesGetTest-378927818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:03:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d52d25da-a21d-4b0f-b8e9-9c2d8fdf0cdc tempest-VolumesGetTest-378927818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:03:43 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-d52d25da-a21d-4b0f-b8e9-9c2d8fdf0cdc tempest-VolumesGetTest-378927818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-910192869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2c12151-f805-46b7-bdba-f0d6c7a62671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8f9e2dd2a2e4b06abadb728c3b16527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:03:44Z,use_quota=True,user_id='7d313d8e29bd49ceb79d9199403d8fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:03:43 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-d52d25da-a21d-4b0f-b8e9-9c2d8fdf0cdc tempest-VolumesGetTest-378927818 None] Creating volume b2c12151-f805-46b7-bdba-f0d6c7a62671 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:03:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d52d25da-a21d-4b0f-b8e9-9c2d8fdf0cdc tempest-VolumesGetTest-378927818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:03:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d52d25da-a21d-4b0f-b8e9-9c2d8fdf0cdc tempest-VolumesGetTest-378927818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:03:43 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-d52d25da-a21d-4b0f-b8e9-9c2d8fdf0cdc tempest-VolumesGetTest-378927818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:03:43 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-d52d25da-a21d-4b0f-b8e9-9c2d8fdf0cdc tempest-VolumesGetTest-378927818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:03:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d52d25da-a21d-4b0f-b8e9-9c2d8fdf0cdc tempest-VolumesGetTest-378927818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:03:43 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-d52d25da-a21d-4b0f-b8e9-9c2d8fdf0cdc tempest-VolumesGetTest-378927818 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:03:43 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-d52d25da-a21d-4b0f-b8e9-9c2d8fdf0cdc tempest-VolumesGetTest-378927818 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:03:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d52d25da-a21d-4b0f-b8e9-9c2d8fdf0cdc tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:43 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671 1073741824 Aug 10 13:03:43 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:44 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d52d25da-a21d-4b0f-b8e9-9c2d8fdf0cdc tempest-VolumesGetTest-378927818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671 1073741824" returned: 0 in 0.396s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d52d25da-a21d-4b0f-b8e9-9c2d8fdf0cdc tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:44 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671 Aug 10 13:03:44 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:44 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d52d25da-a21d-4b0f-b8e9-9c2d8fdf0cdc tempest-VolumesGetTest-378927818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671" returned: 0 in 0.252s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:44 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-d52d25da-a21d-4b0f-b8e9-9c2d8fdf0cdc tempest-VolumesGetTest-378927818 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:03:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d52d25da-a21d-4b0f-b8e9-9c2d8fdf0cdc tempest-VolumesGetTest-378927818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:03:44 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d52d25da-a21d-4b0f-b8e9-9c2d8fdf0cdc tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0beda1dd-727b-44f6-a392-3caed8b3b3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2c12151-f805-46b7-bdba-f0d6c7a62671', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:44 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d52d25da-a21d-4b0f-b8e9-9c2d8fdf0cdc tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (092fe58b-a389-4384-8597-b98fb3862340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:44 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-d52d25da-a21d-4b0f-b8e9-9c2d8fdf0cdc tempest-VolumesGetTest-378927818 None] Volume volume-b2c12151-f805-46b7-bdba-f0d6c7a62671 (b2c12151-f805-46b7-bdba-f0d6c7a62671): created successfully Aug 10 13:03:44 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d52d25da-a21d-4b0f-b8e9-9c2d8fdf0cdc tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (092fe58b-a389-4384-8597-b98fb3862340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:44 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d52d25da-a21d-4b0f-b8e9-9c2d8fdf0cdc tempest-VolumesGetTest-378927818 None] Flow 'volume_create_manager' (2152a3e6-c1de-4011-a893-405ccd5866f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:03:44 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-d52d25da-a21d-4b0f-b8e9-9c2d8fdf0cdc tempest-VolumesGetTest-378927818 None] Created volume successfully. Aug 10 13:03:46 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:03:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Flow 'volume_create_manager' (cac983bb-2bfb-40b5-b6cd-bd65a05d21d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:03:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d991deb-f222-4b0e-9a91-7f507e6f450d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d991deb-f222-4b0e-9a91-7f507e6f450d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2144441866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4422a0c9-5b29-4866-97dc-66de361683fc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f8f9e2dd2a2e4b06abadb728c3b16527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=b2c12151-f805-46b7-bdba-f0d6c7a62671,status='creating',terminated_at=None,updated_at=2026-08-10T11:03:46Z,use_quota=True,user_id='7d313d8e29bd49ceb79d9199403d8fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7773c2f1-7b65-4493-9666-6589432413b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7773c2f1-7b65-4493-9666-6589432413b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349cb0b3-2820-464f-b089-b8a44e0a4f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349cb0b3-2820-464f-b089-b8a44e0a4f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4422a0c9-5b29-4866-97dc-66de361683fc', 'volume_name': 'volume-4422a0c9-5b29-4866-97dc-66de361683fc', 'volume_size': 1, 'source_volid': 'b2c12151-f805-46b7-bdba-f0d6c7a62671', 'source_volstatus': 'available'}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c662682e-6562-48fb-97d6-3293425192ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c662682e-6562-48fb-97d6-3293425192ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72721d5d-cdc2-4717-b535-f611d1d88e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:46 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Volume 4422a0c9-5b29-4866-97dc-66de361683fc: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4422a0c9-5b29-4866-97dc-66de361683fc', 'volume_size': 1, 'source_volid': 'b2c12151-f805-46b7-bdba-f0d6c7a62671', 'source_volstatus': 'available'} Aug 10 13:03:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:03:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:03:46 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Cloning volume b2c12151-f805-46b7-bdba-f0d6c7a62671 to volume 4422a0c9-5b29-4866-97dc-66de361683fc Aug 10 13:03:46 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Creating offline snapshot 15121998-5d8c-42cb-a80d-a74e6df039ca of volume b2c12151-f805-46b7-bdba-f0d6c7a62671 {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 13:03:46 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16b1062-f9b2-47f3-9c07-1f68179f1087]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:03:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:46 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671 Aug 10 13:03:46 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:46 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671" returned: 0 in 0.356s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671.15121998-5d8c-42cb-a80d-a74e6df039ca 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:46 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671.15121998-5d8c-42cb-a80d-a74e6df039ca 1G Aug 10 13:03:46 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:47 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671.15121998-5d8c-42cb-a80d-a74e6df039ca 1G" returned: 0 in 0.397s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2c12151-f805-46b7-bdba-f0d6c7a62671 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671.15121998-5d8c-42cb-a80d-a74e6df039ca {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:47 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2c12151-f805-46b7-bdba-f0d6c7a62671 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671.15121998-5d8c-42cb-a80d-a74e6df039ca Aug 10 13:03:47 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:47 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2c12151-f805-46b7-bdba-f0d6c7a62671 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671.15121998-5d8c-42cb-a80d-a74e6df039ca" returned: 0 in 0.286s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:47 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671.15121998-5d8c-42cb-a80d-a74e6df039ca is being set with open permissions: ugo+rw Aug 10 13:03:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671.15121998-5d8c-42cb-a80d-a74e6df039ca {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:47 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671.15121998-5d8c-42cb-a80d-a74e6df039ca Aug 10 13:03:47 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:47 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671.15121998-5d8c-42cb-a80d-a74e6df039ca" returned: 0 in 0.255s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:47 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671.info Aug 10 13:03:47 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:47 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671.info" returned: 0 in 0.257s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:47 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671.info is being set with open permissions: ugo+rw Aug 10 13:03:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:47 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671.info Aug 10 13:03:47 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:48 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671.info" returned: 0 in 0.238s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:48 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Acquiring lock "cinder-quobyte-4422a0c9-5b29-4866-97dc-66de361683fc" by "_copy_volume_from_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:03:48 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Lock "cinder-quobyte-4422a0c9-5b29-4866-97dc-66de361683fc" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:03:48 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] snapshot: 15121998-5d8c-42cb-a80d-a74e6df039ca, volume: 4422a0c9-5b29-4866-97dc-66de361683fc, {{(pid=89096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 10 13:03:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:03:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:03:48 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:03:48 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:03:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:03:48 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2adf5c1-9036-41ee-8d26-352df078eed5]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:03:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671.15121998-5d8c-42cb-a80d-a74e6df039ca {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:48 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671.15121998-5d8c-42cb-a80d-a74e6df039ca Aug 10 13:03:48 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:48 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671.15121998-5d8c-42cb-a80d-a74e6df039ca" returned: 0 in 0.347s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:48 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2c12151-f805-46b7-bdba-f0d6c7a62671(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 13:03:48 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4a940a-01e8-499f-b840-e80f708287cd]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:03:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:48 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671 Aug 10 13:03:48 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:48 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671" returned: 0 in 0.353s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:48 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671 {{(pid=89096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 10 13:03:48 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Creating direct copy from snapshot {{(pid=89096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 10 13:03:48 devstack cinder-volume[89096]: DEBUG cinder.utils [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Path /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4422a0c9-5b29-4866-97dc-66de361683fc not found in is_blk_device check {{(pid=89096) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 10 13:03:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4422a0c9-5b29-4866-97dc-66de361683fc {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:48 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4422a0c9-5b29-4866-97dc-66de361683fc Aug 10 13:03:48 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:52 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4422a0c9-5b29-4866-97dc-66de361683fc" returned: 0 in 4.004s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:52 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Image conversion details: src /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671, size 1024.00 MB, duration 4.01 sec, destination /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4422a0c9-5b29-4866-97dc-66de361683fc {{(pid=89096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 13:03:52 devstack cinder-volume[89096]: INFO cinder.image.image_utils [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Converted 1024.00 MB image at 255.67 MB/s Aug 10 13:03:52 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4422a0c9-5b29-4866-97dc-66de361683fc is being set with open permissions: ugo+rw Aug 10 13:03:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4422a0c9-5b29-4866-97dc-66de361683fc {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:52 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4422a0c9-5b29-4866-97dc-66de361683fc Aug 10 13:03:52 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:53 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4422a0c9-5b29-4866-97dc-66de361683fc" returned: 0 in 0.235s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:53 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Lock "cinder-quobyte-4422a0c9-5b29-4866-97dc-66de361683fc" released by "_copy_volume_from_snapshot" :: held 5.002s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:03:53 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Acquiring lock "cinder-quobyte-15121998-5d8c-42cb-a80d-a74e6df039ca" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:03:53 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Lock "cinder-quobyte-15121998-5d8c-42cb-a80d-a74e6df039ca" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:03:53 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Deleting offline snapshot 15121998-5d8c-42cb-a80d-a74e6df039ca of volume b2c12151-f805-46b7-bdba-f0d6c7a62671 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 13:03:53 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] snapshot_file for this snap is: volume-b2c12151-f805-46b7-bdba-f0d6c7a62671.15121998-5d8c-42cb-a80d-a74e6df039ca {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 13:03:53 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[618db87a-7787-4024-a226-e469c8cf0b2a]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:03:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671.15121998-5d8c-42cb-a80d-a74e6df039ca {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:53 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671.15121998-5d8c-42cb-a80d-a74e6df039ca Aug 10 13:03:53 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:53 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671.15121998-5d8c-42cb-a80d-a74e6df039ca" returned: 0 in 0.351s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:53 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2c12151-f805-46b7-bdba-f0d6c7a62671(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 13:03:53 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d4f724-ded8-47d7-ba9a-1b7644958c09]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:03:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:53 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671 Aug 10 13:03:53 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:54 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671" returned: 0 in 0.514s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671.15121998-5d8c-42cb-a80d-a74e6df039ca {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:54 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671.15121998-5d8c-42cb-a80d-a74e6df039ca Aug 10 13:03:54 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:54 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671.15121998-5d8c-42cb-a80d-a74e6df039ca" returned: 0 in 0.322s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671.15121998-5d8c-42cb-a80d-a74e6df039ca {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:54 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671.15121998-5d8c-42cb-a80d-a74e6df039ca Aug 10 13:03:54 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:54 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671.15121998-5d8c-42cb-a80d-a74e6df039ca" returned: 0 in 0.255s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:54 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Lock "cinder-quobyte-15121998-5d8c-42cb-a80d-a74e6df039ca" released by "_delete_snapshot" :: held 1.530s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:03:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.496s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:03:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72721d5d-cdc2-4717-b535-f611d1d88e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4422a0c9-5b29-4866-97dc-66de361683fc', 'volume_size': 1, 'source_volid': 'b2c12151-f805-46b7-bdba-f0d6c7a62671', 'source_volstatus': 'available'}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f876f705-a3ac-4c48-b83d-5a39a57ae82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:54 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Volume volume-4422a0c9-5b29-4866-97dc-66de361683fc (4422a0c9-5b29-4866-97dc-66de361683fc): created successfully Aug 10 13:03:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f876f705-a3ac-4c48-b83d-5a39a57ae82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Flow 'volume_create_manager' (cac983bb-2bfb-40b5-b6cd-bd65a05d21d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:03:54 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-4c4c858e-2860-40f2-9999-4f864c74afff tempest-VolumesGetTest-378927818 None] Created volume successfully. Aug 10 13:03:56 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0d3ae1f-56e4-4647-a66d-5b67978f897c tempest-VolumesGetTest-378927818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:03:56 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b0d3ae1f-56e4-4647-a66d-5b67978f897c tempest-VolumesGetTest-378927818 None] Flow 'volume_create_manager' (63a690c8-ddfd-4f33-a0e7-f83ae1898f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:03:56 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b0d3ae1f-56e4-4647-a66d-5b67978f897c tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (084e7d61-c107-4b81-982f-e6869ef80ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:56 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b0d3ae1f-56e4-4647-a66d-5b67978f897c tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (084e7d61-c107-4b81-982f-e6869ef80ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:03:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1020542469',display_name='tempest-VolumesGetTest-Volume-1369485955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae5f9879-a24c-4519-ab74-ffb3b60d28ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8f9e2dd2a2e4b06abadb728c3b16527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:03:56Z,use_quota=True,user_id='7d313d8e29bd49ceb79d9199403d8fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:56 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b0d3ae1f-56e4-4647-a66d-5b67978f897c tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17488598-a92f-46d1-bae6-4fcfc5404186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:56 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b0d3ae1f-56e4-4647-a66d-5b67978f897c tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17488598-a92f-46d1-bae6-4fcfc5404186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:56 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b0d3ae1f-56e4-4647-a66d-5b67978f897c tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd289729-8b12-46d1-9687-b76dd3423755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:56 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b0d3ae1f-56e4-4647-a66d-5b67978f897c tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd289729-8b12-46d1-9687-b76dd3423755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae5f9879-a24c-4519-ab74-ffb3b60d28ac', 'volume_name': 'volume-ae5f9879-a24c-4519-ab74-ffb3b60d28ac', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:56 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b0d3ae1f-56e4-4647-a66d-5b67978f897c tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (409a5b7f-2185-485f-95de-1cacca9b6a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:56 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b0d3ae1f-56e4-4647-a66d-5b67978f897c tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (409a5b7f-2185-485f-95de-1cacca9b6a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:56 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b0d3ae1f-56e4-4647-a66d-5b67978f897c tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e97d3e3d-e6cb-4d43-a7e9-b62ba232b66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:56 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-b0d3ae1f-56e4-4647-a66d-5b67978f897c tempest-VolumesGetTest-378927818 None] Volume ae5f9879-a24c-4519-ab74-ffb3b60d28ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae5f9879-a24c-4519-ab74-ffb3b60d28ac', 'volume_size': 1} Aug 10 13:03:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b0d3ae1f-56e4-4647-a66d-5b67978f897c tempest-VolumesGetTest-378927818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:03:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b0d3ae1f-56e4-4647-a66d-5b67978f897c tempest-VolumesGetTest-378927818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:03:56 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b0d3ae1f-56e4-4647-a66d-5b67978f897c tempest-VolumesGetTest-378927818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:03:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1020542469',display_name='tempest-VolumesGetTest-Volume-1369485955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae5f9879-a24c-4519-ab74-ffb3b60d28ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8f9e2dd2a2e4b06abadb728c3b16527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:03:56Z,use_quota=True,user_id='7d313d8e29bd49ceb79d9199403d8fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:03:56 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-b0d3ae1f-56e4-4647-a66d-5b67978f897c tempest-VolumesGetTest-378927818 None] Creating volume ae5f9879-a24c-4519-ab74-ffb3b60d28ac {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:03:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b0d3ae1f-56e4-4647-a66d-5b67978f897c tempest-VolumesGetTest-378927818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:03:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b0d3ae1f-56e4-4647-a66d-5b67978f897c tempest-VolumesGetTest-378927818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:03:56 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b0d3ae1f-56e4-4647-a66d-5b67978f897c tempest-VolumesGetTest-378927818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:03:56 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b0d3ae1f-56e4-4647-a66d-5b67978f897c tempest-VolumesGetTest-378927818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:03:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b0d3ae1f-56e4-4647-a66d-5b67978f897c tempest-VolumesGetTest-378927818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:03:56 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b0d3ae1f-56e4-4647-a66d-5b67978f897c tempest-VolumesGetTest-378927818 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:03:56 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-b0d3ae1f-56e4-4647-a66d-5b67978f897c tempest-VolumesGetTest-378927818 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:03:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b0d3ae1f-56e4-4647-a66d-5b67978f897c tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ae5f9879-a24c-4519-ab74-ffb3b60d28ac 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:56 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ae5f9879-a24c-4519-ab74-ffb3b60d28ac 1073741824 Aug 10 13:03:56 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:57 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b0d3ae1f-56e4-4647-a66d-5b67978f897c tempest-VolumesGetTest-378927818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ae5f9879-a24c-4519-ab74-ffb3b60d28ac 1073741824" returned: 0 in 0.406s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b0d3ae1f-56e4-4647-a66d-5b67978f897c tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ae5f9879-a24c-4519-ab74-ffb3b60d28ac {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:57 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ae5f9879-a24c-4519-ab74-ffb3b60d28ac Aug 10 13:03:57 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:57 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b0d3ae1f-56e4-4647-a66d-5b67978f897c tempest-VolumesGetTest-378927818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ae5f9879-a24c-4519-ab74-ffb3b60d28ac" returned: 0 in 0.234s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:57 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b0d3ae1f-56e4-4647-a66d-5b67978f897c tempest-VolumesGetTest-378927818 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:03:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b0d3ae1f-56e4-4647-a66d-5b67978f897c tempest-VolumesGetTest-378927818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:03:57 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b0d3ae1f-56e4-4647-a66d-5b67978f897c tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e97d3e3d-e6cb-4d43-a7e9-b62ba232b66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae5f9879-a24c-4519-ab74-ffb3b60d28ac', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:57 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b0d3ae1f-56e4-4647-a66d-5b67978f897c tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b0ebc2e-ae85-4221-b7b9-fbc5c6bedda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:03:57 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-b0d3ae1f-56e4-4647-a66d-5b67978f897c tempest-VolumesGetTest-378927818 None] Volume volume-ae5f9879-a24c-4519-ab74-ffb3b60d28ac (ae5f9879-a24c-4519-ab74-ffb3b60d28ac): created successfully Aug 10 13:03:57 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b0d3ae1f-56e4-4647-a66d-5b67978f897c tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b0ebc2e-ae85-4221-b7b9-fbc5c6bedda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:03:57 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b0d3ae1f-56e4-4647-a66d-5b67978f897c tempest-VolumesGetTest-378927818 None] Flow 'volume_create_manager' (63a690c8-ddfd-4f33-a0e7-f83ae1898f86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:03:57 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-b0d3ae1f-56e4-4647-a66d-5b67978f897c tempest-VolumesGetTest-378927818 None] Created volume successfully. Aug 10 13:03:57 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2b1be5fa-d806-48fe-8ca2-e5d8bd96716a tempest-VolumesGetTest-378927818 None] Acquiring lock "cinder-ae5f9879-a24c-4519-ab74-ffb3b60d28ac-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:03:57 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2b1be5fa-d806-48fe-8ca2-e5d8bd96716a tempest-VolumesGetTest-378927818 None] Lock "cinder-ae5f9879-a24c-4519-ab74-ffb3b60d28ac-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:03:57 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2b1be5fa-d806-48fe-8ca2-e5d8bd96716a tempest-VolumesGetTest-378927818 None] Acquiring lock "cinder-quobyte-ae5f9879-a24c-4519-ab74-ffb3b60d28ac" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:03:57 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2b1be5fa-d806-48fe-8ca2-e5d8bd96716a tempest-VolumesGetTest-378927818 None] Lock "cinder-quobyte-ae5f9879-a24c-4519-ab74-ffb3b60d28ac" acquired by "delete_volume" :: waited 0.015s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:03:57 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[3481b8bc-dec0-4399-9e25-6fe9c23e5c00]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:03:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2b1be5fa-d806-48fe-8ca2-e5d8bd96716a tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ae5f9879-a24c-4519-ab74-ffb3b60d28ac {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:57 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ae5f9879-a24c-4519-ab74-ffb3b60d28ac Aug 10 13:03:57 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:58 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2b1be5fa-d806-48fe-8ca2-e5d8bd96716a tempest-VolumesGetTest-378927818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ae5f9879-a24c-4519-ab74-ffb3b60d28ac" returned: 0 in 0.343s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2b1be5fa-d806-48fe-8ca2-e5d8bd96716a tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ae5f9879-a24c-4519-ab74-ffb3b60d28ac {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:58 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ae5f9879-a24c-4519-ab74-ffb3b60d28ac Aug 10 13:03:58 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:58 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2b1be5fa-d806-48fe-8ca2-e5d8bd96716a tempest-VolumesGetTest-378927818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ae5f9879-a24c-4519-ab74-ffb3b60d28ac" returned: 0 in 0.251s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:58 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2b1be5fa-d806-48fe-8ca2-e5d8bd96716a tempest-VolumesGetTest-378927818 None] Lock "cinder-quobyte-ae5f9879-a24c-4519-ab74-ffb3b60d28ac" released by "delete_volume" :: held 0.633s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:03:58 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-2b1be5fa-d806-48fe-8ca2-e5d8bd96716a tempest-VolumesGetTest-378927818 None] Created reservations ['62814902-811f-40db-b9b0-ca350f19f6cc', '64581a53-6879-4e44-be8e-2d68d8a34eaf', '94592fb7-18af-4661-82a6-0db42af5e7b1', '8d9c1f8b-9fbc-4e81-9bef-36962160861c'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:03:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2b1be5fa-d806-48fe-8ca2-e5d8bd96716a tempest-VolumesGetTest-378927818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:03:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2b1be5fa-d806-48fe-8ca2-e5d8bd96716a tempest-VolumesGetTest-378927818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:03:58 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-2b1be5fa-d806-48fe-8ca2-e5d8bd96716a tempest-VolumesGetTest-378927818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:03:58 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-2b1be5fa-d806-48fe-8ca2-e5d8bd96716a tempest-VolumesGetTest-378927818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:03:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2b1be5fa-d806-48fe-8ca2-e5d8bd96716a tempest-VolumesGetTest-378927818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:03:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2b1be5fa-d806-48fe-8ca2-e5d8bd96716a tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:58 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:03:58 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:58 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2b1be5fa-d806-48fe-8ca2-e5d8bd96716a tempest-VolumesGetTest-378927818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.232s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:58 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-2b1be5fa-d806-48fe-8ca2-e5d8bd96716a tempest-VolumesGetTest-378927818 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:03:58 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-2b1be5fa-d806-48fe-8ca2-e5d8bd96716a tempest-VolumesGetTest-378927818 None] Deleted volume successfully. Aug 10 13:03:58 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2b1be5fa-d806-48fe-8ca2-e5d8bd96716a tempest-VolumesGetTest-378927818 None] Lock "cinder-ae5f9879-a24c-4519-ab74-ffb3b60d28ac-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:03:58 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-08e8cd71-caea-4853-a229-ffbf7dade0fc tempest-VolumesGetTest-378927818 None] Acquiring lock "cinder-4422a0c9-5b29-4866-97dc-66de361683fc-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:03:58 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-08e8cd71-caea-4853-a229-ffbf7dade0fc tempest-VolumesGetTest-378927818 None] Lock "cinder-4422a0c9-5b29-4866-97dc-66de361683fc-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:03:58 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-08e8cd71-caea-4853-a229-ffbf7dade0fc tempest-VolumesGetTest-378927818 None] Acquiring lock "cinder-quobyte-4422a0c9-5b29-4866-97dc-66de361683fc" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:03:58 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-08e8cd71-caea-4853-a229-ffbf7dade0fc tempest-VolumesGetTest-378927818 None] Lock "cinder-quobyte-4422a0c9-5b29-4866-97dc-66de361683fc" acquired by "delete_volume" :: waited 0.014s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:03:58 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd0ac03-423e-4722-851d-1935c4df0a17]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:03:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-08e8cd71-caea-4853-a229-ffbf7dade0fc tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4422a0c9-5b29-4866-97dc-66de361683fc {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:59 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4422a0c9-5b29-4866-97dc-66de361683fc Aug 10 13:03:59 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:59 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-08e8cd71-caea-4853-a229-ffbf7dade0fc tempest-VolumesGetTest-378927818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4422a0c9-5b29-4866-97dc-66de361683fc" returned: 0 in 0.348s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-08e8cd71-caea-4853-a229-ffbf7dade0fc tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4422a0c9-5b29-4866-97dc-66de361683fc {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:59 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4422a0c9-5b29-4866-97dc-66de361683fc Aug 10 13:03:59 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:59 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-08e8cd71-caea-4853-a229-ffbf7dade0fc tempest-VolumesGetTest-378927818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4422a0c9-5b29-4866-97dc-66de361683fc" returned: 0 in 0.257s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:59 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-08e8cd71-caea-4853-a229-ffbf7dade0fc tempest-VolumesGetTest-378927818 None] Lock "cinder-quobyte-4422a0c9-5b29-4866-97dc-66de361683fc" released by "delete_volume" :: held 0.645s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:03:59 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=94,cinder:INSERT=33,cinder:DELETE=5,cinder:UPDATE=112 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 13:03:59 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:UPDATE=114,cinder:SELECT=95,cinder:INSERT=25,cinder:DELETE=15 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 13:03:59 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-08e8cd71-caea-4853-a229-ffbf7dade0fc tempest-VolumesGetTest-378927818 None] Created reservations ['5b26cdfa-2c6e-4b74-8cc7-77a35d0fd27f', '5f6a3dd4-0f1d-4add-b834-b8ec498b283b', '1b9203a5-cc88-4c4b-a5d6-857efeaa4d3c', 'f7925ea2-de1f-4a9a-8186-7fc77a57bf1b'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:03:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-08e8cd71-caea-4853-a229-ffbf7dade0fc tempest-VolumesGetTest-378927818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:03:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-08e8cd71-caea-4853-a229-ffbf7dade0fc tempest-VolumesGetTest-378927818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:03:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-08e8cd71-caea-4853-a229-ffbf7dade0fc tempest-VolumesGetTest-378927818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:03:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-08e8cd71-caea-4853-a229-ffbf7dade0fc tempest-VolumesGetTest-378927818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:03:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-08e8cd71-caea-4853-a229-ffbf7dade0fc tempest-VolumesGetTest-378927818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:03:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-08e8cd71-caea-4853-a229-ffbf7dade0fc tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:03:59 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:03:59 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:03:59 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Aug 10 13:03:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-08e8cd71-caea-4853-a229-ffbf7dade0fc tempest-VolumesGetTest-378927818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.255s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:03:59 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-08e8cd71-caea-4853-a229-ffbf7dade0fc tempest-VolumesGetTest-378927818 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:03:59 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-08e8cd71-caea-4853-a229-ffbf7dade0fc tempest-VolumesGetTest-378927818 None] Deleted volume successfully. Aug 10 13:03:59 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-08e8cd71-caea-4853-a229-ffbf7dade0fc tempest-VolumesGetTest-378927818 None] Lock "cinder-4422a0c9-5b29-4866-97dc-66de361683fc-delete_volume" released by "delete_volume" :: held 1.120s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:04:00 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c9c27999-ed91-4b6a-841f-23d86b7317dc tempest-VolumesGetTest-378927818 None] Acquiring lock "cinder-b2c12151-f805-46b7-bdba-f0d6c7a62671-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:04:00 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c9c27999-ed91-4b6a-841f-23d86b7317dc tempest-VolumesGetTest-378927818 None] Lock "cinder-b2c12151-f805-46b7-bdba-f0d6c7a62671-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:04:00 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c9c27999-ed91-4b6a-841f-23d86b7317dc tempest-VolumesGetTest-378927818 None] Acquiring lock "cinder-quobyte-b2c12151-f805-46b7-bdba-f0d6c7a62671" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:04:00 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c9c27999-ed91-4b6a-841f-23d86b7317dc tempest-VolumesGetTest-378927818 None] Lock "cinder-quobyte-b2c12151-f805-46b7-bdba-f0d6c7a62671" acquired by "delete_volume" :: waited 0.015s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:04:00 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd01a804-7632-40e1-b997-7eeb27047039]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:04:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c9c27999-ed91-4b6a-841f-23d86b7317dc tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:04:00 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671 Aug 10 13:04:00 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:04:00 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Aug 10 13:04:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c9c27999-ed91-4b6a-841f-23d86b7317dc tempest-VolumesGetTest-378927818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671" returned: 0 in 0.366s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:04:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c9c27999-ed91-4b6a-841f-23d86b7317dc tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:04:00 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671 Aug 10 13:04:00 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:04:00 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Aug 10 13:04:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c9c27999-ed91-4b6a-841f-23d86b7317dc tempest-VolumesGetTest-378927818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2c12151-f805-46b7-bdba-f0d6c7a62671" returned: 0 in 0.250s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:04:00 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c9c27999-ed91-4b6a-841f-23d86b7317dc tempest-VolumesGetTest-378927818 None] Lock "cinder-quobyte-b2c12151-f805-46b7-bdba-f0d6c7a62671" released by "delete_volume" :: held 0.670s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:04:00 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-c9c27999-ed91-4b6a-841f-23d86b7317dc tempest-VolumesGetTest-378927818 None] Created reservations ['eccbe6e8-5d09-4434-b564-266f5c234f74', '1387c169-47d3-460b-804e-c94521ce9aa6', '800e8f07-0a1a-4359-8cd2-f36a67bbe87e', '2107e046-7af2-4a0c-a7cf-79ed6e73930b'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:04:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c9c27999-ed91-4b6a-841f-23d86b7317dc tempest-VolumesGetTest-378927818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:04:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c9c27999-ed91-4b6a-841f-23d86b7317dc tempest-VolumesGetTest-378927818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:04:00 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c9c27999-ed91-4b6a-841f-23d86b7317dc tempest-VolumesGetTest-378927818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:04:00 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c9c27999-ed91-4b6a-841f-23d86b7317dc tempest-VolumesGetTest-378927818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:04:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c9c27999-ed91-4b6a-841f-23d86b7317dc tempest-VolumesGetTest-378927818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:04:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c9c27999-ed91-4b6a-841f-23d86b7317dc tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:04:00 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:04:00 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:04:01 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Aug 10 13:04:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c9c27999-ed91-4b6a-841f-23d86b7317dc tempest-VolumesGetTest-378927818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.241s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:04:01 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-c9c27999-ed91-4b6a-841f-23d86b7317dc tempest-VolumesGetTest-378927818 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:04:01 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-c9c27999-ed91-4b6a-841f-23d86b7317dc tempest-VolumesGetTest-378927818 None] Deleted volume successfully. Aug 10 13:04:01 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c9c27999-ed91-4b6a-841f-23d86b7317dc tempest-VolumesGetTest-378927818 None] Lock "cinder-b2c12151-f805-46b7-bdba-f0d6c7a62671-delete_volume" released by "delete_volume" :: held 1.116s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:04:02 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:04:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Flow 'volume_create_manager' (f58e748a-bcdc-4688-bfeb-5a48d3e25f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:04:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62c7f362-770c-443e-86b6-1e763a5214f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:04:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62c7f362-770c-443e-86b6-1e763a5214f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1998831027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f11e50bc-5910-458f-829f-ef361f1f5f52,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f8f9e2dd2a2e4b06abadb728c3b16527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:04:02Z,use_quota=True,user_id='7d313d8e29bd49ceb79d9199403d8fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:04:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cfb4473-374c-4a1e-b8a1-4c5c722f989d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:04:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cfb4473-374c-4a1e-b8a1-4c5c722f989d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:04:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba8bdd66-d4de-4df8-903f-1bad79ea5825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:04:02 devstack cinder-volume[89096]: DEBUG cinder.image.glance [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Creating Keystone auth plugin from conf {{(pid=89096) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 10 13:04:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba8bdd66-d4de-4df8-903f-1bad79ea5825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f11e50bc-5910-458f-829f-ef361f1f5f52', 'volume_name': 'volume-f11e50bc-5910-458f-829f-ef361f1f5f52', 'volume_size': 1, 'image_id': 'd127b0c1-c6db-4978-8f85-71a25140f15c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d127b0c1-c6db-4978-8f85-71a25140f15c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '84a7884b15744611bf66a9a12c498e2b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd127b0c1-c6db-4978-8f85-71a25140f15c', 'created_at': datetime.datetime(2026, 8, 10, 10, 40, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 10, 40, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d127b0c1-c6db-4978-8f85-71a25140f15c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:04:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8df9a32f-a529-49a2-bf7d-2d8f80933e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:04:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8df9a32f-a529-49a2-bf7d-2d8f80933e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:04:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ab31d1-ff88-4075-82c8-176f12e8f66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:04:02 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Volume f11e50bc-5910-458f-829f-ef361f1f5f52: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f11e50bc-5910-458f-829f-ef361f1f5f52', 'volume_size': 1, 'image_id': 'd127b0c1-c6db-4978-8f85-71a25140f15c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d127b0c1-c6db-4978-8f85-71a25140f15c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '84a7884b15744611bf66a9a12c498e2b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd127b0c1-c6db-4978-8f85-71a25140f15c', 'created_at': datetime.datetime(2026, 8, 10, 10, 40, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 10, 40, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d127b0c1-c6db-4978-8f85-71a25140f15c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 10 13:04:02 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Trying to clone f11e50bc-5910-458f-829f-ef361f1f5f52 from image d127b0c1-c6db-4978-8f85-71a25140f15c at location (None, [{'url': 'file:///opt/stack/data/glance/images/d127b0c1-c6db-4978-8f85-71a25140f15c', 'metadata': {}}]). {{(pid=89096) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 10 13:04:02 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_2xucjdgrdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89096) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 10 13:04:02 devstack cinder-volume[89096]: INFO cinder.image.image_utils [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Image download 20.69 MB at 20.69 MB/s Aug 10 13:04:02 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[b513fe2b-eea9-40c9-ba25-11e90d4b0002]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:04:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_2xucjdgrdevstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:04:02 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_2xucjdgrdevstack@QuobyteHD Aug 10 13:04:02 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:04:03 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Aug 10 13:04:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_2xucjdgrdevstack@QuobyteHD" returned: 0 in 0.325s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:04:03 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Temporary image d127b0c1-c6db-4978-8f85-71a25140f15c is fetched for user 7d313d8e29bd49ceb79d9199403d8fbf. {{(pid=89096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 10 13:04:03 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[6faf7e3e-1c6c-4127-8452-4deeecb43f73]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:04:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_2xucjdgrdevstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:04:03 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_2xucjdgrdevstack@QuobyteHD Aug 10 13:04:03 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:04:03 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Aug 10 13:04:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_2xucjdgrdevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:04:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:04:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:04:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1998831027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f11e50bc-5910-458f-829f-ef361f1f5f52,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f8f9e2dd2a2e4b06abadb728c3b16527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:04:02Z,use_quota=True,user_id='7d313d8e29bd49ceb79d9199403d8fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:04:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Creating volume f11e50bc-5910-458f-829f-ef361f1f5f52 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:04:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:04:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:04:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:04:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:04:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:04:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:04:03 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:04:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f11e50bc-5910-458f-829f-ef361f1f5f52 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:04:03 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f11e50bc-5910-458f-829f-ef361f1f5f52 1073741824 Aug 10 13:04:03 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:04:03 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 13:04:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:04:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:04:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:04:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:04:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:04:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:04:03 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:04:03 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:04:03 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Aug 10 13:04:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f11e50bc-5910-458f-829f-ef361f1f5f52 1073741824" returned: 0 in 0.421s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:04:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f11e50bc-5910-458f-829f-ef361f1f5f52 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:04:04 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f11e50bc-5910-458f-829f-ef361f1f5f52 Aug 10 13:04:04 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:04:04 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Aug 10 13:04:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.252s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:04:04 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:04:04 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager._thread_info {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 13:04:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread count: 28 {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 13:04:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread info: [<_MainThread(MainThread, started 130607683133568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Aug 10 13:04:04 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Aug 10 13:04:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f11e50bc-5910-458f-829f-ef361f1f5f52" returned: 0 in 0.273s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:04:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:04:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:04:04 devstack cinder-volume[89096]: DEBUG cinder.volume.volume_utils [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Attempting download of d127b0c1-c6db-4978-8f85-71a25140f15c ((None, [{'url': 'file:///opt/stack/data/glance/images/d127b0c1-c6db-4978-8f85-71a25140f15c', 'metadata': {}}])) to volume f11e50bc-5910-458f-829f-ef361f1f5f52. {{(pid=89096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 10 13:04:04 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c31398-5c13-4574-b3ba-f822ab5a1818]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:04:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d127b0c1-c6db-4978-8f85-71a25140f15c_18zmoj7u {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:04:04 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d127b0c1-c6db-4978-8f85-71a25140f15c_18zmoj7u Aug 10 13:04:04 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:04:04 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Aug 10 13:04:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d127b0c1-c6db-4978-8f85-71a25140f15c_18zmoj7u" returned: 0 in 0.344s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:04:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d127b0c1-c6db-4978-8f85-71a25140f15c_18zmoj7u {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:04:04 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d127b0c1-c6db-4978-8f85-71a25140f15c_18zmoj7u Aug 10 13:04:04 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:04:05 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Aug 10 13:04:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d127b0c1-c6db-4978-8f85-71a25140f15c_18zmoj7u" returned: 1 in 0.331s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:04:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d127b0c1-c6db-4978-8f85-71a25140f15c_18zmoj7u' failed. Not Retrying. {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 13:04:05 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef255ec3-c9b4-41c8-b0a1-14feb6348533]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:04:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_2xucjdgrdevstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:04:05 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_2xucjdgrdevstack@QuobyteHD Aug 10 13:04:05 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:04:05 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Aug 10 13:04:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_2xucjdgrdevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:04:05 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] d127b0c1-c6db-4978-8f85-71a25140f15c was qcow2, converting to qcow2 {{(pid=89096) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 10 13:04:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_2xucjdgrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f11e50bc-5910-458f-829f-ef361f1f5f52 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:04:05 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_2xucjdgrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f11e50bc-5910-458f-829f-ef361f1f5f52 Aug 10 13:04:05 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:04:06 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Aug 10 13:04:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_2xucjdgrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f11e50bc-5910-458f-829f-ef361f1f5f52" returned: 0 in 1.533s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:04:06 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d127b0c1-c6db-4978-8f85-71a25140f15c_2xucjdgrdevstack@QuobyteHD, size 112.00 MB, duration 1.53 sec, destination /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f11e50bc-5910-458f-829f-ef361f1f5f52 {{(pid=89096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 13:04:06 devstack cinder-volume[89096]: INFO cinder.image.image_utils [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Converted 112.00 MB image at 73.01 MB/s Aug 10 13:04:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f11e50bc-5910-458f-829f-ef361f1f5f52 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:04:06 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f11e50bc-5910-458f-829f-ef361f1f5f52 1G Aug 10 13:04:06 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:04:07 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Aug 10 13:04:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f11e50bc-5910-458f-829f-ef361f1f5f52 1G" returned: 0 in 0.312s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:04:07 devstack cinder-volume[89096]: DEBUG cinder.volume.volume_utils [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Downloaded image d127b0c1-c6db-4978-8f85-71a25140f15c ((None, [{'url': 'file:///opt/stack/data/glance/images/d127b0c1-c6db-4978-8f85-71a25140f15c', 'metadata': {}}])) to volume f11e50bc-5910-458f-829f-ef361f1f5f52 successfully. {{(pid=89096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 10 13:04:07 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Temporary image d127b0c1-c6db-4978-8f85-71a25140f15c for user 7d313d8e29bd49ceb79d9199403d8fbf is deleted. {{(pid=89096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 10 13:04:07 devstack cinder-volume[89096]: DEBUG cinder.volume.volume_utils [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Marking volume f11e50bc-5910-458f-829f-ef361f1f5f52 as bootable. {{(pid=89096) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 10 13:04:07 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Copying metadata from image d127b0c1-c6db-4978-8f85-71a25140f15c to f11e50bc-5910-458f-829f-ef361f1f5f52. {{(pid=89096) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 10 13:04:07 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Creating volume glance metadata for volume f11e50bc-5910-458f-829f-ef361f1f5f52 backed by image d127b0c1-c6db-4978-8f85-71a25140f15c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd127b0c1-c6db-4978-8f85-71a25140f15c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89096) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 10 13:04:07 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ab31d1-ff88-4075-82c8-176f12e8f66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f11e50bc-5910-458f-829f-ef361f1f5f52', 'volume_size': 1, 'image_id': 'd127b0c1-c6db-4978-8f85-71a25140f15c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d127b0c1-c6db-4978-8f85-71a25140f15c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '84a7884b15744611bf66a9a12c498e2b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd127b0c1-c6db-4978-8f85-71a25140f15c', 'created_at': datetime.datetime(2026, 8, 10, 10, 40, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 10, 40, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d127b0c1-c6db-4978-8f85-71a25140f15c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:04:07 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f6e138f-41d0-4b4a-9638-36d831601ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:04:07 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Volume volume-f11e50bc-5910-458f-829f-ef361f1f5f52 (f11e50bc-5910-458f-829f-ef361f1f5f52): created successfully Aug 10 13:04:07 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f6e138f-41d0-4b4a-9638-36d831601ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:04:07 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Flow 'volume_create_manager' (f58e748a-bcdc-4688-bfeb-5a48d3e25f94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:04:07 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-9bed7348-a305-49db-be11-05c5115a11c1 tempest-VolumesGetTest-378927818 None] Created volume successfully. Aug 10 13:04:08 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8f3f52b-8b0c-409a-9c1c-b507fd31b4c6 tempest-VolumesGetTest-378927818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:04:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c8f3f52b-8b0c-409a-9c1c-b507fd31b4c6 tempest-VolumesGetTest-378927818 None] Flow 'volume_create_manager' (5d17bf6e-2c2c-4365-8949-773ab471e1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:04:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c8f3f52b-8b0c-409a-9c1c-b507fd31b4c6 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0207679a-774c-4cc5-b429-a2a3e3cad670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:04:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c8f3f52b-8b0c-409a-9c1c-b507fd31b4c6 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0207679a-774c-4cc5-b429-a2a3e3cad670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:04:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-771340840',display_name='tempest-VolumesGetTest-Volume-1643735538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a03d63d7-6f2b-45aa-b7c8-07cc80f56b7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8f9e2dd2a2e4b06abadb728c3b16527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:04:09Z,use_quota=True,user_id='7d313d8e29bd49ceb79d9199403d8fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:04:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c8f3f52b-8b0c-409a-9c1c-b507fd31b4c6 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5853a68c-b44a-4943-a7c4-db7448317bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:04:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c8f3f52b-8b0c-409a-9c1c-b507fd31b4c6 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5853a68c-b44a-4943-a7c4-db7448317bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:04:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c8f3f52b-8b0c-409a-9c1c-b507fd31b4c6 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b643ec6b-9187-4608-bbd3-2ae27edcd59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:04:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c8f3f52b-8b0c-409a-9c1c-b507fd31b4c6 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b643ec6b-9187-4608-bbd3-2ae27edcd59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a03d63d7-6f2b-45aa-b7c8-07cc80f56b7a', 'volume_name': 'volume-a03d63d7-6f2b-45aa-b7c8-07cc80f56b7a', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:04:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c8f3f52b-8b0c-409a-9c1c-b507fd31b4c6 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (329cb2a9-41e9-44b8-b54e-e1b5d576f4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:04:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c8f3f52b-8b0c-409a-9c1c-b507fd31b4c6 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (329cb2a9-41e9-44b8-b54e-e1b5d576f4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:04:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c8f3f52b-8b0c-409a-9c1c-b507fd31b4c6 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ddbb43-f505-41d4-bca9-2ac24f519d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:04:09 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-c8f3f52b-8b0c-409a-9c1c-b507fd31b4c6 tempest-VolumesGetTest-378927818 None] Volume a03d63d7-6f2b-45aa-b7c8-07cc80f56b7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a03d63d7-6f2b-45aa-b7c8-07cc80f56b7a', 'volume_size': 1} Aug 10 13:04:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c8f3f52b-8b0c-409a-9c1c-b507fd31b4c6 tempest-VolumesGetTest-378927818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:04:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c8f3f52b-8b0c-409a-9c1c-b507fd31b4c6 tempest-VolumesGetTest-378927818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:04:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c8f3f52b-8b0c-409a-9c1c-b507fd31b4c6 tempest-VolumesGetTest-378927818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:04:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-771340840',display_name='tempest-VolumesGetTest-Volume-1643735538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a03d63d7-6f2b-45aa-b7c8-07cc80f56b7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8f9e2dd2a2e4b06abadb728c3b16527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:04:09Z,use_quota=True,user_id='7d313d8e29bd49ceb79d9199403d8fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:04:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-c8f3f52b-8b0c-409a-9c1c-b507fd31b4c6 tempest-VolumesGetTest-378927818 None] Creating volume a03d63d7-6f2b-45aa-b7c8-07cc80f56b7a {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:04:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c8f3f52b-8b0c-409a-9c1c-b507fd31b4c6 tempest-VolumesGetTest-378927818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:04:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c8f3f52b-8b0c-409a-9c1c-b507fd31b4c6 tempest-VolumesGetTest-378927818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:04:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c8f3f52b-8b0c-409a-9c1c-b507fd31b4c6 tempest-VolumesGetTest-378927818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:04:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c8f3f52b-8b0c-409a-9c1c-b507fd31b4c6 tempest-VolumesGetTest-378927818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:04:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c8f3f52b-8b0c-409a-9c1c-b507fd31b4c6 tempest-VolumesGetTest-378927818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:04:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c8f3f52b-8b0c-409a-9c1c-b507fd31b4c6 tempest-VolumesGetTest-378927818 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:04:09 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-c8f3f52b-8b0c-409a-9c1c-b507fd31b4c6 tempest-VolumesGetTest-378927818 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:04:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c8f3f52b-8b0c-409a-9c1c-b507fd31b4c6 tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a03d63d7-6f2b-45aa-b7c8-07cc80f56b7a 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:04:09 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a03d63d7-6f2b-45aa-b7c8-07cc80f56b7a 1073741824 Aug 10 13:04:09 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:04:09 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Aug 10 13:04:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c8f3f52b-8b0c-409a-9c1c-b507fd31b4c6 tempest-VolumesGetTest-378927818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a03d63d7-6f2b-45aa-b7c8-07cc80f56b7a 1073741824" returned: 0 in 0.395s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:04:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c8f3f52b-8b0c-409a-9c1c-b507fd31b4c6 tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a03d63d7-6f2b-45aa-b7c8-07cc80f56b7a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:04:09 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a03d63d7-6f2b-45aa-b7c8-07cc80f56b7a Aug 10 13:04:09 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:04:09 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Aug 10 13:04:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c8f3f52b-8b0c-409a-9c1c-b507fd31b4c6 tempest-VolumesGetTest-378927818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a03d63d7-6f2b-45aa-b7c8-07cc80f56b7a" returned: 0 in 0.243s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:04:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c8f3f52b-8b0c-409a-9c1c-b507fd31b4c6 tempest-VolumesGetTest-378927818 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:04:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c8f3f52b-8b0c-409a-9c1c-b507fd31b4c6 tempest-VolumesGetTest-378927818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:04:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c8f3f52b-8b0c-409a-9c1c-b507fd31b4c6 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ddbb43-f505-41d4-bca9-2ac24f519d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a03d63d7-6f2b-45aa-b7c8-07cc80f56b7a', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:04:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c8f3f52b-8b0c-409a-9c1c-b507fd31b4c6 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbaa553c-3297-49af-9e28-c4ae51b9e64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:04:09 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-c8f3f52b-8b0c-409a-9c1c-b507fd31b4c6 tempest-VolumesGetTest-378927818 None] Volume volume-a03d63d7-6f2b-45aa-b7c8-07cc80f56b7a (a03d63d7-6f2b-45aa-b7c8-07cc80f56b7a): created successfully Aug 10 13:04:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c8f3f52b-8b0c-409a-9c1c-b507fd31b4c6 tempest-VolumesGetTest-378927818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbaa553c-3297-49af-9e28-c4ae51b9e64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:04:09 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c8f3f52b-8b0c-409a-9c1c-b507fd31b4c6 tempest-VolumesGetTest-378927818 None] Flow 'volume_create_manager' (5d17bf6e-2c2c-4365-8949-773ab471e1ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:04:09 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-c8f3f52b-8b0c-409a-9c1c-b507fd31b4c6 tempest-VolumesGetTest-378927818 None] Created volume successfully. Aug 10 13:04:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-3aad11c5-5060-46de-9fcf-a26c0ff90f38 tempest-VolumesGetTest-378927818 None] Acquiring lock "cinder-a03d63d7-6f2b-45aa-b7c8-07cc80f56b7a-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:04:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-3aad11c5-5060-46de-9fcf-a26c0ff90f38 tempest-VolumesGetTest-378927818 None] Lock "cinder-a03d63d7-6f2b-45aa-b7c8-07cc80f56b7a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:04:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-3aad11c5-5060-46de-9fcf-a26c0ff90f38 tempest-VolumesGetTest-378927818 None] Acquiring lock "cinder-quobyte-a03d63d7-6f2b-45aa-b7c8-07cc80f56b7a" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:04:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-3aad11c5-5060-46de-9fcf-a26c0ff90f38 tempest-VolumesGetTest-378927818 None] Lock "cinder-quobyte-a03d63d7-6f2b-45aa-b7c8-07cc80f56b7a" acquired by "delete_volume" :: waited 0.014s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:04:10 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edc718d-4bc3-4150-b021-8af3c9a7ebb7]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:04:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3aad11c5-5060-46de-9fcf-a26c0ff90f38 tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a03d63d7-6f2b-45aa-b7c8-07cc80f56b7a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:04:10 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a03d63d7-6f2b-45aa-b7c8-07cc80f56b7a Aug 10 13:04:10 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:04:10 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Aug 10 13:04:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3aad11c5-5060-46de-9fcf-a26c0ff90f38 tempest-VolumesGetTest-378927818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a03d63d7-6f2b-45aa-b7c8-07cc80f56b7a" returned: 0 in 0.352s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:04:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3aad11c5-5060-46de-9fcf-a26c0ff90f38 tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a03d63d7-6f2b-45aa-b7c8-07cc80f56b7a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:04:10 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a03d63d7-6f2b-45aa-b7c8-07cc80f56b7a Aug 10 13:04:10 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:04:10 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Aug 10 13:04:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3aad11c5-5060-46de-9fcf-a26c0ff90f38 tempest-VolumesGetTest-378927818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a03d63d7-6f2b-45aa-b7c8-07cc80f56b7a" returned: 0 in 0.246s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:04:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-3aad11c5-5060-46de-9fcf-a26c0ff90f38 tempest-VolumesGetTest-378927818 None] Lock "cinder-quobyte-a03d63d7-6f2b-45aa-b7c8-07cc80f56b7a" released by "delete_volume" :: held 0.636s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:04:10 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-3aad11c5-5060-46de-9fcf-a26c0ff90f38 tempest-VolumesGetTest-378927818 None] Created reservations ['dfa5ca20-8b25-473a-be2b-10d7d9b7d7af', '754732f8-11a6-4a29-96c9-f5dd01917246', '2890b82d-df4d-4217-820d-659e5c59f593', '3c4c6454-4e3a-40ac-983f-b72d8da65d2f'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:04:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3aad11c5-5060-46de-9fcf-a26c0ff90f38 tempest-VolumesGetTest-378927818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:04:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3aad11c5-5060-46de-9fcf-a26c0ff90f38 tempest-VolumesGetTest-378927818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:04:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3aad11c5-5060-46de-9fcf-a26c0ff90f38 tempest-VolumesGetTest-378927818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:04:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3aad11c5-5060-46de-9fcf-a26c0ff90f38 tempest-VolumesGetTest-378927818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:04:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3aad11c5-5060-46de-9fcf-a26c0ff90f38 tempest-VolumesGetTest-378927818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:04:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3aad11c5-5060-46de-9fcf-a26c0ff90f38 tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:04:10 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:04:10 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:04:11 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Aug 10 13:04:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3aad11c5-5060-46de-9fcf-a26c0ff90f38 tempest-VolumesGetTest-378927818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.243s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:04:11 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-3aad11c5-5060-46de-9fcf-a26c0ff90f38 tempest-VolumesGetTest-378927818 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:04:11 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-3aad11c5-5060-46de-9fcf-a26c0ff90f38 tempest-VolumesGetTest-378927818 None] Deleted volume successfully. Aug 10 13:04:11 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-3aad11c5-5060-46de-9fcf-a26c0ff90f38 tempest-VolumesGetTest-378927818 None] Lock "cinder-a03d63d7-6f2b-45aa-b7c8-07cc80f56b7a-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:04:11 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2d2d9fbe-3dc8-4ed8-bf7a-b4aefc98b92f tempest-VolumesGetTest-378927818 None] Acquiring lock "cinder-f11e50bc-5910-458f-829f-ef361f1f5f52-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:04:11 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2d2d9fbe-3dc8-4ed8-bf7a-b4aefc98b92f tempest-VolumesGetTest-378927818 None] Lock "cinder-f11e50bc-5910-458f-829f-ef361f1f5f52-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:04:11 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2d2d9fbe-3dc8-4ed8-bf7a-b4aefc98b92f tempest-VolumesGetTest-378927818 None] Acquiring lock "cinder-quobyte-f11e50bc-5910-458f-829f-ef361f1f5f52" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:04:11 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2d2d9fbe-3dc8-4ed8-bf7a-b4aefc98b92f tempest-VolumesGetTest-378927818 None] Lock "cinder-quobyte-f11e50bc-5910-458f-829f-ef361f1f5f52" acquired by "delete_volume" :: waited 0.016s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:04:11 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba250ab-a202-4588-9487-639a8e98d92b]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:04:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2d2d9fbe-3dc8-4ed8-bf7a-b4aefc98b92f tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f11e50bc-5910-458f-829f-ef361f1f5f52 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:04:11 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f11e50bc-5910-458f-829f-ef361f1f5f52 Aug 10 13:04:11 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:04:11 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Aug 10 13:04:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2d2d9fbe-3dc8-4ed8-bf7a-b4aefc98b92f tempest-VolumesGetTest-378927818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f11e50bc-5910-458f-829f-ef361f1f5f52" returned: 0 in 0.361s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:04:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2d2d9fbe-3dc8-4ed8-bf7a-b4aefc98b92f tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f11e50bc-5910-458f-829f-ef361f1f5f52 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:04:11 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f11e50bc-5910-458f-829f-ef361f1f5f52 Aug 10 13:04:11 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:04:12 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Aug 10 13:04:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2d2d9fbe-3dc8-4ed8-bf7a-b4aefc98b92f tempest-VolumesGetTest-378927818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f11e50bc-5910-458f-829f-ef361f1f5f52" returned: 0 in 0.245s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:04:12 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2d2d9fbe-3dc8-4ed8-bf7a-b4aefc98b92f tempest-VolumesGetTest-378927818 None] Lock "cinder-quobyte-f11e50bc-5910-458f-829f-ef361f1f5f52" released by "delete_volume" :: held 0.649s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:04:12 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-2d2d9fbe-3dc8-4ed8-bf7a-b4aefc98b92f tempest-VolumesGetTest-378927818 None] Created reservations ['c92175fc-68e7-412a-8376-8bc90bb5e64d', '6cc12ad4-962b-4bde-b2e3-f0502b092247', '8ec2dc9b-0e13-4e57-bdd4-a3503e8538e7', 'f84f75a2-1476-4adc-8564-27dbe16971dd'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:04:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2d2d9fbe-3dc8-4ed8-bf7a-b4aefc98b92f tempest-VolumesGetTest-378927818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:04:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2d2d9fbe-3dc8-4ed8-bf7a-b4aefc98b92f tempest-VolumesGetTest-378927818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:04:12 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-2d2d9fbe-3dc8-4ed8-bf7a-b4aefc98b92f tempest-VolumesGetTest-378927818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:04:12 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-2d2d9fbe-3dc8-4ed8-bf7a-b4aefc98b92f tempest-VolumesGetTest-378927818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:04:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2d2d9fbe-3dc8-4ed8-bf7a-b4aefc98b92f tempest-VolumesGetTest-378927818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:04:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2d2d9fbe-3dc8-4ed8-bf7a-b4aefc98b92f tempest-VolumesGetTest-378927818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:04:12 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:04:12 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:04:12 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Aug 10 13:04:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2d2d9fbe-3dc8-4ed8-bf7a-b4aefc98b92f tempest-VolumesGetTest-378927818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.259s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:04:12 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-2d2d9fbe-3dc8-4ed8-bf7a-b4aefc98b92f tempest-VolumesGetTest-378927818 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:04:12 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-2d2d9fbe-3dc8-4ed8-bf7a-b4aefc98b92f tempest-VolumesGetTest-378927818 None] Deleted volume successfully. Aug 10 13:04:12 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2d2d9fbe-3dc8-4ed8-bf7a-b4aefc98b92f tempest-VolumesGetTest-378927818 None] Lock "cinder-f11e50bc-5910-458f-829f-ef361f1f5f52-delete_volume" released by "delete_volume" :: held 1.140s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:04:22 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=34,cinder:INSERT=20,cinder:UPDATE=42,cinder:DELETE=2 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 13:04:22 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:UPDATE=36,cinder:DELETE=4,cinder:SELECT=25,cinder:INSERT=11 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 13:04:36 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-90e95102-a17f-48c4-b32b-ea6c0f08a1df tempest-TestInstancesWithCinderVolumes-773385314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:04:36 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-90e95102-a17f-48c4-b32b-ea6c0f08a1df tempest-TestInstancesWithCinderVolumes-773385314 None] Flow 'volume_create_manager' (ab6ed736-2ba6-44bb-a001-1112c4daf6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:04:36 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-90e95102-a17f-48c4-b32b-ea6c0f08a1df tempest-TestInstancesWithCinderVolumes-773385314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f74764a1-e5a6-45b8-ac4a-1d2a45893bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:04:36 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-90e95102-a17f-48c4-b32b-ea6c0f08a1df tempest-TestInstancesWithCinderVolumes-773385314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f74764a1-e5a6-45b8-ac4a-1d2a45893bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1275794141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dadb721-3d63-4f63-939b-5d3946bc91df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0282ac6e7ec749acb3081e72a69258f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:04:37Z,use_quota=True,user_id='e561a66127d4439aada58d15baffbb75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ec5a8a7-55bf-4a86-ba9d-4044ca4f14ee),volume_type_id=2ec5a8a7-55bf-4a86-ba9d-4044ca4f14ee)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:04:36 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-90e95102-a17f-48c4-b32b-ea6c0f08a1df tempest-TestInstancesWithCinderVolumes-773385314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4853f689-53f9-4ad6-ac20-0e75abc6cd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:04:36 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-90e95102-a17f-48c4-b32b-ea6c0f08a1df tempest-TestInstancesWithCinderVolumes-773385314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4853f689-53f9-4ad6-ac20-0e75abc6cd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:04:36 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-90e95102-a17f-48c4-b32b-ea6c0f08a1df tempest-TestInstancesWithCinderVolumes-773385314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (423c10cc-8562-4d45-841d-b2b2ff48f85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:04:36 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-90e95102-a17f-48c4-b32b-ea6c0f08a1df tempest-TestInstancesWithCinderVolumes-773385314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (423c10cc-8562-4d45-841d-b2b2ff48f85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dadb721-3d63-4f63-939b-5d3946bc91df', 'volume_name': 'volume-3dadb721-3d63-4f63-939b-5d3946bc91df', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:04:36 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-90e95102-a17f-48c4-b32b-ea6c0f08a1df tempest-TestInstancesWithCinderVolumes-773385314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e2b0d08-8770-456d-9bed-f5ebd918bc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:04:36 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-90e95102-a17f-48c4-b32b-ea6c0f08a1df tempest-TestInstancesWithCinderVolumes-773385314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e2b0d08-8770-456d-9bed-f5ebd918bc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:04:36 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-90e95102-a17f-48c4-b32b-ea6c0f08a1df tempest-TestInstancesWithCinderVolumes-773385314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d7d1f77-ac76-4219-b44f-349764def5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:04:36 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-90e95102-a17f-48c4-b32b-ea6c0f08a1df tempest-TestInstancesWithCinderVolumes-773385314 None] Volume 3dadb721-3d63-4f63-939b-5d3946bc91df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dadb721-3d63-4f63-939b-5d3946bc91df', 'volume_size': 1} Aug 10 13:04:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-90e95102-a17f-48c4-b32b-ea6c0f08a1df tempest-TestInstancesWithCinderVolumes-773385314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:04:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-90e95102-a17f-48c4-b32b-ea6c0f08a1df tempest-TestInstancesWithCinderVolumes-773385314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:04:36 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-90e95102-a17f-48c4-b32b-ea6c0f08a1df tempest-TestInstancesWithCinderVolumes-773385314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1275794141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dadb721-3d63-4f63-939b-5d3946bc91df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0282ac6e7ec749acb3081e72a69258f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:04:37Z,use_quota=True,user_id='e561a66127d4439aada58d15baffbb75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ec5a8a7-55bf-4a86-ba9d-4044ca4f14ee),volume_type_id=2ec5a8a7-55bf-4a86-ba9d-4044ca4f14ee)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:04:36 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-90e95102-a17f-48c4-b32b-ea6c0f08a1df tempest-TestInstancesWithCinderVolumes-773385314 None] Creating volume 3dadb721-3d63-4f63-939b-5d3946bc91df {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:04:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-90e95102-a17f-48c4-b32b-ea6c0f08a1df tempest-TestInstancesWithCinderVolumes-773385314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:04:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-90e95102-a17f-48c4-b32b-ea6c0f08a1df tempest-TestInstancesWithCinderVolumes-773385314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:04:36 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-90e95102-a17f-48c4-b32b-ea6c0f08a1df tempest-TestInstancesWithCinderVolumes-773385314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:04:36 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-90e95102-a17f-48c4-b32b-ea6c0f08a1df tempest-TestInstancesWithCinderVolumes-773385314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:04:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-90e95102-a17f-48c4-b32b-ea6c0f08a1df tempest-TestInstancesWithCinderVolumes-773385314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:04:36 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-90e95102-a17f-48c4-b32b-ea6c0f08a1df tempest-TestInstancesWithCinderVolumes-773385314 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:04:36 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-90e95102-a17f-48c4-b32b-ea6c0f08a1df tempest-TestInstancesWithCinderVolumes-773385314 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:04:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-90e95102-a17f-48c4-b32b-ea6c0f08a1df tempest-TestInstancesWithCinderVolumes-773385314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3dadb721-3d63-4f63-939b-5d3946bc91df 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:04:36 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3dadb721-3d63-4f63-939b-5d3946bc91df 1073741824 Aug 10 13:04:36 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:04:36 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-faa0d6b7-f1e9-4f53-8285-3bd2ab121874 tempest-TestInstancesWithCinderVolumes-773385314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-faa0d6b7-f1e9-4f53-8285-3bd2ab121874 tempest-TestInstancesWithCinderVolumes-773385314 None] Flow 'volume_create_manager' (7bbd17b1-6ace-4ec7-ab28-46b1258d6333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-faa0d6b7-f1e9-4f53-8285-3bd2ab121874 tempest-TestInstancesWithCinderVolumes-773385314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa503b0c-7655-419e-8b2a-2d9063d26358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-faa0d6b7-f1e9-4f53-8285-3bd2ab121874 tempest-TestInstancesWithCinderVolumes-773385314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa503b0c-7655-419e-8b2a-2d9063d26358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-831733841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f30f0534-c23c-4068-b89a-d93731e0aa96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0282ac6e7ec749acb3081e72a69258f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:04:37Z,use_quota=True,user_id='e561a66127d4439aada58d15baffbb75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c66c34a8-d806-438b-8fe4-dc65653fbd64),volume_type_id=c66c34a8-d806-438b-8fe4-dc65653fbd64)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-faa0d6b7-f1e9-4f53-8285-3bd2ab121874 tempest-TestInstancesWithCinderVolumes-773385314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dbda709-ae8e-4f45-8c56-05c459dd2328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-faa0d6b7-f1e9-4f53-8285-3bd2ab121874 tempest-TestInstancesWithCinderVolumes-773385314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dbda709-ae8e-4f45-8c56-05c459dd2328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-faa0d6b7-f1e9-4f53-8285-3bd2ab121874 tempest-TestInstancesWithCinderVolumes-773385314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (085822d1-48b3-4a03-a826-7a4a6dc84884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-faa0d6b7-f1e9-4f53-8285-3bd2ab121874 tempest-TestInstancesWithCinderVolumes-773385314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (085822d1-48b3-4a03-a826-7a4a6dc84884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f30f0534-c23c-4068-b89a-d93731e0aa96', 'volume_name': 'volume-f30f0534-c23c-4068-b89a-d93731e0aa96', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-faa0d6b7-f1e9-4f53-8285-3bd2ab121874 tempest-TestInstancesWithCinderVolumes-773385314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb38b16-816b-473e-9cee-cce8671bb55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-faa0d6b7-f1e9-4f53-8285-3bd2ab121874 tempest-TestInstancesWithCinderVolumes-773385314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb38b16-816b-473e-9cee-cce8671bb55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-faa0d6b7-f1e9-4f53-8285-3bd2ab121874 tempest-TestInstancesWithCinderVolumes-773385314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba21d24f-5d6a-430d-909a-40a2fce380a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:04:37 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-faa0d6b7-f1e9-4f53-8285-3bd2ab121874 tempest-TestInstancesWithCinderVolumes-773385314 None] Volume f30f0534-c23c-4068-b89a-d93731e0aa96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f30f0534-c23c-4068-b89a-d93731e0aa96', 'volume_size': 1} Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-faa0d6b7-f1e9-4f53-8285-3bd2ab121874 tempest-TestInstancesWithCinderVolumes-773385314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:04:37 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-90e95102-a17f-48c4-b32b-ea6c0f08a1df tempest-TestInstancesWithCinderVolumes-773385314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3dadb721-3d63-4f63-939b-5d3946bc91df 1073741824" returned: 0 in 0.472s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-90e95102-a17f-48c4-b32b-ea6c0f08a1df tempest-TestInstancesWithCinderVolumes-773385314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3dadb721-3d63-4f63-939b-5d3946bc91df {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:04:37 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3dadb721-3d63-4f63-939b-5d3946bc91df Aug 10 13:04:37 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:04:37 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-90e95102-a17f-48c4-b32b-ea6c0f08a1df tempest-TestInstancesWithCinderVolumes-773385314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3dadb721-3d63-4f63-939b-5d3946bc91df" returned: 0 in 0.261s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-90e95102-a17f-48c4-b32b-ea6c0f08a1df tempest-TestInstancesWithCinderVolumes-773385314 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-90e95102-a17f-48c4-b32b-ea6c0f08a1df tempest-TestInstancesWithCinderVolumes-773385314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-faa0d6b7-f1e9-4f53-8285-3bd2ab121874 tempest-TestInstancesWithCinderVolumes-773385314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.425s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-faa0d6b7-f1e9-4f53-8285-3bd2ab121874 tempest-TestInstancesWithCinderVolumes-773385314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-831733841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f30f0534-c23c-4068-b89a-d93731e0aa96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0282ac6e7ec749acb3081e72a69258f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:04:37Z,use_quota=True,user_id='e561a66127d4439aada58d15baffbb75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c66c34a8-d806-438b-8fe4-dc65653fbd64),volume_type_id=c66c34a8-d806-438b-8fe4-dc65653fbd64)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-faa0d6b7-f1e9-4f53-8285-3bd2ab121874 tempest-TestInstancesWithCinderVolumes-773385314 None] Creating volume f30f0534-c23c-4068-b89a-d93731e0aa96 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-faa0d6b7-f1e9-4f53-8285-3bd2ab121874 tempest-TestInstancesWithCinderVolumes-773385314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-faa0d6b7-f1e9-4f53-8285-3bd2ab121874 tempest-TestInstancesWithCinderVolumes-773385314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-faa0d6b7-f1e9-4f53-8285-3bd2ab121874 tempest-TestInstancesWithCinderVolumes-773385314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-faa0d6b7-f1e9-4f53-8285-3bd2ab121874 tempest-TestInstancesWithCinderVolumes-773385314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-faa0d6b7-f1e9-4f53-8285-3bd2ab121874 tempest-TestInstancesWithCinderVolumes-773385314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-faa0d6b7-f1e9-4f53-8285-3bd2ab121874 tempest-TestInstancesWithCinderVolumes-773385314 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:04:37 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-faa0d6b7-f1e9-4f53-8285-3bd2ab121874 tempest-TestInstancesWithCinderVolumes-773385314 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-faa0d6b7-f1e9-4f53-8285-3bd2ab121874 tempest-TestInstancesWithCinderVolumes-773385314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f30f0534-c23c-4068-b89a-d93731e0aa96 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-90e95102-a17f-48c4-b32b-ea6c0f08a1df tempest-TestInstancesWithCinderVolumes-773385314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d7d1f77-ac76-4219-b44f-349764def5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dadb721-3d63-4f63-939b-5d3946bc91df', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:04:37 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f30f0534-c23c-4068-b89a-d93731e0aa96 1073741824 Aug 10 13:04:37 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-90e95102-a17f-48c4-b32b-ea6c0f08a1df tempest-TestInstancesWithCinderVolumes-773385314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3279ed20-356b-4dc8-b3d2-08c66e3fc3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:04:37 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-90e95102-a17f-48c4-b32b-ea6c0f08a1df tempest-TestInstancesWithCinderVolumes-773385314 None] Volume volume-3dadb721-3d63-4f63-939b-5d3946bc91df (3dadb721-3d63-4f63-939b-5d3946bc91df): created successfully Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-90e95102-a17f-48c4-b32b-ea6c0f08a1df tempest-TestInstancesWithCinderVolumes-773385314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3279ed20-356b-4dc8-b3d2-08c66e3fc3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-90e95102-a17f-48c4-b32b-ea6c0f08a1df tempest-TestInstancesWithCinderVolumes-773385314 None] Flow 'volume_create_manager' (ab6ed736-2ba6-44bb-a001-1112c4daf6b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Flow 'volume_create_manager' (4ce490f5-3989-44e7-bab2-fc33ea19c556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (277a2928-e042-4f68-88a6-471ba6eb9b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:04:37 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-90e95102-a17f-48c4-b32b-ea6c0f08a1df tempest-TestInstancesWithCinderVolumes-773385314 None] Created volume successfully. Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (277a2928-e042-4f68-88a6-471ba6eb9b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-679352958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89e11c34-7d5b-4a0c-bcab-f4d51090d433,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0282ac6e7ec749acb3081e72a69258f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:04:38Z,use_quota=True,user_id='e561a66127d4439aada58d15baffbb75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df5d28f5-99b1-4dc8-82c5-2db83bf5b963),volume_type_id=df5d28f5-99b1-4dc8-82c5-2db83bf5b963)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e86ae1cb-fc0e-4a9f-87c4-43ae6dbede31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e86ae1cb-fc0e-4a9f-87c4-43ae6dbede31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81d1d26d-0e71-4a53-8781-d7dfa7568aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG cinder.image.glance [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Creating Keystone auth plugin from conf {{(pid=89096) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81d1d26d-0e71-4a53-8781-d7dfa7568aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '89e11c34-7d5b-4a0c-bcab-f4d51090d433', 'volume_name': 'volume-89e11c34-7d5b-4a0c-bcab-f4d51090d433', 'volume_size': 1, 'image_id': 'c925631b-0a0d-43f9-a734-7bc5ee89f638', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c925631b-0a0d-43f9-a734-7bc5ee89f638', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1374960316', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0282ac6e7ec749acb3081e72a69258f6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c925631b-0a0d-43f9-a734-7bc5ee89f638', 'created_at': datetime.datetime(2026, 8, 10, 11, 4, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 11, 4, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c925631b-0a0d-43f9-a734-7bc5ee89f638/file', 'properties': {}}, 'image_service': }' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a78b1803-c0a8-418c-a632-497889f2148b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a78b1803-c0a8-418c-a632-497889f2148b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcd96e36-60b7-47d3-bd1b-0682bbe56910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:04:37 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Volume 89e11c34-7d5b-4a0c-bcab-f4d51090d433: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-89e11c34-7d5b-4a0c-bcab-f4d51090d433', 'volume_size': 1, 'image_id': 'c925631b-0a0d-43f9-a734-7bc5ee89f638', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c925631b-0a0d-43f9-a734-7bc5ee89f638', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1374960316', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0282ac6e7ec749acb3081e72a69258f6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c925631b-0a0d-43f9-a734-7bc5ee89f638', 'created_at': datetime.datetime(2026, 8, 10, 11, 4, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 11, 4, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c925631b-0a0d-43f9-a734-7bc5ee89f638/file', 'properties': {}}, 'image_service': } Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Trying to clone 89e11c34-7d5b-4a0c-bcab-f4d51090d433 from image c925631b-0a0d-43f9-a734-7bc5ee89f638 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c925631b-0a0d-43f9-a734-7bc5ee89f638', 'metadata': {}}]). {{(pid=89096) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 10 13:04:37 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Aug 10 13:04:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-faa0d6b7-f1e9-4f53-8285-3bd2ab121874 tempest-TestInstancesWithCinderVolumes-773385314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f30f0534-c23c-4068-b89a-d93731e0aa96 1073741824" returned: 0 in 0.443s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:04:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-faa0d6b7-f1e9-4f53-8285-3bd2ab121874 tempest-TestInstancesWithCinderVolumes-773385314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f30f0534-c23c-4068-b89a-d93731e0aa96 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:04:38 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f30f0534-c23c-4068-b89a-d93731e0aa96 Aug 10 13:04:38 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:04:38 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Aug 10 13:04:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-faa0d6b7-f1e9-4f53-8285-3bd2ab121874 tempest-TestInstancesWithCinderVolumes-773385314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f30f0534-c23c-4068-b89a-d93731e0aa96" returned: 0 in 0.254s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:04:38 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-faa0d6b7-f1e9-4f53-8285-3bd2ab121874 tempest-TestInstancesWithCinderVolumes-773385314 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:04:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-faa0d6b7-f1e9-4f53-8285-3bd2ab121874 tempest-TestInstancesWithCinderVolumes-773385314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:04:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-faa0d6b7-f1e9-4f53-8285-3bd2ab121874 tempest-TestInstancesWithCinderVolumes-773385314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba21d24f-5d6a-430d-909a-40a2fce380a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f30f0534-c23c-4068-b89a-d93731e0aa96', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:04:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-faa0d6b7-f1e9-4f53-8285-3bd2ab121874 tempest-TestInstancesWithCinderVolumes-773385314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7821b8e9-22df-4c80-a8d8-aad77e1b555d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:04:38 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-faa0d6b7-f1e9-4f53-8285-3bd2ab121874 tempest-TestInstancesWithCinderVolumes-773385314 None] Volume volume-f30f0534-c23c-4068-b89a-d93731e0aa96 (f30f0534-c23c-4068-b89a-d93731e0aa96): created successfully Aug 10 13:04:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-faa0d6b7-f1e9-4f53-8285-3bd2ab121874 tempest-TestInstancesWithCinderVolumes-773385314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7821b8e9-22df-4c80-a8d8-aad77e1b555d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:04:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-faa0d6b7-f1e9-4f53-8285-3bd2ab121874 tempest-TestInstancesWithCinderVolumes-773385314 None] Flow 'volume_create_manager' (7bbd17b1-6ace-4ec7-ab28-46b1258d6333) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:04:38 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-faa0d6b7-f1e9-4f53-8285-3bd2ab121874 tempest-TestInstancesWithCinderVolumes-773385314 None] Created volume successfully. Aug 10 13:04:40 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c925631b-0a0d-43f9-a734-7bc5ee89f638_w29t62avdevstack@QuobyteHD, size 20.69 MB, duration 2.89 sec {{(pid=89096) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 10 13:04:40 devstack cinder-volume[89096]: INFO cinder.image.image_utils [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Image download 20.69 MB at 7.15 MB/s Aug 10 13:04:40 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[79420e5a-283a-4e07-a5f3-32df7326ff9e]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:04:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c925631b-0a0d-43f9-a734-7bc5ee89f638_w29t62avdevstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:04:40 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c925631b-0a0d-43f9-a734-7bc5ee89f638_w29t62avdevstack@QuobyteHD Aug 10 13:04:40 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:04:41 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Aug 10 13:04:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c925631b-0a0d-43f9-a734-7bc5ee89f638_w29t62avdevstack@QuobyteHD" returned: 0 in 0.323s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:04:41 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Temporary image c925631b-0a0d-43f9-a734-7bc5ee89f638 is fetched for user e561a66127d4439aada58d15baffbb75. {{(pid=89096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 10 13:04:41 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[2465a650-8a80-434e-ad45-dd4f617efd71]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:04:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c925631b-0a0d-43f9-a734-7bc5ee89f638_w29t62avdevstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:04:41 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c925631b-0a0d-43f9-a734-7bc5ee89f638_w29t62avdevstack@QuobyteHD Aug 10 13:04:41 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:04:41 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Aug 10 13:04:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c925631b-0a0d-43f9-a734-7bc5ee89f638_w29t62avdevstack@QuobyteHD" returned: 0 in 0.327s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:04:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:04:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:04:41 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-679352958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89e11c34-7d5b-4a0c-bcab-f4d51090d433,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0282ac6e7ec749acb3081e72a69258f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:04:38Z,use_quota=True,user_id='e561a66127d4439aada58d15baffbb75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df5d28f5-99b1-4dc8-82c5-2db83bf5b963),volume_type_id=df5d28f5-99b1-4dc8-82c5-2db83bf5b963)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:04:41 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Creating volume 89e11c34-7d5b-4a0c-bcab-f4d51090d433 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:04:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:04:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:04:41 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:04:41 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:04:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:04:41 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:04:41 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:04:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-89e11c34-7d5b-4a0c-bcab-f4d51090d433 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:04:41 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-89e11c34-7d5b-4a0c-bcab-f4d51090d433 1073741824 Aug 10 13:04:41 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:04:41 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Aug 10 13:04:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-89e11c34-7d5b-4a0c-bcab-f4d51090d433 1073741824" returned: 0 in 0.399s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:04:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-89e11c34-7d5b-4a0c-bcab-f4d51090d433 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:04:42 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-89e11c34-7d5b-4a0c-bcab-f4d51090d433 Aug 10 13:04:42 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:04:42 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Aug 10 13:04:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-89e11c34-7d5b-4a0c-bcab-f4d51090d433" returned: 0 in 0.242s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:04:42 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:04:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:04:42 devstack cinder-volume[89096]: DEBUG cinder.volume.volume_utils [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Attempting download of c925631b-0a0d-43f9-a734-7bc5ee89f638 ((None, [{'url': 'file:///opt/stack/data/glance/images/c925631b-0a0d-43f9-a734-7bc5ee89f638', 'metadata': {}}])) to volume 89e11c34-7d5b-4a0c-bcab-f4d51090d433. {{(pid=89096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 10 13:04:42 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e99e548-ad6f-44d1-b552-608acefeb60b]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:04:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c925631b-0a0d-43f9-a734-7bc5ee89f638_0sadbtz1 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:04:42 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c925631b-0a0d-43f9-a734-7bc5ee89f638_0sadbtz1 Aug 10 13:04:42 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:04:42 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Aug 10 13:04:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c925631b-0a0d-43f9-a734-7bc5ee89f638_0sadbtz1" returned: 0 in 0.321s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:04:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c925631b-0a0d-43f9-a734-7bc5ee89f638_0sadbtz1 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:04:42 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c925631b-0a0d-43f9-a734-7bc5ee89f638_0sadbtz1 Aug 10 13:04:42 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:04:42 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Aug 10 13:04:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c925631b-0a0d-43f9-a734-7bc5ee89f638_0sadbtz1" returned: 1 in 0.311s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:04:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c925631b-0a0d-43f9-a734-7bc5ee89f638_0sadbtz1' failed. Not Retrying. {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 13:04:42 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[81067700-6e88-4474-9b2c-fb7eafe57905]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:04:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c925631b-0a0d-43f9-a734-7bc5ee89f638_w29t62avdevstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:04:43 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c925631b-0a0d-43f9-a734-7bc5ee89f638_w29t62avdevstack@QuobyteHD Aug 10 13:04:43 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:04:43 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Aug 10 13:04:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c925631b-0a0d-43f9-a734-7bc5ee89f638_w29t62avdevstack@QuobyteHD" returned: 0 in 0.312s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:04:43 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] c925631b-0a0d-43f9-a734-7bc5ee89f638 was qcow2, converting to qcow2 {{(pid=89096) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 10 13:04:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c925631b-0a0d-43f9-a734-7bc5ee89f638_w29t62avdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-89e11c34-7d5b-4a0c-bcab-f4d51090d433 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:04:43 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c925631b-0a0d-43f9-a734-7bc5ee89f638_w29t62avdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-89e11c34-7d5b-4a0c-bcab-f4d51090d433 Aug 10 13:04:43 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:04:44 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Aug 10 13:04:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c925631b-0a0d-43f9-a734-7bc5ee89f638_w29t62avdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-89e11c34-7d5b-4a0c-bcab-f4d51090d433" returned: 0 in 1.508s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:04:44 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c925631b-0a0d-43f9-a734-7bc5ee89f638_w29t62avdevstack@QuobyteHD, size 112.00 MB, duration 1.51 sec, destination /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-89e11c34-7d5b-4a0c-bcab-f4d51090d433 {{(pid=89096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 13:04:44 devstack cinder-volume[89096]: INFO cinder.image.image_utils [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Converted 112.00 MB image at 74.21 MB/s Aug 10 13:04:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-89e11c34-7d5b-4a0c-bcab-f4d51090d433 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:04:44 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-89e11c34-7d5b-4a0c-bcab-f4d51090d433 1G Aug 10 13:04:44 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:04:45 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Aug 10 13:04:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-89e11c34-7d5b-4a0c-bcab-f4d51090d433 1G" returned: 0 in 0.309s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:04:45 devstack cinder-volume[89096]: DEBUG cinder.volume.volume_utils [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Downloaded image c925631b-0a0d-43f9-a734-7bc5ee89f638 ((None, [{'url': 'file:///opt/stack/data/glance/images/c925631b-0a0d-43f9-a734-7bc5ee89f638', 'metadata': {}}])) to volume 89e11c34-7d5b-4a0c-bcab-f4d51090d433 successfully. {{(pid=89096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 10 13:04:45 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Temporary image c925631b-0a0d-43f9-a734-7bc5ee89f638 for user e561a66127d4439aada58d15baffbb75 is deleted. {{(pid=89096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 10 13:04:45 devstack cinder-volume[89096]: DEBUG cinder.volume.volume_utils [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Marking volume 89e11c34-7d5b-4a0c-bcab-f4d51090d433 as bootable. {{(pid=89096) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 10 13:04:45 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Copying metadata from image c925631b-0a0d-43f9-a734-7bc5ee89f638 to 89e11c34-7d5b-4a0c-bcab-f4d51090d433. {{(pid=89096) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 10 13:04:45 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Creating volume glance metadata for volume 89e11c34-7d5b-4a0c-bcab-f4d51090d433 backed by image c925631b-0a0d-43f9-a734-7bc5ee89f638 with: {'image_id': 'c925631b-0a0d-43f9-a734-7bc5ee89f638', 'image_name': 'tempest-scenario-img--1374960316', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89096) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 10 13:04:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcd96e36-60b7-47d3-bd1b-0682bbe56910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89e11c34-7d5b-4a0c-bcab-f4d51090d433', 'volume_size': 1, 'image_id': 'c925631b-0a0d-43f9-a734-7bc5ee89f638', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c925631b-0a0d-43f9-a734-7bc5ee89f638', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1374960316', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0282ac6e7ec749acb3081e72a69258f6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c925631b-0a0d-43f9-a734-7bc5ee89f638', 'created_at': datetime.datetime(2026, 8, 10, 11, 4, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 11, 4, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c925631b-0a0d-43f9-a734-7bc5ee89f638/file', 'properties': {}}, 'image_service': }' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:04:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aac3535d-e27d-4058-a732-fa9b1c0b0851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:04:45 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Volume volume-89e11c34-7d5b-4a0c-bcab-f4d51090d433 (89e11c34-7d5b-4a0c-bcab-f4d51090d433): created successfully Aug 10 13:04:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aac3535d-e27d-4058-a732-fa9b1c0b0851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:04:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Flow 'volume_create_manager' (4ce490f5-3989-44e7-bab2-fc33ea19c556) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:04:45 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-7c34920a-468f-45dc-a452-1216ea5dccf1 tempest-TestInstancesWithCinderVolumes-773385314 None] Created volume successfully. Aug 10 13:04:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-6d6e95a0-52ad-4412-b750-80a2b3afd0cc req-6e77b402-aa93-48dc-953f-7aa134d628a8 tempest-TestInstancesWithCinderVolumes-773385314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:04:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-6d6e95a0-52ad-4412-b750-80a2b3afd0cc req-6e77b402-aa93-48dc-953f-7aa134d628a8 tempest-TestInstancesWithCinderVolumes-773385314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:04:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-6d6e95a0-52ad-4412-b750-80a2b3afd0cc req-6e77b402-aa93-48dc-953f-7aa134d628a8 tempest-TestInstancesWithCinderVolumes-773385314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:04:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-6d6e95a0-52ad-4412-b750-80a2b3afd0cc req-6e77b402-aa93-48dc-953f-7aa134d628a8 tempest-TestInstancesWithCinderVolumes-773385314 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d', 'name': 'volume-89e11c34-7d5b-4a0c-bcab-f4d51090d433', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd0d8a185-7a07-4193-8183-7a13d7260af8', 'enforce_multipath': True} {{(pid=89096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Aug 10 13:04:48 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-6d6e95a0-52ad-4412-b750-80a2b3afd0cc req-6e77b402-aa93-48dc-953f-7aa134d628a8 tempest-TestInstancesWithCinderVolumes-773385314 None] attachment_update completed successfully. Aug 10 13:04:58 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=20,cinder:UPDATE=11,cinder:INSERT=7,cinder:DELETE=2 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 13:04:58 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:UPDATE=13,cinder:SELECT=16,cinder:DELETE=1,cinder:INSERT=5 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 13:05:03 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 13:05:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:05:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:05:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:05:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:05:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:05:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:05:03 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:05:03 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:05:04 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Aug 10 13:05:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.256s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:05:04 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:05:04 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager._thread_info {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 13:05:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread count: 28 {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 13:05:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread info: [<_MainThread(MainThread, started 130607683133568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Aug 10 13:05:18 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=1 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 13:05:18 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:UPDATE=1 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 13:05:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-da2d9a93-908f-44b5-8198-7e083376d197 req-4a6ebe96-2b7e-4a2b-acfd-a60a24d4654a tempest-TestInstancesWithCinderVolumes-773385314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:05:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-da2d9a93-908f-44b5-8198-7e083376d197 req-4a6ebe96-2b7e-4a2b-acfd-a60a24d4654a tempest-TestInstancesWithCinderVolumes-773385314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:05:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-da2d9a93-908f-44b5-8198-7e083376d197 req-4a6ebe96-2b7e-4a2b-acfd-a60a24d4654a tempest-TestInstancesWithCinderVolumes-773385314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:05:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-da2d9a93-908f-44b5-8198-7e083376d197 req-4a6ebe96-2b7e-4a2b-acfd-a60a24d4654a tempest-TestInstancesWithCinderVolumes-773385314 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d', 'name': 'volume-3dadb721-3d63-4f63-939b-5d3946bc91df', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5a8fd9bb-0a3a-4534-bcfc-026696c7d6a4', 'enforce_multipath': True} {{(pid=89096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Aug 10 13:05:20 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-da2d9a93-908f-44b5-8198-7e083376d197 req-4a6ebe96-2b7e-4a2b-acfd-a60a24d4654a tempest-TestInstancesWithCinderVolumes-773385314 None] attachment_update completed successfully. Aug 10 13:05:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-8898ff85-49bd-4af5-878f-fc2f16c99644 req-5a6d5931-bde7-467a-986d-1fa383fc9d2f tempest-TestInstancesWithCinderVolumes-773385314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:05:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-8898ff85-49bd-4af5-878f-fc2f16c99644 req-5a6d5931-bde7-467a-986d-1fa383fc9d2f tempest-TestInstancesWithCinderVolumes-773385314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:05:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-8898ff85-49bd-4af5-878f-fc2f16c99644 req-5a6d5931-bde7-467a-986d-1fa383fc9d2f tempest-TestInstancesWithCinderVolumes-773385314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:05:22 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-8898ff85-49bd-4af5-878f-fc2f16c99644 req-5a6d5931-bde7-467a-986d-1fa383fc9d2f tempest-TestInstancesWithCinderVolumes-773385314 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d', 'name': 'volume-f30f0534-c23c-4068-b89a-d93731e0aa96', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b15e591e-e5a4-4157-9683-a04331cb22b3', 'enforce_multipath': True} {{(pid=89096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Aug 10 13:05:22 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-8898ff85-49bd-4af5-878f-fc2f16c99644 req-5a6d5931-bde7-467a-986d-1fa383fc9d2f tempest-TestInstancesWithCinderVolumes-773385314 None] attachment_update completed successfully. Aug 10 13:05:27 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-7c611f5f-def1-4226-b485-bbc459141583 req-fa532dfa-2071-4016-b531-3de0d952a750 tempest-TestInstancesWithCinderVolumes-773385314 None] Terminate volume connection completed successfully. Aug 10 13:05:27 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-7c611f5f-def1-4226-b485-bbc459141583 req-fa532dfa-2071-4016-b531-3de0d952a750 tempest-TestInstancesWithCinderVolumes-773385314 None] Deleting attachment 5a8fd9bb-0a3a-4534-bcfc-026696c7d6a4. {{(pid=89096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Aug 10 13:05:27 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0e7f63ad-2a78-41e7-8c39-39fc5ea7526c tempest-TestInstancesWithCinderVolumes-773385314 None] Acquiring lock "cinder-3dadb721-3d63-4f63-939b-5d3946bc91df-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:05:27 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0e7f63ad-2a78-41e7-8c39-39fc5ea7526c tempest-TestInstancesWithCinderVolumes-773385314 None] Lock "cinder-3dadb721-3d63-4f63-939b-5d3946bc91df-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:05:27 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0e7f63ad-2a78-41e7-8c39-39fc5ea7526c tempest-TestInstancesWithCinderVolumes-773385314 None] Acquiring lock "cinder-quobyte-3dadb721-3d63-4f63-939b-5d3946bc91df" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:05:27 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0e7f63ad-2a78-41e7-8c39-39fc5ea7526c tempest-TestInstancesWithCinderVolumes-773385314 None] Lock "cinder-quobyte-3dadb721-3d63-4f63-939b-5d3946bc91df" acquired by "delete_volume" :: waited 0.015s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:05:27 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7e0f14-d2b0-4e35-8303-2c000c05e82f]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:05:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0e7f63ad-2a78-41e7-8c39-39fc5ea7526c tempest-TestInstancesWithCinderVolumes-773385314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3dadb721-3d63-4f63-939b-5d3946bc91df {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:05:28 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3dadb721-3d63-4f63-939b-5d3946bc91df Aug 10 13:05:28 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:05:28 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Aug 10 13:05:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0e7f63ad-2a78-41e7-8c39-39fc5ea7526c tempest-TestInstancesWithCinderVolumes-773385314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3dadb721-3d63-4f63-939b-5d3946bc91df" returned: 0 in 0.369s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:05:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0e7f63ad-2a78-41e7-8c39-39fc5ea7526c tempest-TestInstancesWithCinderVolumes-773385314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3dadb721-3d63-4f63-939b-5d3946bc91df {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:05:28 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3dadb721-3d63-4f63-939b-5d3946bc91df Aug 10 13:05:28 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:05:28 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Aug 10 13:05:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0e7f63ad-2a78-41e7-8c39-39fc5ea7526c tempest-TestInstancesWithCinderVolumes-773385314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3dadb721-3d63-4f63-939b-5d3946bc91df" returned: 0 in 0.294s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:05:28 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0e7f63ad-2a78-41e7-8c39-39fc5ea7526c tempest-TestInstancesWithCinderVolumes-773385314 None] Lock "cinder-quobyte-3dadb721-3d63-4f63-939b-5d3946bc91df" released by "delete_volume" :: held 0.700s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:05:28 devstack cinder-volume[89096]: WARNING cinder.quota [None req-0e7f63ad-2a78-41e7-8c39-39fc5ea7526c tempest-TestInstancesWithCinderVolumes-773385314 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-98412316-1233051861 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-98412316-1233051861, it is now deprecated. Please use the default quota class for default quota. Aug 10 13:05:28 devstack cinder-volume[89096]: WARNING cinder.quota [None req-0e7f63ad-2a78-41e7-8c39-39fc5ea7526c tempest-TestInstancesWithCinderVolumes-773385314 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-98412316-1233051861 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-98412316-1233051861, it is now deprecated. Please use the default quota class for default quota. Aug 10 13:05:28 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-0e7f63ad-2a78-41e7-8c39-39fc5ea7526c tempest-TestInstancesWithCinderVolumes-773385314 None] Created reservations ['7c5317e3-531e-4f39-b4ca-39970c093216', 'c409f298-5cc4-4e1a-b0bc-1b2887e98ce9', '143abc98-6e51-4c83-b4fa-e7bf6e32bf98', 'c2c5e6de-01fd-4214-b537-64fb8012c188'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:05:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0e7f63ad-2a78-41e7-8c39-39fc5ea7526c tempest-TestInstancesWithCinderVolumes-773385314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:05:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0e7f63ad-2a78-41e7-8c39-39fc5ea7526c tempest-TestInstancesWithCinderVolumes-773385314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:05:28 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0e7f63ad-2a78-41e7-8c39-39fc5ea7526c tempest-TestInstancesWithCinderVolumes-773385314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:05:28 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0e7f63ad-2a78-41e7-8c39-39fc5ea7526c tempest-TestInstancesWithCinderVolumes-773385314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:05:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0e7f63ad-2a78-41e7-8c39-39fc5ea7526c tempest-TestInstancesWithCinderVolumes-773385314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:05:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0e7f63ad-2a78-41e7-8c39-39fc5ea7526c tempest-TestInstancesWithCinderVolumes-773385314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:05:28 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:05:28 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:05:29 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Aug 10 13:05:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0e7f63ad-2a78-41e7-8c39-39fc5ea7526c tempest-TestInstancesWithCinderVolumes-773385314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.271s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:05:29 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-0e7f63ad-2a78-41e7-8c39-39fc5ea7526c tempest-TestInstancesWithCinderVolumes-773385314 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:05:29 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-0e7f63ad-2a78-41e7-8c39-39fc5ea7526c tempest-TestInstancesWithCinderVolumes-773385314 None] Deleted volume successfully. Aug 10 13:05:29 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0e7f63ad-2a78-41e7-8c39-39fc5ea7526c tempest-TestInstancesWithCinderVolumes-773385314 None] Lock "cinder-3dadb721-3d63-4f63-939b-5d3946bc91df-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:05:31 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-a4ffe3c1-26b8-4493-9013-c92c2e4df690 req-150440cc-aadb-4bcd-8e6b-774ee1ca5c65 tempest-TestInstancesWithCinderVolumes-773385314 None] Terminate volume connection completed successfully. Aug 10 13:05:31 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-a4ffe3c1-26b8-4493-9013-c92c2e4df690 req-150440cc-aadb-4bcd-8e6b-774ee1ca5c65 tempest-TestInstancesWithCinderVolumes-773385314 None] Deleting attachment b15e591e-e5a4-4157-9683-a04331cb22b3. {{(pid=89096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Aug 10 13:05:32 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-af419a75-643b-4e7f-9a6e-2dc495db3173 tempest-TestInstancesWithCinderVolumes-773385314 None] Acquiring lock "cinder-f30f0534-c23c-4068-b89a-d93731e0aa96-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:05:32 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-af419a75-643b-4e7f-9a6e-2dc495db3173 tempest-TestInstancesWithCinderVolumes-773385314 None] Lock "cinder-f30f0534-c23c-4068-b89a-d93731e0aa96-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:05:32 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-af419a75-643b-4e7f-9a6e-2dc495db3173 tempest-TestInstancesWithCinderVolumes-773385314 None] Acquiring lock "cinder-quobyte-f30f0534-c23c-4068-b89a-d93731e0aa96" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:05:32 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-af419a75-643b-4e7f-9a6e-2dc495db3173 tempest-TestInstancesWithCinderVolumes-773385314 None] Lock "cinder-quobyte-f30f0534-c23c-4068-b89a-d93731e0aa96" acquired by "delete_volume" :: waited 0.015s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:05:32 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[710db953-7949-48b8-80eb-42a5fd074ceb]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:05:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af419a75-643b-4e7f-9a6e-2dc495db3173 tempest-TestInstancesWithCinderVolumes-773385314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f30f0534-c23c-4068-b89a-d93731e0aa96 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:05:32 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f30f0534-c23c-4068-b89a-d93731e0aa96 Aug 10 13:05:32 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:05:32 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Aug 10 13:05:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af419a75-643b-4e7f-9a6e-2dc495db3173 tempest-TestInstancesWithCinderVolumes-773385314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f30f0534-c23c-4068-b89a-d93731e0aa96" returned: 0 in 0.385s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:05:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af419a75-643b-4e7f-9a6e-2dc495db3173 tempest-TestInstancesWithCinderVolumes-773385314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f30f0534-c23c-4068-b89a-d93731e0aa96 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:05:32 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f30f0534-c23c-4068-b89a-d93731e0aa96 Aug 10 13:05:32 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:05:32 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Aug 10 13:05:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af419a75-643b-4e7f-9a6e-2dc495db3173 tempest-TestInstancesWithCinderVolumes-773385314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f30f0534-c23c-4068-b89a-d93731e0aa96" returned: 0 in 0.269s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:05:32 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-af419a75-643b-4e7f-9a6e-2dc495db3173 tempest-TestInstancesWithCinderVolumes-773385314 None] Lock "cinder-quobyte-f30f0534-c23c-4068-b89a-d93731e0aa96" released by "delete_volume" :: held 0.695s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:05:32 devstack cinder-volume[89096]: WARNING cinder.quota [None req-af419a75-643b-4e7f-9a6e-2dc495db3173 tempest-TestInstancesWithCinderVolumes-773385314 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1928397003-1836065393 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1928397003-1836065393, it is now deprecated. Please use the default quota class for default quota. Aug 10 13:05:32 devstack cinder-volume[89096]: WARNING cinder.quota [None req-af419a75-643b-4e7f-9a6e-2dc495db3173 tempest-TestInstancesWithCinderVolumes-773385314 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1928397003-1836065393 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1928397003-1836065393, it is now deprecated. Please use the default quota class for default quota. Aug 10 13:05:32 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-af419a75-643b-4e7f-9a6e-2dc495db3173 tempest-TestInstancesWithCinderVolumes-773385314 None] Created reservations ['4ab81e23-90ba-4a0e-841b-dbfbd0dc2e42', 'cc239e23-34ab-48ad-8329-9a0fe7c1352d', 'ac35f70a-80fe-495f-80f0-267989ae3452', 'de18b0e5-b0ba-418a-94d1-8c5aa1a816da'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:05:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-af419a75-643b-4e7f-9a6e-2dc495db3173 tempest-TestInstancesWithCinderVolumes-773385314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:05:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-af419a75-643b-4e7f-9a6e-2dc495db3173 tempest-TestInstancesWithCinderVolumes-773385314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:05:33 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-af419a75-643b-4e7f-9a6e-2dc495db3173 tempest-TestInstancesWithCinderVolumes-773385314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:05:33 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-af419a75-643b-4e7f-9a6e-2dc495db3173 tempest-TestInstancesWithCinderVolumes-773385314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:05:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-af419a75-643b-4e7f-9a6e-2dc495db3173 tempest-TestInstancesWithCinderVolumes-773385314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:05:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af419a75-643b-4e7f-9a6e-2dc495db3173 tempest-TestInstancesWithCinderVolumes-773385314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:05:33 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:05:33 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:05:33 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Aug 10 13:05:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-af419a75-643b-4e7f-9a6e-2dc495db3173 tempest-TestInstancesWithCinderVolumes-773385314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.266s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:05:33 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-af419a75-643b-4e7f-9a6e-2dc495db3173 tempest-TestInstancesWithCinderVolumes-773385314 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:05:33 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-af419a75-643b-4e7f-9a6e-2dc495db3173 tempest-TestInstancesWithCinderVolumes-773385314 None] Deleted volume successfully. Aug 10 13:05:33 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-af419a75-643b-4e7f-9a6e-2dc495db3173 tempest-TestInstancesWithCinderVolumes-773385314 None] Lock "cinder-f30f0534-c23c-4068-b89a-d93731e0aa96-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:05:36 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-68cdc311-006b-4f92-bd10-1dfeb381b442 req-83632f72-1989-480c-9ab4-c0dc9e925b73 tempest-TestInstancesWithCinderVolumes-773385314 None] Terminate volume connection completed successfully. Aug 10 13:05:36 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-68cdc311-006b-4f92-bd10-1dfeb381b442 req-83632f72-1989-480c-9ab4-c0dc9e925b73 tempest-TestInstancesWithCinderVolumes-773385314 None] Deleting attachment d0d8a185-7a07-4193-8183-7a13d7260af8. {{(pid=89096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Aug 10 13:05:37 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d75f4767-58a1-48f6-b6c4-d5be69eed312 tempest-TestInstancesWithCinderVolumes-773385314 None] Acquiring lock "cinder-89e11c34-7d5b-4a0c-bcab-f4d51090d433-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:05:37 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d75f4767-58a1-48f6-b6c4-d5be69eed312 tempest-TestInstancesWithCinderVolumes-773385314 None] Lock "cinder-89e11c34-7d5b-4a0c-bcab-f4d51090d433-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:05:37 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d75f4767-58a1-48f6-b6c4-d5be69eed312 tempest-TestInstancesWithCinderVolumes-773385314 None] Acquiring lock "cinder-quobyte-89e11c34-7d5b-4a0c-bcab-f4d51090d433" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:05:37 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d75f4767-58a1-48f6-b6c4-d5be69eed312 tempest-TestInstancesWithCinderVolumes-773385314 None] Lock "cinder-quobyte-89e11c34-7d5b-4a0c-bcab-f4d51090d433" acquired by "delete_volume" :: waited 0.016s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:05:37 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8c352a-45b4-48e3-ab5d-3f00414b0740]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:05:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d75f4767-58a1-48f6-b6c4-d5be69eed312 tempest-TestInstancesWithCinderVolumes-773385314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-89e11c34-7d5b-4a0c-bcab-f4d51090d433 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:05:37 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-89e11c34-7d5b-4a0c-bcab-f4d51090d433 Aug 10 13:05:37 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:05:37 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Aug 10 13:05:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d75f4767-58a1-48f6-b6c4-d5be69eed312 tempest-TestInstancesWithCinderVolumes-773385314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-89e11c34-7d5b-4a0c-bcab-f4d51090d433" returned: 0 in 0.353s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:05:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d75f4767-58a1-48f6-b6c4-d5be69eed312 tempest-TestInstancesWithCinderVolumes-773385314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-89e11c34-7d5b-4a0c-bcab-f4d51090d433 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:05:37 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-89e11c34-7d5b-4a0c-bcab-f4d51090d433 Aug 10 13:05:37 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:05:37 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Aug 10 13:05:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d75f4767-58a1-48f6-b6c4-d5be69eed312 tempest-TestInstancesWithCinderVolumes-773385314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-89e11c34-7d5b-4a0c-bcab-f4d51090d433" returned: 0 in 0.241s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:05:37 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d75f4767-58a1-48f6-b6c4-d5be69eed312 tempest-TestInstancesWithCinderVolumes-773385314 None] Lock "cinder-quobyte-89e11c34-7d5b-4a0c-bcab-f4d51090d433" released by "delete_volume" :: held 0.629s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:05:37 devstack cinder-volume[89096]: WARNING cinder.quota [None req-d75f4767-58a1-48f6-b6c4-d5be69eed312 tempest-TestInstancesWithCinderVolumes-773385314 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-140095656-293468672 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-140095656-293468672, it is now deprecated. Please use the default quota class for default quota. Aug 10 13:05:37 devstack cinder-volume[89096]: WARNING cinder.quota [None req-d75f4767-58a1-48f6-b6c4-d5be69eed312 tempest-TestInstancesWithCinderVolumes-773385314 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-140095656-293468672 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-140095656-293468672, it is now deprecated. Please use the default quota class for default quota. Aug 10 13:05:37 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-d75f4767-58a1-48f6-b6c4-d5be69eed312 tempest-TestInstancesWithCinderVolumes-773385314 None] Created reservations ['57e45aad-47ee-4eb9-aee0-2b273cc28bcc', 'e0709096-bbf2-4fbf-9829-c2f5590e510f', '528833c0-50cf-4e0c-bea9-9adf55dd174e', 'e83188d9-cf6b-406d-9f5e-d2d2334aed63'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:05:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d75f4767-58a1-48f6-b6c4-d5be69eed312 tempest-TestInstancesWithCinderVolumes-773385314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:05:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d75f4767-58a1-48f6-b6c4-d5be69eed312 tempest-TestInstancesWithCinderVolumes-773385314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:05:37 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-d75f4767-58a1-48f6-b6c4-d5be69eed312 tempest-TestInstancesWithCinderVolumes-773385314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:05:37 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-d75f4767-58a1-48f6-b6c4-d5be69eed312 tempest-TestInstancesWithCinderVolumes-773385314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:05:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d75f4767-58a1-48f6-b6c4-d5be69eed312 tempest-TestInstancesWithCinderVolumes-773385314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:05:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d75f4767-58a1-48f6-b6c4-d5be69eed312 tempest-TestInstancesWithCinderVolumes-773385314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:05:37 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:05:37 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:05:38 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Aug 10 13:05:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d75f4767-58a1-48f6-b6c4-d5be69eed312 tempest-TestInstancesWithCinderVolumes-773385314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.236s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:05:38 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-d75f4767-58a1-48f6-b6c4-d5be69eed312 tempest-TestInstancesWithCinderVolumes-773385314 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:05:38 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-d75f4767-58a1-48f6-b6c4-d5be69eed312 tempest-TestInstancesWithCinderVolumes-773385314 None] Deleted volume successfully. Aug 10 13:05:38 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d75f4767-58a1-48f6-b6c4-d5be69eed312 tempest-TestInstancesWithCinderVolumes-773385314 None] Lock "cinder-89e11c34-7d5b-4a0c-bcab-f4d51090d433-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:05:47 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=30,cinder:UPDATE=29,cinder:INSERT=5,cinder:DELETE=1 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 13:05:48 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=32,cinder:UPDATE=25,cinder:INSERT=7,cinder:DELETE=2 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 13:06:03 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 13:06:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:06:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:06:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:06:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:06:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:06:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:06:03 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:06:03 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:06:04 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Aug 10 13:06:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.263s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:06:04 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:06:04 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager._thread_info {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 13:06:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread count: 28 {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 13:06:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread info: [<_MainThread(MainThread, started 130607683133568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Aug 10 13:06:38 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-852038ba-db2a-4bf9-a7e0-1ba938d7297b tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:06:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-852038ba-db2a-4bf9-a7e0-1ba938d7297b tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Flow 'volume_create_manager' (96850ccc-0e2a-4f4a-8176-91e75f268ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:06:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-852038ba-db2a-4bf9-a7e0-1ba938d7297b tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ef0f5ba-186c-43f0-91e6-120004fa7934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:06:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-852038ba-db2a-4bf9-a7e0-1ba938d7297b tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ef0f5ba-186c-43f0-91e6-120004fa7934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-202579302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50daee85-3fdc-4d7c-801c-b60679fe3b9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43b1a9ed98394df2add9245f22b9430b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:06:38Z,use_quota=True,user_id='2c488d47dee6434d94b740a2ae6989a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:06:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-852038ba-db2a-4bf9-a7e0-1ba938d7297b tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (527facb3-319c-475b-94ec-008c4cae5664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:06:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-852038ba-db2a-4bf9-a7e0-1ba938d7297b tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (527facb3-319c-475b-94ec-008c4cae5664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:06:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-852038ba-db2a-4bf9-a7e0-1ba938d7297b tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee758fe7-a447-41f4-991d-bac0d90a5b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:06:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-852038ba-db2a-4bf9-a7e0-1ba938d7297b tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee758fe7-a447-41f4-991d-bac0d90a5b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50daee85-3fdc-4d7c-801c-b60679fe3b9c', 'volume_name': 'volume-50daee85-3fdc-4d7c-801c-b60679fe3b9c', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:06:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-852038ba-db2a-4bf9-a7e0-1ba938d7297b tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8876f0f-ac7a-420d-9ae5-f9b6b9a025df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:06:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-852038ba-db2a-4bf9-a7e0-1ba938d7297b tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8876f0f-ac7a-420d-9ae5-f9b6b9a025df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:06:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-852038ba-db2a-4bf9-a7e0-1ba938d7297b tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f307b5-4962-42a0-aab1-f3f94b0b6a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:06:38 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-852038ba-db2a-4bf9-a7e0-1ba938d7297b tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Volume 50daee85-3fdc-4d7c-801c-b60679fe3b9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50daee85-3fdc-4d7c-801c-b60679fe3b9c', 'volume_size': 1} Aug 10 13:06:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-852038ba-db2a-4bf9-a7e0-1ba938d7297b tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:06:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-852038ba-db2a-4bf9-a7e0-1ba938d7297b tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:06:38 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-852038ba-db2a-4bf9-a7e0-1ba938d7297b tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-202579302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50daee85-3fdc-4d7c-801c-b60679fe3b9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43b1a9ed98394df2add9245f22b9430b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:06:38Z,use_quota=True,user_id='2c488d47dee6434d94b740a2ae6989a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:06:38 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-852038ba-db2a-4bf9-a7e0-1ba938d7297b tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Creating volume 50daee85-3fdc-4d7c-801c-b60679fe3b9c {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:06:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-852038ba-db2a-4bf9-a7e0-1ba938d7297b tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:06:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-852038ba-db2a-4bf9-a7e0-1ba938d7297b tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:06:38 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-852038ba-db2a-4bf9-a7e0-1ba938d7297b tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:06:38 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-852038ba-db2a-4bf9-a7e0-1ba938d7297b tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:06:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-852038ba-db2a-4bf9-a7e0-1ba938d7297b tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:06:38 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-852038ba-db2a-4bf9-a7e0-1ba938d7297b tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:06:38 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-852038ba-db2a-4bf9-a7e0-1ba938d7297b tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:06:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-852038ba-db2a-4bf9-a7e0-1ba938d7297b tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-50daee85-3fdc-4d7c-801c-b60679fe3b9c 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:06:38 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-50daee85-3fdc-4d7c-801c-b60679fe3b9c 1073741824 Aug 10 13:06:38 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:06:38 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Aug 10 13:06:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-852038ba-db2a-4bf9-a7e0-1ba938d7297b tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-50daee85-3fdc-4d7c-801c-b60679fe3b9c 1073741824" returned: 0 in 0.402s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:06:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-852038ba-db2a-4bf9-a7e0-1ba938d7297b tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-50daee85-3fdc-4d7c-801c-b60679fe3b9c {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:06:38 devstack sudo[107820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-50daee85-3fdc-4d7c-801c-b60679fe3b9c Aug 10 13:06:38 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:06:38 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root Aug 10 13:06:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-852038ba-db2a-4bf9-a7e0-1ba938d7297b tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-50daee85-3fdc-4d7c-801c-b60679fe3b9c" returned: 0 in 0.247s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:06:38 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-852038ba-db2a-4bf9-a7e0-1ba938d7297b tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:06:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-852038ba-db2a-4bf9-a7e0-1ba938d7297b tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:06:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-852038ba-db2a-4bf9-a7e0-1ba938d7297b tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f307b5-4962-42a0-aab1-f3f94b0b6a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50daee85-3fdc-4d7c-801c-b60679fe3b9c', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:06:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-852038ba-db2a-4bf9-a7e0-1ba938d7297b tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2bdb5c4-0e21-44a9-9a5c-98e08bc07583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:06:38 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-852038ba-db2a-4bf9-a7e0-1ba938d7297b tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Volume volume-50daee85-3fdc-4d7c-801c-b60679fe3b9c (50daee85-3fdc-4d7c-801c-b60679fe3b9c): created successfully Aug 10 13:06:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-852038ba-db2a-4bf9-a7e0-1ba938d7297b tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2bdb5c4-0e21-44a9-9a5c-98e08bc07583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:06:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-852038ba-db2a-4bf9-a7e0-1ba938d7297b tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Flow 'volume_create_manager' (96850ccc-0e2a-4f4a-8176-91e75f268ba3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:06:38 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-852038ba-db2a-4bf9-a7e0-1ba938d7297b tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Created volume successfully. Aug 10 13:06:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-03bb5c2d-35df-438e-910c-c7bb3df53cef req-415d66eb-d303-4aae-8ddb-05f079cd9980 tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:06:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-03bb5c2d-35df-438e-910c-c7bb3df53cef req-415d66eb-d303-4aae-8ddb-05f079cd9980 tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:06:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [req-03bb5c2d-35df-438e-910c-c7bb3df53cef req-415d66eb-d303-4aae-8ddb-05f079cd9980 tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:06:39 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-03bb5c2d-35df-438e-910c-c7bb3df53cef req-415d66eb-d303-4aae-8ddb-05f079cd9980 tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d', 'name': 'volume-50daee85-3fdc-4d7c-801c-b60679fe3b9c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd6cc6ac0-f4a9-4501-8ecb-cf1928b0d563', 'enforce_multipath': True} {{(pid=89096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Aug 10 13:06:39 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-03bb5c2d-35df-438e-910c-c7bb3df53cef req-415d66eb-d303-4aae-8ddb-05f079cd9980 tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] attachment_update completed successfully. Aug 10 13:06:42 devstack cinder-volume[89096]: INFO cinder.volume.manager [req-dfcb6f2a-ce01-4855-824e-a3e4ac4ee523 req-ccfd985c-a34b-43fc-842a-df2cdf4ce62d tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Terminate volume connection completed successfully. Aug 10 13:06:42 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [req-dfcb6f2a-ce01-4855-824e-a3e4ac4ee523 req-ccfd985c-a34b-43fc-842a-df2cdf4ce62d tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Deleting attachment d6cc6ac0-f4a9-4501-8ecb-cf1928b0d563. {{(pid=89096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Aug 10 13:06:43 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7af3360e-58b3-424a-b2a7-87e0d7e7abd3 tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Acquiring lock "cinder-50daee85-3fdc-4d7c-801c-b60679fe3b9c-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:06:43 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7af3360e-58b3-424a-b2a7-87e0d7e7abd3 tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Lock "cinder-50daee85-3fdc-4d7c-801c-b60679fe3b9c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:06:43 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7af3360e-58b3-424a-b2a7-87e0d7e7abd3 tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Acquiring lock "cinder-quobyte-50daee85-3fdc-4d7c-801c-b60679fe3b9c" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:06:43 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7af3360e-58b3-424a-b2a7-87e0d7e7abd3 tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Lock "cinder-quobyte-50daee85-3fdc-4d7c-801c-b60679fe3b9c" acquired by "delete_volume" :: waited 0.014s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:06:43 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[179dac70-e852-4433-bc74-f01c0f1bb52b]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:06:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7af3360e-58b3-424a-b2a7-87e0d7e7abd3 tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-50daee85-3fdc-4d7c-801c-b60679fe3b9c {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:06:43 devstack sudo[108250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-50daee85-3fdc-4d7c-801c-b60679fe3b9c Aug 10 13:06:43 devstack sudo[108250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:06:44 devstack sudo[108250]: pam_unix(sudo:session): session closed for user root Aug 10 13:06:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7af3360e-58b3-424a-b2a7-87e0d7e7abd3 tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-50daee85-3fdc-4d7c-801c-b60679fe3b9c" returned: 0 in 0.357s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:06:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7af3360e-58b3-424a-b2a7-87e0d7e7abd3 tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-50daee85-3fdc-4d7c-801c-b60679fe3b9c {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:06:44 devstack sudo[108255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-50daee85-3fdc-4d7c-801c-b60679fe3b9c Aug 10 13:06:44 devstack sudo[108255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:06:44 devstack sudo[108255]: pam_unix(sudo:session): session closed for user root Aug 10 13:06:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7af3360e-58b3-424a-b2a7-87e0d7e7abd3 tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-50daee85-3fdc-4d7c-801c-b60679fe3b9c" returned: 0 in 0.255s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:06:44 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7af3360e-58b3-424a-b2a7-87e0d7e7abd3 tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Lock "cinder-quobyte-50daee85-3fdc-4d7c-801c-b60679fe3b9c" released by "delete_volume" :: held 0.652s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:06:44 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-7af3360e-58b3-424a-b2a7-87e0d7e7abd3 tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Created reservations ['82354ecc-94ee-4a8d-b449-27bbfc63924f', 'de8e0f6e-19ef-4fab-b7a8-5c4ec008e160', 'bf0d42a2-753f-4d92-9b43-ee7f1b3922b2', '59cdc4d9-03de-4aa7-a053-8d356821eb4f'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:06:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7af3360e-58b3-424a-b2a7-87e0d7e7abd3 tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:06:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7af3360e-58b3-424a-b2a7-87e0d7e7abd3 tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:06:44 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-7af3360e-58b3-424a-b2a7-87e0d7e7abd3 tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:06:44 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-7af3360e-58b3-424a-b2a7-87e0d7e7abd3 tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:06:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7af3360e-58b3-424a-b2a7-87e0d7e7abd3 tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:06:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7af3360e-58b3-424a-b2a7-87e0d7e7abd3 tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:06:44 devstack sudo[108264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:06:44 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:06:44 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root Aug 10 13:06:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7af3360e-58b3-424a-b2a7-87e0d7e7abd3 tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.247s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:06:44 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-7af3360e-58b3-424a-b2a7-87e0d7e7abd3 tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:06:44 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-7af3360e-58b3-424a-b2a7-87e0d7e7abd3 tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Deleted volume successfully. Aug 10 13:06:44 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7af3360e-58b3-424a-b2a7-87e0d7e7abd3 tempest-TestServerVolumeAttachScenarioOldVersion-1080393408 None] Lock "cinder-50daee85-3fdc-4d7c-801c-b60679fe3b9c-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:06:54 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=14,cinder:INSERT=2,cinder:UPDATE=11 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 13:06:54 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:UPDATE=14,cinder:SELECT=15,cinder:DELETE=2,cinder:INSERT=3 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 13:06:58 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-3953beb1-9a5e-4919-bc8a-7a895d050dce tempest-CreateVolumesFromSnapshotTest-232942598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:06:58 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3953beb1-9a5e-4919-bc8a-7a895d050dce tempest-CreateVolumesFromSnapshotTest-232942598 None] Flow 'volume_create_manager' (71b724e4-5c2e-4295-9713-ce9d476cd136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:06:58 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3953beb1-9a5e-4919-bc8a-7a895d050dce tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51bf5fbe-f111-4666-9f05-0bdf2068b96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:06:58 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3953beb1-9a5e-4919-bc8a-7a895d050dce tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51bf5fbe-f111-4666-9f05-0bdf2068b96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-153760677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=785b6965-848f-442d-8a69-51818ef5a645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd2c3da474454769a76cd78a66246cc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:06:59Z,use_quota=True,user_id='df985cfc6c35422f9dd2f949c55eb277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:06:58 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3953beb1-9a5e-4919-bc8a-7a895d050dce tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5d9af88-f226-486a-af30-ad0be3e6e6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:06:58 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3953beb1-9a5e-4919-bc8a-7a895d050dce tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5d9af88-f226-486a-af30-ad0be3e6e6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:06:58 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3953beb1-9a5e-4919-bc8a-7a895d050dce tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df85c65-a76f-4161-85fe-7f394ae41e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:06:58 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3953beb1-9a5e-4919-bc8a-7a895d050dce tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df85c65-a76f-4161-85fe-7f394ae41e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '785b6965-848f-442d-8a69-51818ef5a645', 'volume_name': 'volume-785b6965-848f-442d-8a69-51818ef5a645', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:06:58 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3953beb1-9a5e-4919-bc8a-7a895d050dce tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e4fdb3-d1e7-418d-a5fa-b7152ba7d892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:06:58 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3953beb1-9a5e-4919-bc8a-7a895d050dce tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e4fdb3-d1e7-418d-a5fa-b7152ba7d892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:06:58 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3953beb1-9a5e-4919-bc8a-7a895d050dce tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013009a8-c6cd-4953-8b26-14472a1548be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:06:58 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-3953beb1-9a5e-4919-bc8a-7a895d050dce tempest-CreateVolumesFromSnapshotTest-232942598 None] Volume 785b6965-848f-442d-8a69-51818ef5a645: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-785b6965-848f-442d-8a69-51818ef5a645', 'volume_size': 1} Aug 10 13:06:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3953beb1-9a5e-4919-bc8a-7a895d050dce tempest-CreateVolumesFromSnapshotTest-232942598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:06:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3953beb1-9a5e-4919-bc8a-7a895d050dce tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:06:58 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3953beb1-9a5e-4919-bc8a-7a895d050dce tempest-CreateVolumesFromSnapshotTest-232942598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-153760677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=785b6965-848f-442d-8a69-51818ef5a645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd2c3da474454769a76cd78a66246cc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:06:59Z,use_quota=True,user_id='df985cfc6c35422f9dd2f949c55eb277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:06:58 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-3953beb1-9a5e-4919-bc8a-7a895d050dce tempest-CreateVolumesFromSnapshotTest-232942598 None] Creating volume 785b6965-848f-442d-8a69-51818ef5a645 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:06:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3953beb1-9a5e-4919-bc8a-7a895d050dce tempest-CreateVolumesFromSnapshotTest-232942598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:06:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3953beb1-9a5e-4919-bc8a-7a895d050dce tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:06:58 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3953beb1-9a5e-4919-bc8a-7a895d050dce tempest-CreateVolumesFromSnapshotTest-232942598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:06:58 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3953beb1-9a5e-4919-bc8a-7a895d050dce tempest-CreateVolumesFromSnapshotTest-232942598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:06:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3953beb1-9a5e-4919-bc8a-7a895d050dce tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:06:58 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3953beb1-9a5e-4919-bc8a-7a895d050dce tempest-CreateVolumesFromSnapshotTest-232942598 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:06:58 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-3953beb1-9a5e-4919-bc8a-7a895d050dce tempest-CreateVolumesFromSnapshotTest-232942598 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:06:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3953beb1-9a5e-4919-bc8a-7a895d050dce tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:06:58 devstack sudo[108300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645 1073741824 Aug 10 13:06:58 devstack sudo[108300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:06:59 devstack sudo[108300]: pam_unix(sudo:session): session closed for user root Aug 10 13:06:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3953beb1-9a5e-4919-bc8a-7a895d050dce tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645 1073741824" returned: 0 in 0.406s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:06:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3953beb1-9a5e-4919-bc8a-7a895d050dce tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:06:59 devstack sudo[108307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645 Aug 10 13:06:59 devstack sudo[108307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:06:59 devstack sudo[108307]: pam_unix(sudo:session): session closed for user root Aug 10 13:06:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3953beb1-9a5e-4919-bc8a-7a895d050dce tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645" returned: 0 in 0.237s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:06:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3953beb1-9a5e-4919-bc8a-7a895d050dce tempest-CreateVolumesFromSnapshotTest-232942598 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:06:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3953beb1-9a5e-4919-bc8a-7a895d050dce tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:06:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3953beb1-9a5e-4919-bc8a-7a895d050dce tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013009a8-c6cd-4953-8b26-14472a1548be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-785b6965-848f-442d-8a69-51818ef5a645', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:06:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3953beb1-9a5e-4919-bc8a-7a895d050dce tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63ba337e-d4fb-42f7-9341-796ed02b930a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:06:59 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-3953beb1-9a5e-4919-bc8a-7a895d050dce tempest-CreateVolumesFromSnapshotTest-232942598 None] Volume volume-785b6965-848f-442d-8a69-51818ef5a645 (785b6965-848f-442d-8a69-51818ef5a645): created successfully Aug 10 13:06:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3953beb1-9a5e-4919-bc8a-7a895d050dce tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63ba337e-d4fb-42f7-9341-796ed02b930a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:06:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3953beb1-9a5e-4919-bc8a-7a895d050dce tempest-CreateVolumesFromSnapshotTest-232942598 None] Flow 'volume_create_manager' (71b724e4-5c2e-4295-9713-ce9d476cd136) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:06:59 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-3953beb1-9a5e-4919-bc8a-7a895d050dce tempest-CreateVolumesFromSnapshotTest-232942598 None] Created volume successfully. Aug 10 13:06:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-57a8a6c1-3073-4399-9005-33e083813a3b tempest-CreateVolumesFromSnapshotTest-232942598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:06:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-57a8a6c1-3073-4399-9005-33e083813a3b tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:06:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-57a8a6c1-3073-4399-9005-33e083813a3b tempest-CreateVolumesFromSnapshotTest-232942598 None] Creating offline snapshot a73caed8-276a-407a-a8a5-54d2b1ce2e2b of volume 785b6965-848f-442d-8a69-51818ef5a645 {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 13:06:59 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a58ca9d-ceef-404f-b5f2-12c125140181]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:06:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-57a8a6c1-3073-4399-9005-33e083813a3b tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:00 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645 Aug 10 13:07:00 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:00 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-57a8a6c1-3073-4399-9005-33e083813a3b tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645" returned: 0 in 0.359s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-57a8a6c1-3073-4399-9005-33e083813a3b tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645.a73caed8-276a-407a-a8a5-54d2b1ce2e2b 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:00 devstack sudo[108315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645.a73caed8-276a-407a-a8a5-54d2b1ce2e2b 1G Aug 10 13:07:00 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:00 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-57a8a6c1-3073-4399-9005-33e083813a3b tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645.a73caed8-276a-407a-a8a5-54d2b1ce2e2b 1G" returned: 0 in 0.374s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-57a8a6c1-3073-4399-9005-33e083813a3b tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-785b6965-848f-442d-8a69-51818ef5a645 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645.a73caed8-276a-407a-a8a5-54d2b1ce2e2b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:00 devstack sudo[108321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-785b6965-848f-442d-8a69-51818ef5a645 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645.a73caed8-276a-407a-a8a5-54d2b1ce2e2b Aug 10 13:07:00 devstack sudo[108321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:00 devstack sudo[108321]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-57a8a6c1-3073-4399-9005-33e083813a3b tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-785b6965-848f-442d-8a69-51818ef5a645 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645.a73caed8-276a-407a-a8a5-54d2b1ce2e2b" returned: 0 in 0.279s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:00 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-57a8a6c1-3073-4399-9005-33e083813a3b tempest-CreateVolumesFromSnapshotTest-232942598 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645.a73caed8-276a-407a-a8a5-54d2b1ce2e2b is being set with open permissions: ugo+rw Aug 10 13:07:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-57a8a6c1-3073-4399-9005-33e083813a3b tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645.a73caed8-276a-407a-a8a5-54d2b1ce2e2b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:00 devstack sudo[108326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645.a73caed8-276a-407a-a8a5-54d2b1ce2e2b Aug 10 13:07:00 devstack sudo[108326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:01 devstack sudo[108326]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-57a8a6c1-3073-4399-9005-33e083813a3b tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645.a73caed8-276a-407a-a8a5-54d2b1ce2e2b" returned: 0 in 0.256s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-57a8a6c1-3073-4399-9005-33e083813a3b tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:01 devstack sudo[108331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645.info Aug 10 13:07:01 devstack sudo[108331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:01 devstack sudo[108331]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-57a8a6c1-3073-4399-9005-33e083813a3b tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645.info" returned: 0 in 0.240s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:01 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-57a8a6c1-3073-4399-9005-33e083813a3b tempest-CreateVolumesFromSnapshotTest-232942598 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645.info is being set with open permissions: ugo+rw Aug 10 13:07:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-57a8a6c1-3073-4399-9005-33e083813a3b tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:01 devstack sudo[108334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645.info Aug 10 13:07:01 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:01 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-57a8a6c1-3073-4399-9005-33e083813a3b tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645.info" returned: 0 in 0.242s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-57a8a6c1-3073-4399-9005-33e083813a3b tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.858s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:01 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-57a8a6c1-3073-4399-9005-33e083813a3b tempest-CreateVolumesFromSnapshotTest-232942598 None] Create snapshot completed successfully Aug 10 13:07:02 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e6600b8-e36c-4048-9fee-2480514f6f76 tempest-CreateVolumesFromSnapshotTest-232942598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:07:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4e6600b8-e36c-4048-9fee-2480514f6f76 tempest-CreateVolumesFromSnapshotTest-232942598 None] Flow 'volume_create_manager' (78bff09d-40f8-48d8-9e33-364b6612177e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4e6600b8-e36c-4048-9fee-2480514f6f76 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82ab1c37-be0d-4436-ac24-8d69dbd26ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4e6600b8-e36c-4048-9fee-2480514f6f76 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82ab1c37-be0d-4436-ac24-8d69dbd26ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1798493928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce10da16-5ff8-414b-8f46-b481d585a9b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd2c3da474454769a76cd78a66246cc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:02Z,use_quota=True,user_id='df985cfc6c35422f9dd2f949c55eb277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4e6600b8-e36c-4048-9fee-2480514f6f76 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b50b89-a7ad-4ad0-8bf8-725635dcb579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4e6600b8-e36c-4048-9fee-2480514f6f76 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b50b89-a7ad-4ad0-8bf8-725635dcb579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4e6600b8-e36c-4048-9fee-2480514f6f76 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9c6946c-ede6-4177-b3bb-65df849cca2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4e6600b8-e36c-4048-9fee-2480514f6f76 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9c6946c-ede6-4177-b3bb-65df849cca2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce10da16-5ff8-414b-8f46-b481d585a9b3', 'volume_name': 'volume-ce10da16-5ff8-414b-8f46-b481d585a9b3', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4e6600b8-e36c-4048-9fee-2480514f6f76 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cba5b5a-870c-408c-9185-204b06d73fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4e6600b8-e36c-4048-9fee-2480514f6f76 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cba5b5a-870c-408c-9185-204b06d73fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4e6600b8-e36c-4048-9fee-2480514f6f76 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46bc9119-e388-4bd1-988f-4be9fc38a90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:02 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-4e6600b8-e36c-4048-9fee-2480514f6f76 tempest-CreateVolumesFromSnapshotTest-232942598 None] Volume ce10da16-5ff8-414b-8f46-b481d585a9b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce10da16-5ff8-414b-8f46-b481d585a9b3', 'volume_size': 1} Aug 10 13:07:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4e6600b8-e36c-4048-9fee-2480514f6f76 tempest-CreateVolumesFromSnapshotTest-232942598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4e6600b8-e36c-4048-9fee-2480514f6f76 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4e6600b8-e36c-4048-9fee-2480514f6f76 tempest-CreateVolumesFromSnapshotTest-232942598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1798493928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce10da16-5ff8-414b-8f46-b481d585a9b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd2c3da474454769a76cd78a66246cc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:02Z,use_quota=True,user_id='df985cfc6c35422f9dd2f949c55eb277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:07:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-4e6600b8-e36c-4048-9fee-2480514f6f76 tempest-CreateVolumesFromSnapshotTest-232942598 None] Creating volume ce10da16-5ff8-414b-8f46-b481d585a9b3 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:07:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4e6600b8-e36c-4048-9fee-2480514f6f76 tempest-CreateVolumesFromSnapshotTest-232942598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4e6600b8-e36c-4048-9fee-2480514f6f76 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4e6600b8-e36c-4048-9fee-2480514f6f76 tempest-CreateVolumesFromSnapshotTest-232942598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:07:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4e6600b8-e36c-4048-9fee-2480514f6f76 tempest-CreateVolumesFromSnapshotTest-232942598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:07:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4e6600b8-e36c-4048-9fee-2480514f6f76 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4e6600b8-e36c-4048-9fee-2480514f6f76 tempest-CreateVolumesFromSnapshotTest-232942598 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:07:02 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-4e6600b8-e36c-4048-9fee-2480514f6f76 tempest-CreateVolumesFromSnapshotTest-232942598 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:07:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4e6600b8-e36c-4048-9fee-2480514f6f76 tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ce10da16-5ff8-414b-8f46-b481d585a9b3 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:02 devstack sudo[108337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ce10da16-5ff8-414b-8f46-b481d585a9b3 1073741824 Aug 10 13:07:02 devstack sudo[108337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:02 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec224391-abd9-4da3-b0f7-9060d2f1ba86 tempest-CreateVolumesFromSnapshotTest-232942598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:07:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ec224391-abd9-4da3-b0f7-9060d2f1ba86 tempest-CreateVolumesFromSnapshotTest-232942598 None] Flow 'volume_create_manager' (600c5310-09d7-48ad-8a7f-d6e984dfa595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ec224391-abd9-4da3-b0f7-9060d2f1ba86 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcca79f0-638b-4460-86a9-6ac7c5446917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ec224391-abd9-4da3-b0f7-9060d2f1ba86 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcca79f0-638b-4460-86a9-6ac7c5446917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-445457280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eea178e-f81d-417b-9eca-082853988566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd2c3da474454769a76cd78a66246cc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:03Z,use_quota=True,user_id='df985cfc6c35422f9dd2f949c55eb277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ec224391-abd9-4da3-b0f7-9060d2f1ba86 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3426e61-b176-496a-9e22-5968538c7047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ec224391-abd9-4da3-b0f7-9060d2f1ba86 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3426e61-b176-496a-9e22-5968538c7047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ec224391-abd9-4da3-b0f7-9060d2f1ba86 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b99f8086-1ae7-457f-9d2c-e33132646283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ec224391-abd9-4da3-b0f7-9060d2f1ba86 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b99f8086-1ae7-457f-9d2c-e33132646283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3eea178e-f81d-417b-9eca-082853988566', 'volume_name': 'volume-3eea178e-f81d-417b-9eca-082853988566', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ec224391-abd9-4da3-b0f7-9060d2f1ba86 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d15f16e2-338c-48a5-a15e-2f20983fcc23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ec224391-abd9-4da3-b0f7-9060d2f1ba86 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d15f16e2-338c-48a5-a15e-2f20983fcc23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ec224391-abd9-4da3-b0f7-9060d2f1ba86 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd7d3ea-2cbd-48f1-bd68-7ea6db7eb038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:02 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-ec224391-abd9-4da3-b0f7-9060d2f1ba86 tempest-CreateVolumesFromSnapshotTest-232942598 None] Volume 3eea178e-f81d-417b-9eca-082853988566: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3eea178e-f81d-417b-9eca-082853988566', 'volume_size': 1} Aug 10 13:07:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ec224391-abd9-4da3-b0f7-9060d2f1ba86 tempest-CreateVolumesFromSnapshotTest-232942598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:03 devstack sudo[108337]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4e6600b8-e36c-4048-9fee-2480514f6f76 tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ce10da16-5ff8-414b-8f46-b481d585a9b3 1073741824" returned: 0 in 0.480s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4e6600b8-e36c-4048-9fee-2480514f6f76 tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ce10da16-5ff8-414b-8f46-b481d585a9b3 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:03 devstack sudo[108344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ce10da16-5ff8-414b-8f46-b481d585a9b3 Aug 10 13:07:03 devstack sudo[108344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-3087317c-adc0-40e2-b730-273c5f3f0dd4 tempest-CreateVolumesFromSnapshotTest-232942598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3087317c-adc0-40e2-b730-273c5f3f0dd4 tempest-CreateVolumesFromSnapshotTest-232942598 None] Flow 'volume_create_manager' (d4ab9c64-44c6-4dbc-967b-25f4de0a2b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3087317c-adc0-40e2-b730-273c5f3f0dd4 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96ff1879-efee-41ce-bde1-79901284e5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3087317c-adc0-40e2-b730-273c5f3f0dd4 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96ff1879-efee-41ce-bde1-79901284e5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-98511732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=332eb5f5-ece8-4b46-962f-849bb7ee8ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd2c3da474454769a76cd78a66246cc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:03Z,use_quota=True,user_id='df985cfc6c35422f9dd2f949c55eb277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3087317c-adc0-40e2-b730-273c5f3f0dd4 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdfa4167-d1b6-4256-8440-6b48f586aa4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3087317c-adc0-40e2-b730-273c5f3f0dd4 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdfa4167-d1b6-4256-8440-6b48f586aa4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3087317c-adc0-40e2-b730-273c5f3f0dd4 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b1e9601-76ef-4e74-ab86-d9c50a50d961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3087317c-adc0-40e2-b730-273c5f3f0dd4 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b1e9601-76ef-4e74-ab86-d9c50a50d961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '332eb5f5-ece8-4b46-962f-849bb7ee8ef4', 'volume_name': 'volume-332eb5f5-ece8-4b46-962f-849bb7ee8ef4', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3087317c-adc0-40e2-b730-273c5f3f0dd4 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d8f42f-9984-496e-aeb7-5df19cae4553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3087317c-adc0-40e2-b730-273c5f3f0dd4 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d8f42f-9984-496e-aeb7-5df19cae4553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3087317c-adc0-40e2-b730-273c5f3f0dd4 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8354e4f-1d52-4dd2-a969-cf909dd016b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:03 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-3087317c-adc0-40e2-b730-273c5f3f0dd4 tempest-CreateVolumesFromSnapshotTest-232942598 None] Volume 332eb5f5-ece8-4b46-962f-849bb7ee8ef4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-332eb5f5-ece8-4b46-962f-849bb7ee8ef4', 'volume_size': 1} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3087317c-adc0-40e2-b730-273c5f3f0dd4 tempest-CreateVolumesFromSnapshotTest-232942598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:03 devstack sudo[108344]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4e6600b8-e36c-4048-9fee-2480514f6f76 tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ce10da16-5ff8-414b-8f46-b481d585a9b3" returned: 0 in 0.268s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4e6600b8-e36c-4048-9fee-2480514f6f76 tempest-CreateVolumesFromSnapshotTest-232942598 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4e6600b8-e36c-4048-9fee-2480514f6f76 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ec224391-abd9-4da3-b0f7-9060d2f1ba86 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.419s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ec224391-abd9-4da3-b0f7-9060d2f1ba86 tempest-CreateVolumesFromSnapshotTest-232942598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-445457280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eea178e-f81d-417b-9eca-082853988566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd2c3da474454769a76cd78a66246cc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:03Z,use_quota=True,user_id='df985cfc6c35422f9dd2f949c55eb277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-ec224391-abd9-4da3-b0f7-9060d2f1ba86 tempest-CreateVolumesFromSnapshotTest-232942598 None] Creating volume 3eea178e-f81d-417b-9eca-082853988566 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ec224391-abd9-4da3-b0f7-9060d2f1ba86 tempest-CreateVolumesFromSnapshotTest-232942598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ec224391-abd9-4da3-b0f7-9060d2f1ba86 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ec224391-abd9-4da3-b0f7-9060d2f1ba86 tempest-CreateVolumesFromSnapshotTest-232942598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ec224391-abd9-4da3-b0f7-9060d2f1ba86 tempest-CreateVolumesFromSnapshotTest-232942598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ec224391-abd9-4da3-b0f7-9060d2f1ba86 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ec224391-abd9-4da3-b0f7-9060d2f1ba86 tempest-CreateVolumesFromSnapshotTest-232942598 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:07:03 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-ec224391-abd9-4da3-b0f7-9060d2f1ba86 tempest-CreateVolumesFromSnapshotTest-232942598 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ec224391-abd9-4da3-b0f7-9060d2f1ba86 tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3eea178e-f81d-417b-9eca-082853988566 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4e6600b8-e36c-4048-9fee-2480514f6f76 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46bc9119-e388-4bd1-988f-4be9fc38a90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce10da16-5ff8-414b-8f46-b481d585a9b3', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:03 devstack sudo[108347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3eea178e-f81d-417b-9eca-082853988566 1073741824 Aug 10 13:07:03 devstack sudo[108347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4e6600b8-e36c-4048-9fee-2480514f6f76 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7d5196f-ecb4-49ab-9a8d-c60489030c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:03 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-4e6600b8-e36c-4048-9fee-2480514f6f76 tempest-CreateVolumesFromSnapshotTest-232942598 None] Volume volume-ce10da16-5ff8-414b-8f46-b481d585a9b3 (ce10da16-5ff8-414b-8f46-b481d585a9b3): created successfully Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4e6600b8-e36c-4048-9fee-2480514f6f76 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7d5196f-ecb4-49ab-9a8d-c60489030c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4e6600b8-e36c-4048-9fee-2480514f6f76 tempest-CreateVolumesFromSnapshotTest-232942598 None] Flow 'volume_create_manager' (78bff09d-40f8-48d8-9e33-364b6612177e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:03 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-4e6600b8-e36c-4048-9fee-2480514f6f76 tempest-CreateVolumesFromSnapshotTest-232942598 None] Created volume successfully. Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b39c249-0d2f-4d09-ad57-2def7f869c77 tempest-CreateVolumesFromSnapshotTest-232942598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4b39c249-0d2f-4d09-ad57-2def7f869c77 tempest-CreateVolumesFromSnapshotTest-232942598 None] Flow 'volume_create_manager' (003bd2e9-6e27-47ad-a113-a4e523d3bde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4b39c249-0d2f-4d09-ad57-2def7f869c77 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10734512-009a-4386-b7b3-654dc1fb69ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4b39c249-0d2f-4d09-ad57-2def7f869c77 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10734512-009a-4386-b7b3-654dc1fb69ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1151521280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=403bffd0-1c52-4d52-b2e0-c1b57798460c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd2c3da474454769a76cd78a66246cc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:04Z,use_quota=True,user_id='df985cfc6c35422f9dd2f949c55eb277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4b39c249-0d2f-4d09-ad57-2def7f869c77 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c69e2d5-928c-4824-aa5a-3f0d4a630979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4b39c249-0d2f-4d09-ad57-2def7f869c77 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c69e2d5-928c-4824-aa5a-3f0d4a630979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4b39c249-0d2f-4d09-ad57-2def7f869c77 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1ba15d-874a-428d-a4fa-a5ba196010c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4b39c249-0d2f-4d09-ad57-2def7f869c77 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1ba15d-874a-428d-a4fa-a5ba196010c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '403bffd0-1c52-4d52-b2e0-c1b57798460c', 'volume_name': 'volume-403bffd0-1c52-4d52-b2e0-c1b57798460c', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4b39c249-0d2f-4d09-ad57-2def7f869c77 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f2353a-3ce2-45b5-92a3-12fb076173e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4b39c249-0d2f-4d09-ad57-2def7f869c77 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f2353a-3ce2-45b5-92a3-12fb076173e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4b39c249-0d2f-4d09-ad57-2def7f869c77 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00db424a-8685-4e8d-b5bb-e129182b3c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:03 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-4b39c249-0d2f-4d09-ad57-2def7f869c77 tempest-CreateVolumesFromSnapshotTest-232942598 None] Volume 403bffd0-1c52-4d52-b2e0-c1b57798460c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-403bffd0-1c52-4d52-b2e0-c1b57798460c', 'volume_size': 1} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4b39c249-0d2f-4d09-ad57-2def7f869c77 tempest-CreateVolumesFromSnapshotTest-232942598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:03 devstack sudo[108347]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ec224391-abd9-4da3-b0f7-9060d2f1ba86 tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3eea178e-f81d-417b-9eca-082853988566 1073741824" returned: 0 in 0.462s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ec224391-abd9-4da3-b0f7-9060d2f1ba86 tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3eea178e-f81d-417b-9eca-082853988566 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:03 devstack sudo[108353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3eea178e-f81d-417b-9eca-082853988566 Aug 10 13:07:03 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:03 devstack sudo[108355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:07:03 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-247b0aae-a636-404b-861e-a6358273cdc3 tempest-CreateVolumesFromSnapshotTest-232942598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-247b0aae-a636-404b-861e-a6358273cdc3 tempest-CreateVolumesFromSnapshotTest-232942598 None] Flow 'volume_create_manager' (8d59dce2-69d6-4761-8dcd-c455fb19df78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-247b0aae-a636-404b-861e-a6358273cdc3 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6227dd5-cb31-45b5-9bd8-c3db5eae52d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-247b0aae-a636-404b-861e-a6358273cdc3 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6227dd5-cb31-45b5-9bd8-c3db5eae52d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-706313514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50e6b1d6-fd9e-45b8-af3a-4ae3226300fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd2c3da474454769a76cd78a66246cc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:04Z,use_quota=True,user_id='df985cfc6c35422f9dd2f949c55eb277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-247b0aae-a636-404b-861e-a6358273cdc3 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99d7ad34-b3c0-4a00-b6c8-13a804f5f4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-247b0aae-a636-404b-861e-a6358273cdc3 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99d7ad34-b3c0-4a00-b6c8-13a804f5f4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-247b0aae-a636-404b-861e-a6358273cdc3 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38c2227c-5cbb-4cd7-a4c3-359bedf669e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-247b0aae-a636-404b-861e-a6358273cdc3 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38c2227c-5cbb-4cd7-a4c3-359bedf669e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50e6b1d6-fd9e-45b8-af3a-4ae3226300fe', 'volume_name': 'volume-50e6b1d6-fd9e-45b8-af3a-4ae3226300fe', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-247b0aae-a636-404b-861e-a6358273cdc3 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f758a5-107d-4a78-93fc-aa1e53f963ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-247b0aae-a636-404b-861e-a6358273cdc3 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f758a5-107d-4a78-93fc-aa1e53f963ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-247b0aae-a636-404b-861e-a6358273cdc3 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dd9cc49-9e88-426f-adf8-63611296e7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:04 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-247b0aae-a636-404b-861e-a6358273cdc3 tempest-CreateVolumesFromSnapshotTest-232942598 None] Volume 50e6b1d6-fd9e-45b8-af3a-4ae3226300fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50e6b1d6-fd9e-45b8-af3a-4ae3226300fe', 'volume_size': 1} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-247b0aae-a636-404b-861e-a6358273cdc3 tempest-CreateVolumesFromSnapshotTest-232942598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:04 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ec224391-abd9-4da3-b0f7-9060d2f1ba86 tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3eea178e-f81d-417b-9eca-082853988566" returned: 0 in 0.258s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ec224391-abd9-4da3-b0f7-9060d2f1ba86 tempest-CreateVolumesFromSnapshotTest-232942598 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ec224391-abd9-4da3-b0f7-9060d2f1ba86 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3087317c-adc0-40e2-b730-273c5f3f0dd4 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.802s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3087317c-adc0-40e2-b730-273c5f3f0dd4 tempest-CreateVolumesFromSnapshotTest-232942598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-98511732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=332eb5f5-ece8-4b46-962f-849bb7ee8ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd2c3da474454769a76cd78a66246cc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:03Z,use_quota=True,user_id='df985cfc6c35422f9dd2f949c55eb277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-3087317c-adc0-40e2-b730-273c5f3f0dd4 tempest-CreateVolumesFromSnapshotTest-232942598 None] Creating volume 332eb5f5-ece8-4b46-962f-849bb7ee8ef4 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3087317c-adc0-40e2-b730-273c5f3f0dd4 tempest-CreateVolumesFromSnapshotTest-232942598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3087317c-adc0-40e2-b730-273c5f3f0dd4 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3087317c-adc0-40e2-b730-273c5f3f0dd4 tempest-CreateVolumesFromSnapshotTest-232942598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3087317c-adc0-40e2-b730-273c5f3f0dd4 tempest-CreateVolumesFromSnapshotTest-232942598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3087317c-adc0-40e2-b730-273c5f3f0dd4 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3087317c-adc0-40e2-b730-273c5f3f0dd4 tempest-CreateVolumesFromSnapshotTest-232942598 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:07:04 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-3087317c-adc0-40e2-b730-273c5f3f0dd4 tempest-CreateVolumesFromSnapshotTest-232942598 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3087317c-adc0-40e2-b730-273c5f3f0dd4 tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-332eb5f5-ece8-4b46-962f-849bb7ee8ef4 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ec224391-abd9-4da3-b0f7-9060d2f1ba86 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd7d3ea-2cbd-48f1-bd68-7ea6db7eb038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eea178e-f81d-417b-9eca-082853988566', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ec224391-abd9-4da3-b0f7-9060d2f1ba86 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f104708a-2aa1-4535-99ef-d284ec4afa7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:04 devstack sudo[108358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-332eb5f5-ece8-4b46-962f-849bb7ee8ef4 1073741824 Aug 10 13:07:04 devstack sudo[108358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:04 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-ec224391-abd9-4da3-b0f7-9060d2f1ba86 tempest-CreateVolumesFromSnapshotTest-232942598 None] Volume volume-3eea178e-f81d-417b-9eca-082853988566 (3eea178e-f81d-417b-9eca-082853988566): created successfully Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ec224391-abd9-4da3-b0f7-9060d2f1ba86 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f104708a-2aa1-4535-99ef-d284ec4afa7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ec224391-abd9-4da3-b0f7-9060d2f1ba86 tempest-CreateVolumesFromSnapshotTest-232942598 None] Flow 'volume_create_manager' (600c5310-09d7-48ad-8a7f-d6e984dfa595) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:04 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-ec224391-abd9-4da3-b0f7-9060d2f1ba86 tempest-CreateVolumesFromSnapshotTest-232942598 None] Created volume successfully. Aug 10 13:07:04 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.263s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager._thread_info {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread count: 28 {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread info: [<_MainThread(MainThread, started 130607683133568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Aug 10 13:07:04 devstack sudo[108358]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3087317c-adc0-40e2-b730-273c5f3f0dd4 tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-332eb5f5-ece8-4b46-962f-849bb7ee8ef4 1073741824" returned: 0 in 0.415s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3087317c-adc0-40e2-b730-273c5f3f0dd4 tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-332eb5f5-ece8-4b46-962f-849bb7ee8ef4 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:04 devstack sudo[108365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-332eb5f5-ece8-4b46-962f-849bb7ee8ef4 Aug 10 13:07:04 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:04 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3087317c-adc0-40e2-b730-273c5f3f0dd4 tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-332eb5f5-ece8-4b46-962f-849bb7ee8ef4" returned: 0 in 0.243s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3087317c-adc0-40e2-b730-273c5f3f0dd4 tempest-CreateVolumesFromSnapshotTest-232942598 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3087317c-adc0-40e2-b730-273c5f3f0dd4 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4b39c249-0d2f-4d09-ad57-2def7f869c77 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.112s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4b39c249-0d2f-4d09-ad57-2def7f869c77 tempest-CreateVolumesFromSnapshotTest-232942598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1151521280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=403bffd0-1c52-4d52-b2e0-c1b57798460c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd2c3da474454769a76cd78a66246cc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:04Z,use_quota=True,user_id='df985cfc6c35422f9dd2f949c55eb277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-4b39c249-0d2f-4d09-ad57-2def7f869c77 tempest-CreateVolumesFromSnapshotTest-232942598 None] Creating volume 403bffd0-1c52-4d52-b2e0-c1b57798460c {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4b39c249-0d2f-4d09-ad57-2def7f869c77 tempest-CreateVolumesFromSnapshotTest-232942598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4b39c249-0d2f-4d09-ad57-2def7f869c77 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4b39c249-0d2f-4d09-ad57-2def7f869c77 tempest-CreateVolumesFromSnapshotTest-232942598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4b39c249-0d2f-4d09-ad57-2def7f869c77 tempest-CreateVolumesFromSnapshotTest-232942598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4b39c249-0d2f-4d09-ad57-2def7f869c77 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4b39c249-0d2f-4d09-ad57-2def7f869c77 tempest-CreateVolumesFromSnapshotTest-232942598 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:07:04 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-4b39c249-0d2f-4d09-ad57-2def7f869c77 tempest-CreateVolumesFromSnapshotTest-232942598 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4b39c249-0d2f-4d09-ad57-2def7f869c77 tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-403bffd0-1c52-4d52-b2e0-c1b57798460c 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3087317c-adc0-40e2-b730-273c5f3f0dd4 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8354e4f-1d52-4dd2-a969-cf909dd016b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-332eb5f5-ece8-4b46-962f-849bb7ee8ef4', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:04 devstack sudo[108368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-403bffd0-1c52-4d52-b2e0-c1b57798460c 1073741824 Aug 10 13:07:04 devstack sudo[108368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3087317c-adc0-40e2-b730-273c5f3f0dd4 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ed9e7d0-83e0-423c-a945-4d9aed5c29dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:04 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-3087317c-adc0-40e2-b730-273c5f3f0dd4 tempest-CreateVolumesFromSnapshotTest-232942598 None] Volume volume-332eb5f5-ece8-4b46-962f-849bb7ee8ef4 (332eb5f5-ece8-4b46-962f-849bb7ee8ef4): created successfully Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3087317c-adc0-40e2-b730-273c5f3f0dd4 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ed9e7d0-83e0-423c-a945-4d9aed5c29dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3087317c-adc0-40e2-b730-273c5f3f0dd4 tempest-CreateVolumesFromSnapshotTest-232942598 None] Flow 'volume_create_manager' (d4ab9c64-44c6-4dbc-967b-25f4de0a2b22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:04 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-3087317c-adc0-40e2-b730-273c5f3f0dd4 tempest-CreateVolumesFromSnapshotTest-232942598 None] Created volume successfully. Aug 10 13:07:05 devstack sudo[108368]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4b39c249-0d2f-4d09-ad57-2def7f869c77 tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-403bffd0-1c52-4d52-b2e0-c1b57798460c 1073741824" returned: 0 in 0.400s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4b39c249-0d2f-4d09-ad57-2def7f869c77 tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-403bffd0-1c52-4d52-b2e0-c1b57798460c {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:05 devstack sudo[108374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-403bffd0-1c52-4d52-b2e0-c1b57798460c Aug 10 13:07:05 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:05 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4b39c249-0d2f-4d09-ad57-2def7f869c77 tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-403bffd0-1c52-4d52-b2e0-c1b57798460c" returned: 0 in 0.233s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4b39c249-0d2f-4d09-ad57-2def7f869c77 tempest-CreateVolumesFromSnapshotTest-232942598 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:07:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4b39c249-0d2f-4d09-ad57-2def7f869c77 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-247b0aae-a636-404b-861e-a6358273cdc3 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.436s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-247b0aae-a636-404b-861e-a6358273cdc3 tempest-CreateVolumesFromSnapshotTest-232942598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-706313514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50e6b1d6-fd9e-45b8-af3a-4ae3226300fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd2c3da474454769a76cd78a66246cc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:04Z,use_quota=True,user_id='df985cfc6c35422f9dd2f949c55eb277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:07:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-247b0aae-a636-404b-861e-a6358273cdc3 tempest-CreateVolumesFromSnapshotTest-232942598 None] Creating volume 50e6b1d6-fd9e-45b8-af3a-4ae3226300fe {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:07:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-247b0aae-a636-404b-861e-a6358273cdc3 tempest-CreateVolumesFromSnapshotTest-232942598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-247b0aae-a636-404b-861e-a6358273cdc3 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-247b0aae-a636-404b-861e-a6358273cdc3 tempest-CreateVolumesFromSnapshotTest-232942598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:07:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-247b0aae-a636-404b-861e-a6358273cdc3 tempest-CreateVolumesFromSnapshotTest-232942598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:07:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-247b0aae-a636-404b-861e-a6358273cdc3 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-247b0aae-a636-404b-861e-a6358273cdc3 tempest-CreateVolumesFromSnapshotTest-232942598 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:07:05 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-247b0aae-a636-404b-861e-a6358273cdc3 tempest-CreateVolumesFromSnapshotTest-232942598 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:07:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-247b0aae-a636-404b-861e-a6358273cdc3 tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-50e6b1d6-fd9e-45b8-af3a-4ae3226300fe 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:05 devstack sudo[108377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-50e6b1d6-fd9e-45b8-af3a-4ae3226300fe 1073741824 Aug 10 13:07:05 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4b39c249-0d2f-4d09-ad57-2def7f869c77 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00db424a-8685-4e8d-b5bb-e129182b3c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-403bffd0-1c52-4d52-b2e0-c1b57798460c', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4b39c249-0d2f-4d09-ad57-2def7f869c77 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f02e12bb-cdb5-4827-a799-d02f04411081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:05 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-4b39c249-0d2f-4d09-ad57-2def7f869c77 tempest-CreateVolumesFromSnapshotTest-232942598 None] Volume volume-403bffd0-1c52-4d52-b2e0-c1b57798460c (403bffd0-1c52-4d52-b2e0-c1b57798460c): created successfully Aug 10 13:07:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4b39c249-0d2f-4d09-ad57-2def7f869c77 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f02e12bb-cdb5-4827-a799-d02f04411081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4b39c249-0d2f-4d09-ad57-2def7f869c77 tempest-CreateVolumesFromSnapshotTest-232942598 None] Flow 'volume_create_manager' (003bd2e9-6e27-47ad-a113-a4e523d3bde5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:05 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-4b39c249-0d2f-4d09-ad57-2def7f869c77 tempest-CreateVolumesFromSnapshotTest-232942598 None] Created volume successfully. Aug 10 13:07:05 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-247b0aae-a636-404b-861e-a6358273cdc3 tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-50e6b1d6-fd9e-45b8-af3a-4ae3226300fe 1073741824" returned: 0 in 0.419s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-247b0aae-a636-404b-861e-a6358273cdc3 tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-50e6b1d6-fd9e-45b8-af3a-4ae3226300fe {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:05 devstack sudo[108382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-50e6b1d6-fd9e-45b8-af3a-4ae3226300fe Aug 10 13:07:05 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:06 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-247b0aae-a636-404b-861e-a6358273cdc3 tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-50e6b1d6-fd9e-45b8-af3a-4ae3226300fe" returned: 0 in 0.251s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:06 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-247b0aae-a636-404b-861e-a6358273cdc3 tempest-CreateVolumesFromSnapshotTest-232942598 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:07:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-247b0aae-a636-404b-861e-a6358273cdc3 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-247b0aae-a636-404b-861e-a6358273cdc3 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dd9cc49-9e88-426f-adf8-63611296e7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50e6b1d6-fd9e-45b8-af3a-4ae3226300fe', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-247b0aae-a636-404b-861e-a6358273cdc3 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91296dc-cfaa-4438-8555-e73b8a8429ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:06 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-247b0aae-a636-404b-861e-a6358273cdc3 tempest-CreateVolumesFromSnapshotTest-232942598 None] Volume volume-50e6b1d6-fd9e-45b8-af3a-4ae3226300fe (50e6b1d6-fd9e-45b8-af3a-4ae3226300fe): created successfully Aug 10 13:07:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-247b0aae-a636-404b-861e-a6358273cdc3 tempest-CreateVolumesFromSnapshotTest-232942598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91296dc-cfaa-4438-8555-e73b8a8429ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-247b0aae-a636-404b-861e-a6358273cdc3 tempest-CreateVolumesFromSnapshotTest-232942598 None] Flow 'volume_create_manager' (8d59dce2-69d6-4761-8dcd-c455fb19df78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:06 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-247b0aae-a636-404b-861e-a6358273cdc3 tempest-CreateVolumesFromSnapshotTest-232942598 None] Created volume successfully. Aug 10 13:07:07 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d8d47f59-4e0c-440a-82c6-129b96e431ef tempest-CreateVolumesFromSnapshotTest-232942598 None] Acquiring lock "cinder-50e6b1d6-fd9e-45b8-af3a-4ae3226300fe-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:07:07 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d8d47f59-4e0c-440a-82c6-129b96e431ef tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "cinder-50e6b1d6-fd9e-45b8-af3a-4ae3226300fe-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:07:07 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d8d47f59-4e0c-440a-82c6-129b96e431ef tempest-CreateVolumesFromSnapshotTest-232942598 None] Acquiring lock "cinder-quobyte-50e6b1d6-fd9e-45b8-af3a-4ae3226300fe" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:07:07 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d8d47f59-4e0c-440a-82c6-129b96e431ef tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "cinder-quobyte-50e6b1d6-fd9e-45b8-af3a-4ae3226300fe" acquired by "delete_volume" :: waited 0.016s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:07:07 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[0982a0d4-4be1-4120-851f-b9a62ab4a66f]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:07:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d8d47f59-4e0c-440a-82c6-129b96e431ef tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-50e6b1d6-fd9e-45b8-af3a-4ae3226300fe {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:07 devstack sudo[108385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-50e6b1d6-fd9e-45b8-af3a-4ae3226300fe Aug 10 13:07:07 devstack sudo[108385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:07 devstack sudo[108385]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d8d47f59-4e0c-440a-82c6-129b96e431ef tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-50e6b1d6-fd9e-45b8-af3a-4ae3226300fe" returned: 0 in 0.341s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d8d47f59-4e0c-440a-82c6-129b96e431ef tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-50e6b1d6-fd9e-45b8-af3a-4ae3226300fe {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:07 devstack sudo[108390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-50e6b1d6-fd9e-45b8-af3a-4ae3226300fe Aug 10 13:07:07 devstack sudo[108390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:07 devstack sudo[108390]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d8d47f59-4e0c-440a-82c6-129b96e431ef tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-50e6b1d6-fd9e-45b8-af3a-4ae3226300fe" returned: 0 in 0.238s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:08 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d8d47f59-4e0c-440a-82c6-129b96e431ef tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "cinder-quobyte-50e6b1d6-fd9e-45b8-af3a-4ae3226300fe" released by "delete_volume" :: held 0.617s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:07:08 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-d8d47f59-4e0c-440a-82c6-129b96e431ef tempest-CreateVolumesFromSnapshotTest-232942598 None] Created reservations ['6c21675e-de32-4084-87a4-117b73100fda', 'f3acfdc4-99f8-43d6-8e5e-0d87d26d23c9', 'a8aa6811-c019-4d5a-b63c-0d80c92d40f2', '428453b3-da41-431f-b062-8565824fd503'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:07:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d8d47f59-4e0c-440a-82c6-129b96e431ef tempest-CreateVolumesFromSnapshotTest-232942598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d8d47f59-4e0c-440a-82c6-129b96e431ef tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-d8d47f59-4e0c-440a-82c6-129b96e431ef tempest-CreateVolumesFromSnapshotTest-232942598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:07:08 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-d8d47f59-4e0c-440a-82c6-129b96e431ef tempest-CreateVolumesFromSnapshotTest-232942598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:07:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d8d47f59-4e0c-440a-82c6-129b96e431ef tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d8d47f59-4e0c-440a-82c6-129b96e431ef tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:08 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:07:08 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:08 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d8d47f59-4e0c-440a-82c6-129b96e431ef tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.238s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:08 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-d8d47f59-4e0c-440a-82c6-129b96e431ef tempest-CreateVolumesFromSnapshotTest-232942598 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:07:08 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-d8d47f59-4e0c-440a-82c6-129b96e431ef tempest-CreateVolumesFromSnapshotTest-232942598 None] Deleted volume successfully. Aug 10 13:07:08 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d8d47f59-4e0c-440a-82c6-129b96e431ef tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "cinder-50e6b1d6-fd9e-45b8-af3a-4ae3226300fe-delete_volume" released by "delete_volume" :: held 1.049s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:07:08 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8cb81a5b-3dbe-4204-82b5-fa3d08b22ac6 tempest-CreateVolumesFromSnapshotTest-232942598 None] Acquiring lock "cinder-403bffd0-1c52-4d52-b2e0-c1b57798460c-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:07:08 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8cb81a5b-3dbe-4204-82b5-fa3d08b22ac6 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "cinder-403bffd0-1c52-4d52-b2e0-c1b57798460c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:07:08 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8cb81a5b-3dbe-4204-82b5-fa3d08b22ac6 tempest-CreateVolumesFromSnapshotTest-232942598 None] Acquiring lock "cinder-quobyte-403bffd0-1c52-4d52-b2e0-c1b57798460c" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:07:08 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8cb81a5b-3dbe-4204-82b5-fa3d08b22ac6 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "cinder-quobyte-403bffd0-1c52-4d52-b2e0-c1b57798460c" acquired by "delete_volume" :: waited 0.015s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:07:08 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[8410ced3-fc4b-4e26-8907-6ed0f45cf82b]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:07:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8cb81a5b-3dbe-4204-82b5-fa3d08b22ac6 tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-403bffd0-1c52-4d52-b2e0-c1b57798460c {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:08 devstack sudo[108396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-403bffd0-1c52-4d52-b2e0-c1b57798460c Aug 10 13:07:08 devstack sudo[108396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:08 devstack sudo[108396]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8cb81a5b-3dbe-4204-82b5-fa3d08b22ac6 tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-403bffd0-1c52-4d52-b2e0-c1b57798460c" returned: 0 in 0.356s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8cb81a5b-3dbe-4204-82b5-fa3d08b22ac6 tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-403bffd0-1c52-4d52-b2e0-c1b57798460c {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:08 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-403bffd0-1c52-4d52-b2e0-c1b57798460c Aug 10 13:07:08 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:09 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8cb81a5b-3dbe-4204-82b5-fa3d08b22ac6 tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-403bffd0-1c52-4d52-b2e0-c1b57798460c" returned: 0 in 0.237s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:09 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8cb81a5b-3dbe-4204-82b5-fa3d08b22ac6 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "cinder-quobyte-403bffd0-1c52-4d52-b2e0-c1b57798460c" released by "delete_volume" :: held 0.629s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:07:09 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-8cb81a5b-3dbe-4204-82b5-fa3d08b22ac6 tempest-CreateVolumesFromSnapshotTest-232942598 None] Created reservations ['b4aea197-927c-467d-b726-8f2b611d6cdc', '1c8dc627-c91d-4f9a-8042-fe54051e58b9', 'b89522cb-722e-4d2a-8c88-328b121241cc', '74673e61-db5a-46f6-905d-86ba0f815ad7'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:07:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8cb81a5b-3dbe-4204-82b5-fa3d08b22ac6 tempest-CreateVolumesFromSnapshotTest-232942598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8cb81a5b-3dbe-4204-82b5-fa3d08b22ac6 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8cb81a5b-3dbe-4204-82b5-fa3d08b22ac6 tempest-CreateVolumesFromSnapshotTest-232942598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:07:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8cb81a5b-3dbe-4204-82b5-fa3d08b22ac6 tempest-CreateVolumesFromSnapshotTest-232942598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:07:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8cb81a5b-3dbe-4204-82b5-fa3d08b22ac6 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8cb81a5b-3dbe-4204-82b5-fa3d08b22ac6 tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:09 devstack sudo[108405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:07:09 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:09 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8cb81a5b-3dbe-4204-82b5-fa3d08b22ac6 tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.240s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:09 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-8cb81a5b-3dbe-4204-82b5-fa3d08b22ac6 tempest-CreateVolumesFromSnapshotTest-232942598 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:07:09 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-8cb81a5b-3dbe-4204-82b5-fa3d08b22ac6 tempest-CreateVolumesFromSnapshotTest-232942598 None] Deleted volume successfully. Aug 10 13:07:09 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8cb81a5b-3dbe-4204-82b5-fa3d08b22ac6 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "cinder-403bffd0-1c52-4d52-b2e0-c1b57798460c-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:07:09 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2be15bb7-0ad4-494f-a589-16c91fe8b578 tempest-CreateVolumesFromSnapshotTest-232942598 None] Acquiring lock "cinder-332eb5f5-ece8-4b46-962f-849bb7ee8ef4-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:07:09 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2be15bb7-0ad4-494f-a589-16c91fe8b578 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "cinder-332eb5f5-ece8-4b46-962f-849bb7ee8ef4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:07:09 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2be15bb7-0ad4-494f-a589-16c91fe8b578 tempest-CreateVolumesFromSnapshotTest-232942598 None] Acquiring lock "cinder-quobyte-332eb5f5-ece8-4b46-962f-849bb7ee8ef4" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:07:09 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2be15bb7-0ad4-494f-a589-16c91fe8b578 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "cinder-quobyte-332eb5f5-ece8-4b46-962f-849bb7ee8ef4" acquired by "delete_volume" :: waited 0.016s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:07:09 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[1804d8da-5f3c-4dcc-b6ad-5e9e7219b81e]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:07:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2be15bb7-0ad4-494f-a589-16c91fe8b578 tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-332eb5f5-ece8-4b46-962f-849bb7ee8ef4 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:09 devstack sudo[108408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-332eb5f5-ece8-4b46-962f-849bb7ee8ef4 Aug 10 13:07:09 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:10 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2be15bb7-0ad4-494f-a589-16c91fe8b578 tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-332eb5f5-ece8-4b46-962f-849bb7ee8ef4" returned: 0 in 0.345s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2be15bb7-0ad4-494f-a589-16c91fe8b578 tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-332eb5f5-ece8-4b46-962f-849bb7ee8ef4 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:10 devstack sudo[108414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-332eb5f5-ece8-4b46-962f-849bb7ee8ef4 Aug 10 13:07:10 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:10 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2be15bb7-0ad4-494f-a589-16c91fe8b578 tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-332eb5f5-ece8-4b46-962f-849bb7ee8ef4" returned: 0 in 0.238s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2be15bb7-0ad4-494f-a589-16c91fe8b578 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "cinder-quobyte-332eb5f5-ece8-4b46-962f-849bb7ee8ef4" released by "delete_volume" :: held 0.619s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:07:10 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-2be15bb7-0ad4-494f-a589-16c91fe8b578 tempest-CreateVolumesFromSnapshotTest-232942598 None] Created reservations ['23fc891d-577d-4d7c-bb33-06a062769ff8', '56f393c3-a9cb-4093-b7c1-0b405ee82662', 'd8e520f3-4df9-4000-9a94-cb708a2f04ac', '7c32938a-83f8-41e6-8bc2-c190e9a807d9'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:07:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2be15bb7-0ad4-494f-a589-16c91fe8b578 tempest-CreateVolumesFromSnapshotTest-232942598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2be15bb7-0ad4-494f-a589-16c91fe8b578 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-2be15bb7-0ad4-494f-a589-16c91fe8b578 tempest-CreateVolumesFromSnapshotTest-232942598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:07:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-2be15bb7-0ad4-494f-a589-16c91fe8b578 tempest-CreateVolumesFromSnapshotTest-232942598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:07:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2be15bb7-0ad4-494f-a589-16c91fe8b578 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2be15bb7-0ad4-494f-a589-16c91fe8b578 tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:10 devstack sudo[108417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:07:10 devstack sudo[108417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:10 devstack sudo[108417]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2be15bb7-0ad4-494f-a589-16c91fe8b578 tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.253s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:10 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-2be15bb7-0ad4-494f-a589-16c91fe8b578 tempest-CreateVolumesFromSnapshotTest-232942598 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:07:10 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-2be15bb7-0ad4-494f-a589-16c91fe8b578 tempest-CreateVolumesFromSnapshotTest-232942598 None] Deleted volume successfully. Aug 10 13:07:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2be15bb7-0ad4-494f-a589-16c91fe8b578 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "cinder-332eb5f5-ece8-4b46-962f-849bb7ee8ef4-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:07:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-dcd0d566-0b9e-420d-9eb3-6e8491da99ee tempest-CreateVolumesFromSnapshotTest-232942598 None] Acquiring lock "cinder-3eea178e-f81d-417b-9eca-082853988566-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:07:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-dcd0d566-0b9e-420d-9eb3-6e8491da99ee tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "cinder-3eea178e-f81d-417b-9eca-082853988566-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:07:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-dcd0d566-0b9e-420d-9eb3-6e8491da99ee tempest-CreateVolumesFromSnapshotTest-232942598 None] Acquiring lock "cinder-quobyte-3eea178e-f81d-417b-9eca-082853988566" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:07:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-dcd0d566-0b9e-420d-9eb3-6e8491da99ee tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "cinder-quobyte-3eea178e-f81d-417b-9eca-082853988566" acquired by "delete_volume" :: waited 0.013s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:07:10 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca9d74f-3bd0-4bde-ba60-e91b5c93d3cc]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:07:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dcd0d566-0b9e-420d-9eb3-6e8491da99ee tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3eea178e-f81d-417b-9eca-082853988566 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:10 devstack sudo[108420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3eea178e-f81d-417b-9eca-082853988566 Aug 10 13:07:10 devstack sudo[108420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:11 devstack sudo[108420]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dcd0d566-0b9e-420d-9eb3-6e8491da99ee tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3eea178e-f81d-417b-9eca-082853988566" returned: 0 in 0.347s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dcd0d566-0b9e-420d-9eb3-6e8491da99ee tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3eea178e-f81d-417b-9eca-082853988566 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:11 devstack sudo[108425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3eea178e-f81d-417b-9eca-082853988566 Aug 10 13:07:11 devstack sudo[108425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:11 devstack sudo[108425]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dcd0d566-0b9e-420d-9eb3-6e8491da99ee tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3eea178e-f81d-417b-9eca-082853988566" returned: 0 in 0.242s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:11 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-dcd0d566-0b9e-420d-9eb3-6e8491da99ee tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "cinder-quobyte-3eea178e-f81d-417b-9eca-082853988566" released by "delete_volume" :: held 0.625s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:07:11 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-dcd0d566-0b9e-420d-9eb3-6e8491da99ee tempest-CreateVolumesFromSnapshotTest-232942598 None] Created reservations ['856e4496-0c4b-456a-b4c6-a839889e8fb1', '831fb584-8372-4c90-a7be-8589e59483ac', 'c87e5ef2-113b-424b-9486-6a7abbe17748', 'b25bd8b5-1bbd-42a4-a1c2-19563b6acbec'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:07:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-dcd0d566-0b9e-420d-9eb3-6e8491da99ee tempest-CreateVolumesFromSnapshotTest-232942598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-dcd0d566-0b9e-420d-9eb3-6e8491da99ee tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:11 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-dcd0d566-0b9e-420d-9eb3-6e8491da99ee tempest-CreateVolumesFromSnapshotTest-232942598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:07:11 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-dcd0d566-0b9e-420d-9eb3-6e8491da99ee tempest-CreateVolumesFromSnapshotTest-232942598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:07:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-dcd0d566-0b9e-420d-9eb3-6e8491da99ee tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dcd0d566-0b9e-420d-9eb3-6e8491da99ee tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:11 devstack sudo[108428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:07:11 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:11 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dcd0d566-0b9e-420d-9eb3-6e8491da99ee tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.240s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:11 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-dcd0d566-0b9e-420d-9eb3-6e8491da99ee tempest-CreateVolumesFromSnapshotTest-232942598 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:07:11 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-dcd0d566-0b9e-420d-9eb3-6e8491da99ee tempest-CreateVolumesFromSnapshotTest-232942598 None] Deleted volume successfully. Aug 10 13:07:11 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-dcd0d566-0b9e-420d-9eb3-6e8491da99ee tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "cinder-3eea178e-f81d-417b-9eca-082853988566-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:07:11 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-1a69370f-0e1a-4aeb-b32a-3e18af09c525 tempest-CreateVolumesFromSnapshotTest-232942598 None] Acquiring lock "cinder-ce10da16-5ff8-414b-8f46-b481d585a9b3-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:07:11 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-1a69370f-0e1a-4aeb-b32a-3e18af09c525 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "cinder-ce10da16-5ff8-414b-8f46-b481d585a9b3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:07:11 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-1a69370f-0e1a-4aeb-b32a-3e18af09c525 tempest-CreateVolumesFromSnapshotTest-232942598 None] Acquiring lock "cinder-quobyte-ce10da16-5ff8-414b-8f46-b481d585a9b3" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:07:12 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-1a69370f-0e1a-4aeb-b32a-3e18af09c525 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "cinder-quobyte-ce10da16-5ff8-414b-8f46-b481d585a9b3" acquired by "delete_volume" :: waited 0.013s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:07:12 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bb28f1-1b5c-44b4-bea8-f74040214f8e]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:07:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1a69370f-0e1a-4aeb-b32a-3e18af09c525 tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ce10da16-5ff8-414b-8f46-b481d585a9b3 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:12 devstack sudo[108431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ce10da16-5ff8-414b-8f46-b481d585a9b3 Aug 10 13:07:12 devstack sudo[108431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:12 devstack sudo[108431]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1a69370f-0e1a-4aeb-b32a-3e18af09c525 tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ce10da16-5ff8-414b-8f46-b481d585a9b3" returned: 0 in 0.344s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1a69370f-0e1a-4aeb-b32a-3e18af09c525 tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ce10da16-5ff8-414b-8f46-b481d585a9b3 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:12 devstack sudo[108436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ce10da16-5ff8-414b-8f46-b481d585a9b3 Aug 10 13:07:12 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:12 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1a69370f-0e1a-4aeb-b32a-3e18af09c525 tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ce10da16-5ff8-414b-8f46-b481d585a9b3" returned: 0 in 0.249s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:12 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-1a69370f-0e1a-4aeb-b32a-3e18af09c525 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "cinder-quobyte-ce10da16-5ff8-414b-8f46-b481d585a9b3" released by "delete_volume" :: held 0.631s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:07:12 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-1a69370f-0e1a-4aeb-b32a-3e18af09c525 tempest-CreateVolumesFromSnapshotTest-232942598 None] Created reservations ['051b8ffa-9200-4953-a9a5-031e48feff9f', 'e460183a-1ad3-4cbc-8306-cca2f7f4b6e5', 'b964f798-29a1-424b-9dac-4b63c632619a', 'b47c566d-45a5-4d3e-b3dd-f11488c99d26'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:07:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1a69370f-0e1a-4aeb-b32a-3e18af09c525 tempest-CreateVolumesFromSnapshotTest-232942598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1a69370f-0e1a-4aeb-b32a-3e18af09c525 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:12 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1a69370f-0e1a-4aeb-b32a-3e18af09c525 tempest-CreateVolumesFromSnapshotTest-232942598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:07:12 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1a69370f-0e1a-4aeb-b32a-3e18af09c525 tempest-CreateVolumesFromSnapshotTest-232942598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:07:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1a69370f-0e1a-4aeb-b32a-3e18af09c525 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1a69370f-0e1a-4aeb-b32a-3e18af09c525 tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:12 devstack sudo[108439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:07:12 devstack sudo[108439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:12 devstack sudo[108439]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1a69370f-0e1a-4aeb-b32a-3e18af09c525 tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.236s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:12 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-1a69370f-0e1a-4aeb-b32a-3e18af09c525 tempest-CreateVolumesFromSnapshotTest-232942598 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:07:12 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-1a69370f-0e1a-4aeb-b32a-3e18af09c525 tempest-CreateVolumesFromSnapshotTest-232942598 None] Deleted volume successfully. Aug 10 13:07:13 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-1a69370f-0e1a-4aeb-b32a-3e18af09c525 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "cinder-ce10da16-5ff8-414b-8f46-b481d585a9b3-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:07:13 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-87776a45-ca42-4acf-b148-977b4052dca5 tempest-CreateVolumesFromSnapshotTest-232942598 None] Acquiring lock "cinder-a73caed8-276a-407a-a8a5-54d2b1ce2e2b-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:07:13 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-87776a45-ca42-4acf-b148-977b4052dca5 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "cinder-a73caed8-276a-407a-a8a5-54d2b1ce2e2b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:07:13 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-87776a45-ca42-4acf-b148-977b4052dca5 tempest-CreateVolumesFromSnapshotTest-232942598 None] Acquiring lock "cinder-quobyte-785b6965-848f-442d-8a69-51818ef5a645" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:07:13 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-87776a45-ca42-4acf-b148-977b4052dca5 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "cinder-quobyte-785b6965-848f-442d-8a69-51818ef5a645" acquired by "delete_snapshot" :: waited 0.014s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:07:13 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-87776a45-ca42-4acf-b148-977b4052dca5 tempest-CreateVolumesFromSnapshotTest-232942598 None] Acquiring lock "cinder-quobyte-a73caed8-276a-407a-a8a5-54d2b1ce2e2b" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:07:13 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-87776a45-ca42-4acf-b148-977b4052dca5 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "cinder-quobyte-a73caed8-276a-407a-a8a5-54d2b1ce2e2b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:07:13 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-87776a45-ca42-4acf-b148-977b4052dca5 tempest-CreateVolumesFromSnapshotTest-232942598 None] Deleting offline snapshot a73caed8-276a-407a-a8a5-54d2b1ce2e2b of volume 785b6965-848f-442d-8a69-51818ef5a645 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 13:07:13 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-87776a45-ca42-4acf-b148-977b4052dca5 tempest-CreateVolumesFromSnapshotTest-232942598 None] snapshot_file for this snap is: volume-785b6965-848f-442d-8a69-51818ef5a645.a73caed8-276a-407a-a8a5-54d2b1ce2e2b {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 13:07:13 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea59d03-e72e-4fd4-ac8d-148e2763bd58]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:07:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-87776a45-ca42-4acf-b148-977b4052dca5 tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645.a73caed8-276a-407a-a8a5-54d2b1ce2e2b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:13 devstack sudo[108442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645.a73caed8-276a-407a-a8a5-54d2b1ce2e2b Aug 10 13:07:13 devstack sudo[108442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:13 devstack sudo[108442]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-87776a45-ca42-4acf-b148-977b4052dca5 tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645.a73caed8-276a-407a-a8a5-54d2b1ce2e2b" returned: 0 in 0.356s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:13 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-87776a45-ca42-4acf-b148-977b4052dca5 tempest-CreateVolumesFromSnapshotTest-232942598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-785b6965-848f-442d-8a69-51818ef5a645(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 13:07:13 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95cd4d8-d6af-409c-9f68-b7b2724c073b]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:07:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-87776a45-ca42-4acf-b148-977b4052dca5 tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:13 devstack sudo[108447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645 Aug 10 13:07:13 devstack sudo[108447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:13 devstack sudo[108447]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-87776a45-ca42-4acf-b148-977b4052dca5 tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645" returned: 0 in 0.351s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-87776a45-ca42-4acf-b148-977b4052dca5 tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645.a73caed8-276a-407a-a8a5-54d2b1ce2e2b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:13 devstack sudo[108452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645.a73caed8-276a-407a-a8a5-54d2b1ce2e2b Aug 10 13:07:13 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:14 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-87776a45-ca42-4acf-b148-977b4052dca5 tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645.a73caed8-276a-407a-a8a5-54d2b1ce2e2b" returned: 0 in 0.327s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-87776a45-ca42-4acf-b148-977b4052dca5 tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645.a73caed8-276a-407a-a8a5-54d2b1ce2e2b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:14 devstack sudo[108458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645.a73caed8-276a-407a-a8a5-54d2b1ce2e2b Aug 10 13:07:14 devstack sudo[108458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:14 devstack sudo[108458]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-87776a45-ca42-4acf-b148-977b4052dca5 tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645.a73caed8-276a-407a-a8a5-54d2b1ce2e2b" returned: 0 in 0.249s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:14 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-87776a45-ca42-4acf-b148-977b4052dca5 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "cinder-quobyte-a73caed8-276a-407a-a8a5-54d2b1ce2e2b" released by "_delete_snapshot" :: held 1.381s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:07:14 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-87776a45-ca42-4acf-b148-977b4052dca5 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "cinder-quobyte-785b6965-848f-442d-8a69-51818ef5a645" released by "delete_snapshot" :: held 1.403s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:07:14 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-87776a45-ca42-4acf-b148-977b4052dca5 tempest-CreateVolumesFromSnapshotTest-232942598 None] Created reservations ['96239968-7960-4fcd-bad4-22dae3a4400a', '8d7408ac-2fa5-46cc-89a3-1cbc3554d701', 'b5ad81d8-c3db-4f09-b23c-d46f56413676', '46a4f5df-dfd7-4cb8-866b-8ae5e9fe81c6'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:07:14 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-87776a45-ca42-4acf-b148-977b4052dca5 tempest-CreateVolumesFromSnapshotTest-232942598 None] Delete snapshot completed successfully. Aug 10 13:07:14 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-87776a45-ca42-4acf-b148-977b4052dca5 tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "cinder-a73caed8-276a-407a-a8a5-54d2b1ce2e2b-delete_snapshot" released by "delete_snapshot" :: held 1.533s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:07:15 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2e17ca69-2ab6-4d3a-bd0f-616a2207660b tempest-CreateVolumesFromSnapshotTest-232942598 None] Acquiring lock "cinder-785b6965-848f-442d-8a69-51818ef5a645-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:07:15 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2e17ca69-2ab6-4d3a-bd0f-616a2207660b tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "cinder-785b6965-848f-442d-8a69-51818ef5a645-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:07:15 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2e17ca69-2ab6-4d3a-bd0f-616a2207660b tempest-CreateVolumesFromSnapshotTest-232942598 None] Acquiring lock "cinder-quobyte-785b6965-848f-442d-8a69-51818ef5a645" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:07:15 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2e17ca69-2ab6-4d3a-bd0f-616a2207660b tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "cinder-quobyte-785b6965-848f-442d-8a69-51818ef5a645" acquired by "delete_volume" :: waited 0.016s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:07:15 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[de92ea32-0d86-445e-af66-42c8d7765fa9]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:07:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2e17ca69-2ab6-4d3a-bd0f-616a2207660b tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:15 devstack sudo[108461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645 Aug 10 13:07:15 devstack sudo[108461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:15 devstack sudo[108461]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2e17ca69-2ab6-4d3a-bd0f-616a2207660b tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645" returned: 0 in 0.345s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2e17ca69-2ab6-4d3a-bd0f-616a2207660b tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:15 devstack sudo[108466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645 Aug 10 13:07:15 devstack sudo[108466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:15 devstack sudo[108466]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2e17ca69-2ab6-4d3a-bd0f-616a2207660b tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-785b6965-848f-442d-8a69-51818ef5a645" returned: 0 in 0.241s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:15 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2e17ca69-2ab6-4d3a-bd0f-616a2207660b tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "cinder-quobyte-785b6965-848f-442d-8a69-51818ef5a645" released by "delete_volume" :: held 0.641s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:07:15 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-2e17ca69-2ab6-4d3a-bd0f-616a2207660b tempest-CreateVolumesFromSnapshotTest-232942598 None] Created reservations ['651e90b5-da09-4769-a323-94d6c78551ce', '385416bd-44e9-4606-8c14-8e03d25ddcdc', 'ac71b24a-8601-414f-9a2a-0f2b644d9da2', 'f506f2fd-d8c4-4061-bc48-658c20a4a939'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:07:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2e17ca69-2ab6-4d3a-bd0f-616a2207660b tempest-CreateVolumesFromSnapshotTest-232942598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2e17ca69-2ab6-4d3a-bd0f-616a2207660b tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:16 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-2e17ca69-2ab6-4d3a-bd0f-616a2207660b tempest-CreateVolumesFromSnapshotTest-232942598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:07:16 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-2e17ca69-2ab6-4d3a-bd0f-616a2207660b tempest-CreateVolumesFromSnapshotTest-232942598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:07:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2e17ca69-2ab6-4d3a-bd0f-616a2207660b tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2e17ca69-2ab6-4d3a-bd0f-616a2207660b tempest-CreateVolumesFromSnapshotTest-232942598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:16 devstack sudo[108469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:07:16 devstack sudo[108469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:16 devstack sudo[108469]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2e17ca69-2ab6-4d3a-bd0f-616a2207660b tempest-CreateVolumesFromSnapshotTest-232942598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.238s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:16 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-2e17ca69-2ab6-4d3a-bd0f-616a2207660b tempest-CreateVolumesFromSnapshotTest-232942598 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:07:16 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-2e17ca69-2ab6-4d3a-bd0f-616a2207660b tempest-CreateVolumesFromSnapshotTest-232942598 None] Deleted volume successfully. Aug 10 13:07:16 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2e17ca69-2ab6-4d3a-bd0f-616a2207660b tempest-CreateVolumesFromSnapshotTest-232942598 None] Lock "cinder-785b6965-848f-442d-8a69-51818ef5a645-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:07:19 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad8af28d-ffb7-479d-8e3a-79d653e017d0 tempest-VolumeDependencyTests-822983888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:07:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ad8af28d-ffb7-479d-8e3a-79d653e017d0 tempest-VolumeDependencyTests-822983888 None] Flow 'volume_create_manager' (d80e48b3-ddf5-4f64-86b5-59a150dc9dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ad8af28d-ffb7-479d-8e3a-79d653e017d0 tempest-VolumeDependencyTests-822983888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c10b90b-518a-45f0-9d1f-65cd6c4b23c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ad8af28d-ffb7-479d-8e3a-79d653e017d0 tempest-VolumeDependencyTests-822983888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c10b90b-518a-45f0-9d1f-65cd6c4b23c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1885538432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9722efd3-1695-41f2-8c64-f61850714a86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f49797aff84140bab7541f5b747fe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:19Z,use_quota=True,user_id='803936f5d78c4df296b5cb82a72bacc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ad8af28d-ffb7-479d-8e3a-79d653e017d0 tempest-VolumeDependencyTests-822983888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9eaf81c-4d9a-47c6-9158-970820ceb574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ad8af28d-ffb7-479d-8e3a-79d653e017d0 tempest-VolumeDependencyTests-822983888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9eaf81c-4d9a-47c6-9158-970820ceb574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ad8af28d-ffb7-479d-8e3a-79d653e017d0 tempest-VolumeDependencyTests-822983888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c3e63b-b188-430a-887a-1e8dbf5a235a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ad8af28d-ffb7-479d-8e3a-79d653e017d0 tempest-VolumeDependencyTests-822983888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c3e63b-b188-430a-887a-1e8dbf5a235a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9722efd3-1695-41f2-8c64-f61850714a86', 'volume_name': 'volume-9722efd3-1695-41f2-8c64-f61850714a86', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ad8af28d-ffb7-479d-8e3a-79d653e017d0 tempest-VolumeDependencyTests-822983888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97d1b2f3-ad84-4d70-8a00-33e7932e3fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ad8af28d-ffb7-479d-8e3a-79d653e017d0 tempest-VolumeDependencyTests-822983888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97d1b2f3-ad84-4d70-8a00-33e7932e3fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ad8af28d-ffb7-479d-8e3a-79d653e017d0 tempest-VolumeDependencyTests-822983888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (115136c2-0714-41ca-9223-456060061569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:19 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-ad8af28d-ffb7-479d-8e3a-79d653e017d0 tempest-VolumeDependencyTests-822983888 None] Volume 9722efd3-1695-41f2-8c64-f61850714a86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9722efd3-1695-41f2-8c64-f61850714a86', 'volume_size': 1} Aug 10 13:07:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ad8af28d-ffb7-479d-8e3a-79d653e017d0 tempest-VolumeDependencyTests-822983888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ad8af28d-ffb7-479d-8e3a-79d653e017d0 tempest-VolumeDependencyTests-822983888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:19 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ad8af28d-ffb7-479d-8e3a-79d653e017d0 tempest-VolumeDependencyTests-822983888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1885538432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9722efd3-1695-41f2-8c64-f61850714a86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f49797aff84140bab7541f5b747fe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:19Z,use_quota=True,user_id='803936f5d78c4df296b5cb82a72bacc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:07:19 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-ad8af28d-ffb7-479d-8e3a-79d653e017d0 tempest-VolumeDependencyTests-822983888 None] Creating volume 9722efd3-1695-41f2-8c64-f61850714a86 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:07:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ad8af28d-ffb7-479d-8e3a-79d653e017d0 tempest-VolumeDependencyTests-822983888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ad8af28d-ffb7-479d-8e3a-79d653e017d0 tempest-VolumeDependencyTests-822983888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:19 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ad8af28d-ffb7-479d-8e3a-79d653e017d0 tempest-VolumeDependencyTests-822983888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:07:19 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ad8af28d-ffb7-479d-8e3a-79d653e017d0 tempest-VolumeDependencyTests-822983888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:07:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ad8af28d-ffb7-479d-8e3a-79d653e017d0 tempest-VolumeDependencyTests-822983888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:19 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ad8af28d-ffb7-479d-8e3a-79d653e017d0 tempest-VolumeDependencyTests-822983888 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:07:19 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-ad8af28d-ffb7-479d-8e3a-79d653e017d0 tempest-VolumeDependencyTests-822983888 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:07:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ad8af28d-ffb7-479d-8e3a-79d653e017d0 tempest-VolumeDependencyTests-822983888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:19 devstack sudo[108475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86 1073741824 Aug 10 13:07:19 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:19 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ad8af28d-ffb7-479d-8e3a-79d653e017d0 tempest-VolumeDependencyTests-822983888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86 1073741824" returned: 0 in 0.408s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ad8af28d-ffb7-479d-8e3a-79d653e017d0 tempest-VolumeDependencyTests-822983888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:19 devstack sudo[108481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86 Aug 10 13:07:19 devstack sudo[108481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:19 devstack sudo[108481]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ad8af28d-ffb7-479d-8e3a-79d653e017d0 tempest-VolumeDependencyTests-822983888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86" returned: 0 in 0.244s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:19 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ad8af28d-ffb7-479d-8e3a-79d653e017d0 tempest-VolumeDependencyTests-822983888 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:07:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ad8af28d-ffb7-479d-8e3a-79d653e017d0 tempest-VolumeDependencyTests-822983888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ad8af28d-ffb7-479d-8e3a-79d653e017d0 tempest-VolumeDependencyTests-822983888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (115136c2-0714-41ca-9223-456060061569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9722efd3-1695-41f2-8c64-f61850714a86', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ad8af28d-ffb7-479d-8e3a-79d653e017d0 tempest-VolumeDependencyTests-822983888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95cbfb98-7535-4cd2-b871-f0f6d23670f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:19 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-ad8af28d-ffb7-479d-8e3a-79d653e017d0 tempest-VolumeDependencyTests-822983888 None] Volume volume-9722efd3-1695-41f2-8c64-f61850714a86 (9722efd3-1695-41f2-8c64-f61850714a86): created successfully Aug 10 13:07:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ad8af28d-ffb7-479d-8e3a-79d653e017d0 tempest-VolumeDependencyTests-822983888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95cbfb98-7535-4cd2-b871-f0f6d23670f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:19 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ad8af28d-ffb7-479d-8e3a-79d653e017d0 tempest-VolumeDependencyTests-822983888 None] Flow 'volume_create_manager' (d80e48b3-ddf5-4f64-86b5-59a150dc9dde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:19 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-ad8af28d-ffb7-479d-8e3a-79d653e017d0 tempest-VolumeDependencyTests-822983888 None] Created volume successfully. Aug 10 13:07:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-52226bc2-4a08-4d30-805f-8c3898cd8623 tempest-VolumeDependencyTests-822983888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-52226bc2-4a08-4d30-805f-8c3898cd8623 tempest-VolumeDependencyTests-822983888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:20 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-52226bc2-4a08-4d30-805f-8c3898cd8623 tempest-VolumeDependencyTests-822983888 None] Creating offline snapshot 9727aacd-c732-420d-8f73-81e6afa6ffc8 of volume 9722efd3-1695-41f2-8c64-f61850714a86 {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 13:07:20 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec0dee8-37bb-41d6-9f2c-2503ee7901f9]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:07:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-52226bc2-4a08-4d30-805f-8c3898cd8623 tempest-VolumeDependencyTests-822983888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:20 devstack sudo[108484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86 Aug 10 13:07:20 devstack sudo[108484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:20 devstack sudo[108484]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-52226bc2-4a08-4d30-805f-8c3898cd8623 tempest-VolumeDependencyTests-822983888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86" returned: 0 in 0.351s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-52226bc2-4a08-4d30-805f-8c3898cd8623 tempest-VolumeDependencyTests-822983888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86.9727aacd-c732-420d-8f73-81e6afa6ffc8 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:20 devstack sudo[108489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86.9727aacd-c732-420d-8f73-81e6afa6ffc8 1G Aug 10 13:07:20 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:20 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-52226bc2-4a08-4d30-805f-8c3898cd8623 tempest-VolumeDependencyTests-822983888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86.9727aacd-c732-420d-8f73-81e6afa6ffc8 1G" returned: 0 in 0.395s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-52226bc2-4a08-4d30-805f-8c3898cd8623 tempest-VolumeDependencyTests-822983888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9722efd3-1695-41f2-8c64-f61850714a86 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86.9727aacd-c732-420d-8f73-81e6afa6ffc8 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:21 devstack sudo[108494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9722efd3-1695-41f2-8c64-f61850714a86 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86.9727aacd-c732-420d-8f73-81e6afa6ffc8 Aug 10 13:07:21 devstack sudo[108494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:21 devstack sudo[108494]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-52226bc2-4a08-4d30-805f-8c3898cd8623 tempest-VolumeDependencyTests-822983888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9722efd3-1695-41f2-8c64-f61850714a86 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86.9727aacd-c732-420d-8f73-81e6afa6ffc8" returned: 0 in 0.279s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:21 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-52226bc2-4a08-4d30-805f-8c3898cd8623 tempest-VolumeDependencyTests-822983888 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86.9727aacd-c732-420d-8f73-81e6afa6ffc8 is being set with open permissions: ugo+rw Aug 10 13:07:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-52226bc2-4a08-4d30-805f-8c3898cd8623 tempest-VolumeDependencyTests-822983888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86.9727aacd-c732-420d-8f73-81e6afa6ffc8 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:21 devstack sudo[108499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86.9727aacd-c732-420d-8f73-81e6afa6ffc8 Aug 10 13:07:21 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:21 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-52226bc2-4a08-4d30-805f-8c3898cd8623 tempest-VolumeDependencyTests-822983888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86.9727aacd-c732-420d-8f73-81e6afa6ffc8" returned: 0 in 0.238s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-52226bc2-4a08-4d30-805f-8c3898cd8623 tempest-VolumeDependencyTests-822983888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:21 devstack sudo[108502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86.info Aug 10 13:07:21 devstack sudo[108502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:21 devstack sudo[108502]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-52226bc2-4a08-4d30-805f-8c3898cd8623 tempest-VolumeDependencyTests-822983888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86.info" returned: 0 in 0.255s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:21 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-52226bc2-4a08-4d30-805f-8c3898cd8623 tempest-VolumeDependencyTests-822983888 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86.info is being set with open permissions: ugo+rw Aug 10 13:07:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-52226bc2-4a08-4d30-805f-8c3898cd8623 tempest-VolumeDependencyTests-822983888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:21 devstack sudo[108505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86.info Aug 10 13:07:21 devstack sudo[108505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:22 devstack sudo[108505]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-52226bc2-4a08-4d30-805f-8c3898cd8623 tempest-VolumeDependencyTests-822983888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86.info" returned: 0 in 0.246s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-52226bc2-4a08-4d30-805f-8c3898cd8623 tempest-VolumeDependencyTests-822983888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.866s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:22 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-52226bc2-4a08-4d30-805f-8c3898cd8623 tempest-VolumeDependencyTests-822983888 None] Create snapshot completed successfully Aug 10 13:07:22 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:07:22 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Flow 'volume_create_manager' (ad38274f-0aeb-43c3-b59c-4cfa15fee953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:22 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e3ce6ef-cc8d-47b3-9a88-948c28d8ee79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:22 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e3ce6ef-cc8d-47b3-9a88-948c28d8ee79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1011411239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32001d49-7603-4310-833a-c3ad68dd00f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f49797aff84140bab7541f5b747fe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9727aacd-c732-420d-8f73-81e6afa6ffc8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:23Z,use_quota=True,user_id='803936f5d78c4df296b5cb82a72bacc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:22 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faa5df01-70d8-4068-8a83-27a588f03105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:22 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faa5df01-70d8-4068-8a83-27a588f03105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:22 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25760137-ec3c-4319-a2a0-938ef006826d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:22 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25760137-ec3c-4319-a2a0-938ef006826d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '32001d49-7603-4310-833a-c3ad68dd00f1', 'volume_name': 'volume-32001d49-7603-4310-833a-c3ad68dd00f1', 'volume_size': 1, 'snapshot_id': '9727aacd-c732-420d-8f73-81e6afa6ffc8'}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:22 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae93e238-2c90-4a61-86eb-0775d08a9431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:22 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae93e238-2c90-4a61-86eb-0775d08a9431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:22 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09482f95-349a-423b-80e0-cdfac22f40ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:22 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Volume 32001d49-7603-4310-833a-c3ad68dd00f1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-32001d49-7603-4310-833a-c3ad68dd00f1', 'volume_size': 1, 'snapshot_id': '9727aacd-c732-420d-8f73-81e6afa6ffc8'} Aug 10 13:07:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:22 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Acquiring lock "cinder-quobyte-9727aacd-c732-420d-8f73-81e6afa6ffc8-32001d49-7603-4310-833a-c3ad68dd00f1" by "_create_volume_from_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:07:22 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Lock "cinder-quobyte-9727aacd-c732-420d-8f73-81e6afa6ffc8-32001d49-7603-4310-833a-c3ad68dd00f1" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:07:22 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Creating volume 32001d49-7603-4310-833a-c3ad68dd00f1 from snapshot 9727aacd-c732-420d-8f73-81e6afa6ffc8 {{(pid=89096) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 10 13:07:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:22 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:07:22 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:07:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:22 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:07:22 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Acquiring lock "cinder-quobyte-32001d49-7603-4310-833a-c3ad68dd00f1" by "_copy_volume_from_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:07:22 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Lock "cinder-quobyte-32001d49-7603-4310-833a-c3ad68dd00f1" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:07:22 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] snapshot: 9727aacd-c732-420d-8f73-81e6afa6ffc8, volume: 32001d49-7603-4310-833a-c3ad68dd00f1, {{(pid=89096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 10 13:07:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:22 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:07:22 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:07:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:22 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[14342326-e7b0-4fde-9f15-ca0d13739064]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:07:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86.9727aacd-c732-420d-8f73-81e6afa6ffc8 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:23 devstack sudo[108508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86.9727aacd-c732-420d-8f73-81e6afa6ffc8 Aug 10 13:07:23 devstack sudo[108508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:23 devstack sudo[108508]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86.9727aacd-c732-420d-8f73-81e6afa6ffc8" returned: 0 in 0.351s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:23 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9722efd3-1695-41f2-8c64-f61850714a86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 13:07:23 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b20bba-38be-4d62-ace4-47f0a665da22]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:07:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:23 devstack sudo[108513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86 Aug 10 13:07:23 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:23 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86" returned: 0 in 0.339s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:23 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86 {{(pid=89096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 10 13:07:23 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Creating direct copy from snapshot {{(pid=89096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 10 13:07:23 devstack cinder-volume[89096]: DEBUG cinder.utils [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Path /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-32001d49-7603-4310-833a-c3ad68dd00f1 not found in is_blk_device check {{(pid=89096) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 10 13:07:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-32001d49-7603-4310-833a-c3ad68dd00f1 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:23 devstack sudo[108518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-32001d49-7603-4310-833a-c3ad68dd00f1 Aug 10 13:07:23 devstack sudo[108518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:27 devstack sudo[108518]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-32001d49-7603-4310-833a-c3ad68dd00f1" returned: 0 in 3.867s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:27 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Image conversion details: src /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86, size 1024.00 MB, duration 3.87 sec, destination /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-32001d49-7603-4310-833a-c3ad68dd00f1 {{(pid=89096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 13:07:27 devstack cinder-volume[89096]: INFO cinder.image.image_utils [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Converted 1024.00 MB image at 264.76 MB/s Aug 10 13:07:27 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-32001d49-7603-4310-833a-c3ad68dd00f1 is being set with open permissions: ugo+rw Aug 10 13:07:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-32001d49-7603-4310-833a-c3ad68dd00f1 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:27 devstack sudo[108531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-32001d49-7603-4310-833a-c3ad68dd00f1 Aug 10 13:07:27 devstack sudo[108531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:27 devstack sudo[108531]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-32001d49-7603-4310-833a-c3ad68dd00f1" returned: 0 in 0.235s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:27 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Lock "cinder-quobyte-32001d49-7603-4310-833a-c3ad68dd00f1" released by "_copy_volume_from_snapshot" :: held 4.861s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:07:27 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Lock "cinder-quobyte-9727aacd-c732-420d-8f73-81e6afa6ffc8-32001d49-7603-4310-833a-c3ad68dd00f1" released by "_create_volume_from_snapshot" :: held 4.916s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:07:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.931s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:27 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09482f95-349a-423b-80e0-cdfac22f40ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32001d49-7603-4310-833a-c3ad68dd00f1', 'volume_size': 1, 'snapshot_id': '9727aacd-c732-420d-8f73-81e6afa6ffc8'}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:27 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1a26bb2-7041-4da8-923e-f1ace3484564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:27 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Volume volume-32001d49-7603-4310-833a-c3ad68dd00f1 (32001d49-7603-4310-833a-c3ad68dd00f1): created successfully Aug 10 13:07:27 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1a26bb2-7041-4da8-923e-f1ace3484564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:27 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Flow 'volume_create_manager' (ad38274f-0aeb-43c3-b59c-4cfa15fee953) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:27 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-4abdca01-28f8-4c93-907f-4400cd251c70 tempest-VolumeDependencyTests-822983888 None] Created volume successfully. Aug 10 13:07:28 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0b8c4886-ff1e-4564-85e4-c3d92612cd94 tempest-VolumeDependencyTests-822983888 None] Acquiring lock "cinder-9727aacd-c732-420d-8f73-81e6afa6ffc8-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:07:28 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0b8c4886-ff1e-4564-85e4-c3d92612cd94 tempest-VolumeDependencyTests-822983888 None] Lock "cinder-9727aacd-c732-420d-8f73-81e6afa6ffc8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:07:28 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0b8c4886-ff1e-4564-85e4-c3d92612cd94 tempest-VolumeDependencyTests-822983888 None] Acquiring lock "cinder-quobyte-9722efd3-1695-41f2-8c64-f61850714a86" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:07:28 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0b8c4886-ff1e-4564-85e4-c3d92612cd94 tempest-VolumeDependencyTests-822983888 None] Lock "cinder-quobyte-9722efd3-1695-41f2-8c64-f61850714a86" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:07:28 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0b8c4886-ff1e-4564-85e4-c3d92612cd94 tempest-VolumeDependencyTests-822983888 None] Acquiring lock "cinder-quobyte-9727aacd-c732-420d-8f73-81e6afa6ffc8" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:07:28 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0b8c4886-ff1e-4564-85e4-c3d92612cd94 tempest-VolumeDependencyTests-822983888 None] Lock "cinder-quobyte-9727aacd-c732-420d-8f73-81e6afa6ffc8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:07:28 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-0b8c4886-ff1e-4564-85e4-c3d92612cd94 tempest-VolumeDependencyTests-822983888 None] Deleting offline snapshot 9727aacd-c732-420d-8f73-81e6afa6ffc8 of volume 9722efd3-1695-41f2-8c64-f61850714a86 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 13:07:28 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-0b8c4886-ff1e-4564-85e4-c3d92612cd94 tempest-VolumeDependencyTests-822983888 None] snapshot_file for this snap is: volume-9722efd3-1695-41f2-8c64-f61850714a86.9727aacd-c732-420d-8f73-81e6afa6ffc8 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 13:07:28 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[8724d628-74d8-4a57-b1c7-7c1e5e321e51]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:07:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0b8c4886-ff1e-4564-85e4-c3d92612cd94 tempest-VolumeDependencyTests-822983888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86.9727aacd-c732-420d-8f73-81e6afa6ffc8 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:28 devstack sudo[108534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86.9727aacd-c732-420d-8f73-81e6afa6ffc8 Aug 10 13:07:28 devstack sudo[108534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:28 devstack sudo[108534]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0b8c4886-ff1e-4564-85e4-c3d92612cd94 tempest-VolumeDependencyTests-822983888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86.9727aacd-c732-420d-8f73-81e6afa6ffc8" returned: 0 in 0.345s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:28 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-0b8c4886-ff1e-4564-85e4-c3d92612cd94 tempest-VolumeDependencyTests-822983888 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9722efd3-1695-41f2-8c64-f61850714a86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 13:07:28 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd29b66c-6219-4d46-bb11-8d8137ad1be0]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:07:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0b8c4886-ff1e-4564-85e4-c3d92612cd94 tempest-VolumeDependencyTests-822983888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:28 devstack sudo[108541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86 Aug 10 13:07:28 devstack sudo[108541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:29 devstack sudo[108541]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0b8c4886-ff1e-4564-85e4-c3d92612cd94 tempest-VolumeDependencyTests-822983888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86" returned: 0 in 0.505s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0b8c4886-ff1e-4564-85e4-c3d92612cd94 tempest-VolumeDependencyTests-822983888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86.9727aacd-c732-420d-8f73-81e6afa6ffc8 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:29 devstack sudo[108547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86.9727aacd-c732-420d-8f73-81e6afa6ffc8 Aug 10 13:07:29 devstack sudo[108547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:29 devstack sudo[108547]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0b8c4886-ff1e-4564-85e4-c3d92612cd94 tempest-VolumeDependencyTests-822983888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86.9727aacd-c732-420d-8f73-81e6afa6ffc8" returned: 0 in 0.316s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0b8c4886-ff1e-4564-85e4-c3d92612cd94 tempest-VolumeDependencyTests-822983888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86.9727aacd-c732-420d-8f73-81e6afa6ffc8 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:29 devstack sudo[108552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86.9727aacd-c732-420d-8f73-81e6afa6ffc8 Aug 10 13:07:29 devstack sudo[108552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:29 devstack sudo[108552]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0b8c4886-ff1e-4564-85e4-c3d92612cd94 tempest-VolumeDependencyTests-822983888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86.9727aacd-c732-420d-8f73-81e6afa6ffc8" returned: 0 in 0.240s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:29 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0b8c4886-ff1e-4564-85e4-c3d92612cd94 tempest-VolumeDependencyTests-822983888 None] Lock "cinder-quobyte-9727aacd-c732-420d-8f73-81e6afa6ffc8" released by "_delete_snapshot" :: held 1.500s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:07:29 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0b8c4886-ff1e-4564-85e4-c3d92612cd94 tempest-VolumeDependencyTests-822983888 None] Lock "cinder-quobyte-9722efd3-1695-41f2-8c64-f61850714a86" released by "delete_snapshot" :: held 1.521s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:07:29 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-0b8c4886-ff1e-4564-85e4-c3d92612cd94 tempest-VolumeDependencyTests-822983888 None] Created reservations ['01a48e4a-4745-486c-a75f-78c5d8bf19af', '4a36dd95-3b16-4781-bcf1-8058d1a85d44', 'd6c44a14-e1cc-4b56-bb4c-4a4946d9c98d', '1e87b39e-59ae-4ce3-ac1a-ce333460858f'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:07:29 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-0b8c4886-ff1e-4564-85e4-c3d92612cd94 tempest-VolumeDependencyTests-822983888 None] Delete snapshot completed successfully. Aug 10 13:07:29 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0b8c4886-ff1e-4564-85e4-c3d92612cd94 tempest-VolumeDependencyTests-822983888 None] Lock "cinder-9727aacd-c732-420d-8f73-81e6afa6ffc8-delete_snapshot" released by "delete_snapshot" :: held 1.658s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:07:30 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-343c47aa-b910-4c48-aa4f-ba47fb0c8c43 tempest-VolumeDependencyTests-822983888 None] Acquiring lock "cinder-9722efd3-1695-41f2-8c64-f61850714a86-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:07:30 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-343c47aa-b910-4c48-aa4f-ba47fb0c8c43 tempest-VolumeDependencyTests-822983888 None] Lock "cinder-9722efd3-1695-41f2-8c64-f61850714a86-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:07:30 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-343c47aa-b910-4c48-aa4f-ba47fb0c8c43 tempest-VolumeDependencyTests-822983888 None] Acquiring lock "cinder-quobyte-9722efd3-1695-41f2-8c64-f61850714a86" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:07:30 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-343c47aa-b910-4c48-aa4f-ba47fb0c8c43 tempest-VolumeDependencyTests-822983888 None] Lock "cinder-quobyte-9722efd3-1695-41f2-8c64-f61850714a86" acquired by "delete_volume" :: waited 0.014s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:07:30 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f26d9c3-faea-403c-8f6b-493893ed8288]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:07:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-343c47aa-b910-4c48-aa4f-ba47fb0c8c43 tempest-VolumeDependencyTests-822983888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:30 devstack sudo[108556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86 Aug 10 13:07:30 devstack sudo[108556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:30 devstack sudo[108556]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-343c47aa-b910-4c48-aa4f-ba47fb0c8c43 tempest-VolumeDependencyTests-822983888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86" returned: 0 in 0.353s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-343c47aa-b910-4c48-aa4f-ba47fb0c8c43 tempest-VolumeDependencyTests-822983888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:30 devstack sudo[108561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86 Aug 10 13:07:30 devstack sudo[108561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:31 devstack sudo[108561]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-343c47aa-b910-4c48-aa4f-ba47fb0c8c43 tempest-VolumeDependencyTests-822983888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9722efd3-1695-41f2-8c64-f61850714a86" returned: 0 in 0.247s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:31 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-343c47aa-b910-4c48-aa4f-ba47fb0c8c43 tempest-VolumeDependencyTests-822983888 None] Lock "cinder-quobyte-9722efd3-1695-41f2-8c64-f61850714a86" released by "delete_volume" :: held 0.658s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:07:31 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-343c47aa-b910-4c48-aa4f-ba47fb0c8c43 tempest-VolumeDependencyTests-822983888 None] Created reservations ['d21998a9-fb05-4f62-ba30-718680b6072f', 'f7cbd69a-72d8-4a49-a85d-eff55ee20f8c', 'b6344b49-a74a-434c-b813-2511dd5569f1', '271f9954-6e0a-4d58-b951-be75196da704'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:07:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-343c47aa-b910-4c48-aa4f-ba47fb0c8c43 tempest-VolumeDependencyTests-822983888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-343c47aa-b910-4c48-aa4f-ba47fb0c8c43 tempest-VolumeDependencyTests-822983888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:31 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-343c47aa-b910-4c48-aa4f-ba47fb0c8c43 tempest-VolumeDependencyTests-822983888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:07:31 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-343c47aa-b910-4c48-aa4f-ba47fb0c8c43 tempest-VolumeDependencyTests-822983888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:07:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-343c47aa-b910-4c48-aa4f-ba47fb0c8c43 tempest-VolumeDependencyTests-822983888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-343c47aa-b910-4c48-aa4f-ba47fb0c8c43 tempest-VolumeDependencyTests-822983888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:31 devstack sudo[108564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:07:31 devstack sudo[108564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:31 devstack sudo[108564]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-343c47aa-b910-4c48-aa4f-ba47fb0c8c43 tempest-VolumeDependencyTests-822983888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.232s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:31 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-343c47aa-b910-4c48-aa4f-ba47fb0c8c43 tempest-VolumeDependencyTests-822983888 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:07:31 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-343c47aa-b910-4c48-aa4f-ba47fb0c8c43 tempest-VolumeDependencyTests-822983888 None] Deleted volume successfully. Aug 10 13:07:31 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-343c47aa-b910-4c48-aa4f-ba47fb0c8c43 tempest-VolumeDependencyTests-822983888 None] Lock "cinder-9722efd3-1695-41f2-8c64-f61850714a86-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:07:31 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e53a7ef9-cc76-423c-81ea-d519e180afe9 tempest-VolumeDependencyTests-822983888 None] Acquiring lock "cinder-32001d49-7603-4310-833a-c3ad68dd00f1-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:07:31 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e53a7ef9-cc76-423c-81ea-d519e180afe9 tempest-VolumeDependencyTests-822983888 None] Lock "cinder-32001d49-7603-4310-833a-c3ad68dd00f1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:07:31 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e53a7ef9-cc76-423c-81ea-d519e180afe9 tempest-VolumeDependencyTests-822983888 None] Acquiring lock "cinder-quobyte-32001d49-7603-4310-833a-c3ad68dd00f1" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:07:31 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e53a7ef9-cc76-423c-81ea-d519e180afe9 tempest-VolumeDependencyTests-822983888 None] Lock "cinder-quobyte-32001d49-7603-4310-833a-c3ad68dd00f1" acquired by "delete_volume" :: waited 0.015s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:07:31 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34a4b8a-4459-4a56-92c3-de30b21cc175]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:07:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e53a7ef9-cc76-423c-81ea-d519e180afe9 tempest-VolumeDependencyTests-822983888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-32001d49-7603-4310-833a-c3ad68dd00f1 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:31 devstack sudo[108567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-32001d49-7603-4310-833a-c3ad68dd00f1 Aug 10 13:07:31 devstack sudo[108567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:32 devstack sudo[108567]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e53a7ef9-cc76-423c-81ea-d519e180afe9 tempest-VolumeDependencyTests-822983888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-32001d49-7603-4310-833a-c3ad68dd00f1" returned: 0 in 0.357s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e53a7ef9-cc76-423c-81ea-d519e180afe9 tempest-VolumeDependencyTests-822983888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-32001d49-7603-4310-833a-c3ad68dd00f1 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:32 devstack sudo[108606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-32001d49-7603-4310-833a-c3ad68dd00f1 Aug 10 13:07:32 devstack sudo[108606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:32 devstack sudo[108606]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e53a7ef9-cc76-423c-81ea-d519e180afe9 tempest-VolumeDependencyTests-822983888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-32001d49-7603-4310-833a-c3ad68dd00f1" returned: 0 in 0.269s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:32 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e53a7ef9-cc76-423c-81ea-d519e180afe9 tempest-VolumeDependencyTests-822983888 None] Lock "cinder-quobyte-32001d49-7603-4310-833a-c3ad68dd00f1" released by "delete_volume" :: held 0.663s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:07:32 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-e53a7ef9-cc76-423c-81ea-d519e180afe9 tempest-VolumeDependencyTests-822983888 None] Created reservations ['c489b06d-5b5c-48e2-a0f0-262295b855cd', '9fb514ad-f3b8-4dc5-9336-234426806ec8', '12737b8c-f6b2-49a8-b4b9-c078ba2ac4ec', '4679e4d4-436a-4f60-9d1f-74af88e50f99'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:07:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e53a7ef9-cc76-423c-81ea-d519e180afe9 tempest-VolumeDependencyTests-822983888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e53a7ef9-cc76-423c-81ea-d519e180afe9 tempest-VolumeDependencyTests-822983888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:32 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e53a7ef9-cc76-423c-81ea-d519e180afe9 tempest-VolumeDependencyTests-822983888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:07:32 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e53a7ef9-cc76-423c-81ea-d519e180afe9 tempest-VolumeDependencyTests-822983888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:07:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e53a7ef9-cc76-423c-81ea-d519e180afe9 tempest-VolumeDependencyTests-822983888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e53a7ef9-cc76-423c-81ea-d519e180afe9 tempest-VolumeDependencyTests-822983888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:32 devstack sudo[108611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:07:32 devstack sudo[108611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:32 devstack sudo[108611]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e53a7ef9-cc76-423c-81ea-d519e180afe9 tempest-VolumeDependencyTests-822983888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.234s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:32 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-e53a7ef9-cc76-423c-81ea-d519e180afe9 tempest-VolumeDependencyTests-822983888 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:07:32 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-e53a7ef9-cc76-423c-81ea-d519e180afe9 tempest-VolumeDependencyTests-822983888 None] Deleted volume successfully. Aug 10 13:07:32 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e53a7ef9-cc76-423c-81ea-d519e180afe9 tempest-VolumeDependencyTests-822983888 None] Lock "cinder-32001d49-7603-4310-833a-c3ad68dd00f1-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:07:42 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:UPDATE=109,cinder:SELECT=73,cinder:INSERT=22,cinder:DELETE=4 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 13:07:42 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=79,cinder:INSERT=28,cinder:UPDATE=96,cinder:DELETE=14 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 13:07:44 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-81491634-f987-483d-9cc2-c443f9fbaec0 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:07:44 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81491634-f987-483d-9cc2-c443f9fbaec0 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Flow 'volume_create_manager' (511b22ae-b3b9-4ad0-8ec0-e60b36319f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:44 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81491634-f987-483d-9cc2-c443f9fbaec0 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e3c963f-0a9e-4ad7-8814-460463f2a97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:44 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81491634-f987-483d-9cc2-c443f9fbaec0 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e3c963f-0a9e-4ad7-8814-460463f2a97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1053946195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b9d6fd5-a7dc-4e96-ac06-3161123425a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca60da22eddc4711a8ddb7ab04f6bdac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:45Z,use_quota=True,user_id='073076aa29664a38b33a76c2622fd94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:44 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81491634-f987-483d-9cc2-c443f9fbaec0 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92ad1561-2590-4e33-a607-a973e129e052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:44 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81491634-f987-483d-9cc2-c443f9fbaec0 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92ad1561-2590-4e33-a607-a973e129e052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:44 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81491634-f987-483d-9cc2-c443f9fbaec0 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52103b7e-b229-4609-9b0c-811731f0596d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:44 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81491634-f987-483d-9cc2-c443f9fbaec0 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52103b7e-b229-4609-9b0c-811731f0596d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b9d6fd5-a7dc-4e96-ac06-3161123425a7', 'volume_name': 'volume-2b9d6fd5-a7dc-4e96-ac06-3161123425a7', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:44 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81491634-f987-483d-9cc2-c443f9fbaec0 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eddb54e-2017-4aa3-8078-8374a92da84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:44 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81491634-f987-483d-9cc2-c443f9fbaec0 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eddb54e-2017-4aa3-8078-8374a92da84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:44 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81491634-f987-483d-9cc2-c443f9fbaec0 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c12e6030-89e5-482b-bca7-2ad02e0d1610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:44 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-81491634-f987-483d-9cc2-c443f9fbaec0 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Volume 2b9d6fd5-a7dc-4e96-ac06-3161123425a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b9d6fd5-a7dc-4e96-ac06-3161123425a7', 'volume_size': 1} Aug 10 13:07:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-81491634-f987-483d-9cc2-c443f9fbaec0 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-81491634-f987-483d-9cc2-c443f9fbaec0 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:44 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-81491634-f987-483d-9cc2-c443f9fbaec0 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1053946195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b9d6fd5-a7dc-4e96-ac06-3161123425a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca60da22eddc4711a8ddb7ab04f6bdac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:45Z,use_quota=True,user_id='073076aa29664a38b33a76c2622fd94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:07:44 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-81491634-f987-483d-9cc2-c443f9fbaec0 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Creating volume 2b9d6fd5-a7dc-4e96-ac06-3161123425a7 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:07:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-81491634-f987-483d-9cc2-c443f9fbaec0 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-81491634-f987-483d-9cc2-c443f9fbaec0 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:44 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-81491634-f987-483d-9cc2-c443f9fbaec0 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:07:44 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-81491634-f987-483d-9cc2-c443f9fbaec0 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:07:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-81491634-f987-483d-9cc2-c443f9fbaec0 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:44 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-81491634-f987-483d-9cc2-c443f9fbaec0 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:07:44 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-81491634-f987-483d-9cc2-c443f9fbaec0 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:07:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-81491634-f987-483d-9cc2-c443f9fbaec0 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2b9d6fd5-a7dc-4e96-ac06-3161123425a7 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:44 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-28d1e3a8-df30-4d4f-a427-b187535c5af6 tempest-CreateVolumesFromImageTest-775244685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:07:44 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-28d1e3a8-df30-4d4f-a427-b187535c5af6 tempest-CreateVolumesFromImageTest-775244685 None] Flow 'volume_create_manager' (6690f842-0665-45c4-9338-4c7fb28209ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:44 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-28d1e3a8-df30-4d4f-a427-b187535c5af6 tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab4f6eb4-681e-453e-a842-31f9e9c9f62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:44 devstack sudo[108659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2b9d6fd5-a7dc-4e96-ac06-3161123425a7 1073741824 Aug 10 13:07:45 devstack sudo[108659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-28d1e3a8-df30-4d4f-a427-b187535c5af6 tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab4f6eb4-681e-453e-a842-31f9e9c9f62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-425579830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bd29f65-4f5a-4dfd-9fb9-c54e904e1437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099dabcf3c2c4b638cb9daea2753f407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:45Z,use_quota=True,user_id='840f7b965ad8405dbba530f2c88b66cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-28d1e3a8-df30-4d4f-a427-b187535c5af6 tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5d3a1ab-8939-46a7-80f3-0764b515ef3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-28d1e3a8-df30-4d4f-a427-b187535c5af6 tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5d3a1ab-8939-46a7-80f3-0764b515ef3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-28d1e3a8-df30-4d4f-a427-b187535c5af6 tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c2fffc2-cc42-49f8-be27-65eff5df759c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-28d1e3a8-df30-4d4f-a427-b187535c5af6 tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c2fffc2-cc42-49f8-be27-65eff5df759c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bd29f65-4f5a-4dfd-9fb9-c54e904e1437', 'volume_name': 'volume-1bd29f65-4f5a-4dfd-9fb9-c54e904e1437', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-28d1e3a8-df30-4d4f-a427-b187535c5af6 tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67c9d4de-6d5c-4cb7-83fb-0d446f18f2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-28d1e3a8-df30-4d4f-a427-b187535c5af6 tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67c9d4de-6d5c-4cb7-83fb-0d446f18f2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-28d1e3a8-df30-4d4f-a427-b187535c5af6 tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73fbcbd1-ecdb-4a1e-8438-7b25d06e67f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:45 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-28d1e3a8-df30-4d4f-a427-b187535c5af6 tempest-CreateVolumesFromImageTest-775244685 None] Volume 1bd29f65-4f5a-4dfd-9fb9-c54e904e1437: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bd29f65-4f5a-4dfd-9fb9-c54e904e1437', 'volume_size': 1} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-28d1e3a8-df30-4d4f-a427-b187535c5af6 tempest-CreateVolumesFromImageTest-775244685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-21fafd4a-00cd-4024-a3cd-a76c6a146acd tempest-CreateVolumesFromImageTest-775244685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-21fafd4a-00cd-4024-a3cd-a76c6a146acd tempest-CreateVolumesFromImageTest-775244685 None] Flow 'volume_create_manager' (8f67bd05-dd85-48d4-8c95-1b38d3da48c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-21fafd4a-00cd-4024-a3cd-a76c6a146acd tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (142cfe61-4480-4f9a-b251-ac77dc60a98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-21fafd4a-00cd-4024-a3cd-a76c6a146acd tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (142cfe61-4480-4f9a-b251-ac77dc60a98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1217012380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62b0bca5-2afc-4074-985b-2d8b52457b08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099dabcf3c2c4b638cb9daea2753f407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:45Z,use_quota=True,user_id='840f7b965ad8405dbba530f2c88b66cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-21fafd4a-00cd-4024-a3cd-a76c6a146acd tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3704a72d-0c36-4ad0-af45-131d0294c01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-21fafd4a-00cd-4024-a3cd-a76c6a146acd tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3704a72d-0c36-4ad0-af45-131d0294c01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-21fafd4a-00cd-4024-a3cd-a76c6a146acd tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60efa00f-7851-44d1-9a5b-eadebadbcf6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-21fafd4a-00cd-4024-a3cd-a76c6a146acd tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60efa00f-7851-44d1-9a5b-eadebadbcf6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62b0bca5-2afc-4074-985b-2d8b52457b08', 'volume_name': 'volume-62b0bca5-2afc-4074-985b-2d8b52457b08', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-21fafd4a-00cd-4024-a3cd-a76c6a146acd tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d938395-79a0-4481-a01c-51089f869fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-21fafd4a-00cd-4024-a3cd-a76c6a146acd tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d938395-79a0-4481-a01c-51089f869fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-21fafd4a-00cd-4024-a3cd-a76c6a146acd tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc7a3f0-6ada-415c-a944-e2c4f43fbd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:45 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-21fafd4a-00cd-4024-a3cd-a76c6a146acd tempest-CreateVolumesFromImageTest-775244685 None] Volume 62b0bca5-2afc-4074-985b-2d8b52457b08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62b0bca5-2afc-4074-985b-2d8b52457b08', 'volume_size': 1} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-21fafd4a-00cd-4024-a3cd-a76c6a146acd tempest-CreateVolumesFromImageTest-775244685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-953c2204-6fbc-4187-b6db-b18ab3fe9454 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-953c2204-6fbc-4187-b6db-b18ab3fe9454 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Flow 'volume_create_manager' (18c8a4d9-22b8-444a-bb33-720cab55790f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-953c2204-6fbc-4187-b6db-b18ab3fe9454 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80ac7465-8c17-4d7e-893c-c536d4f67550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-953c2204-6fbc-4187-b6db-b18ab3fe9454 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80ac7465-8c17-4d7e-893c-c536d4f67550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1180002706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0caaa217-71bf-4549-9e72-4554f4fbaa1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53f6576b7a0f40c692116c9034dd19cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:45Z,use_quota=True,user_id='9c7096c16fd844c792368b1733d669fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-953c2204-6fbc-4187-b6db-b18ab3fe9454 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c6b61a7-4f00-4a75-954d-2c4d3fc77d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-953c2204-6fbc-4187-b6db-b18ab3fe9454 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c6b61a7-4f00-4a75-954d-2c4d3fc77d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-953c2204-6fbc-4187-b6db-b18ab3fe9454 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20a5aa55-eda6-4295-b7a2-9784f0fce1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-953c2204-6fbc-4187-b6db-b18ab3fe9454 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20a5aa55-eda6-4295-b7a2-9784f0fce1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0caaa217-71bf-4549-9e72-4554f4fbaa1e', 'volume_name': 'volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-953c2204-6fbc-4187-b6db-b18ab3fe9454 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b06d010-9fc3-4251-97a7-5cf7a8ab7007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-953c2204-6fbc-4187-b6db-b18ab3fe9454 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b06d010-9fc3-4251-97a7-5cf7a8ab7007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-953c2204-6fbc-4187-b6db-b18ab3fe9454 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3804bed4-1beb-41c6-8430-882220187886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:45 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-953c2204-6fbc-4187-b6db-b18ab3fe9454 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Volume 0caaa217-71bf-4549-9e72-4554f4fbaa1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e', 'volume_size': 1} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-953c2204-6fbc-4187-b6db-b18ab3fe9454 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:45 devstack sudo[108659]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-81491634-f987-483d-9cc2-c443f9fbaec0 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2b9d6fd5-a7dc-4e96-ac06-3161123425a7 1073741824" returned: 0 in 0.601s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-81491634-f987-483d-9cc2-c443f9fbaec0 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2b9d6fd5-a7dc-4e96-ac06-3161123425a7 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:45 devstack sudo[108665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2b9d6fd5-a7dc-4e96-ac06-3161123425a7 Aug 10 13:07:45 devstack sudo[108665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:45 devstack sudo[108665]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-81491634-f987-483d-9cc2-c443f9fbaec0 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2b9d6fd5-a7dc-4e96-ac06-3161123425a7" returned: 0 in 0.290s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-81491634-f987-483d-9cc2-c443f9fbaec0 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-81491634-f987-483d-9cc2-c443f9fbaec0 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-28d1e3a8-df30-4d4f-a427-b187535c5af6 tempest-CreateVolumesFromImageTest-775244685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.823s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-28d1e3a8-df30-4d4f-a427-b187535c5af6 tempest-CreateVolumesFromImageTest-775244685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-425579830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bd29f65-4f5a-4dfd-9fb9-c54e904e1437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099dabcf3c2c4b638cb9daea2753f407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:45Z,use_quota=True,user_id='840f7b965ad8405dbba530f2c88b66cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-28d1e3a8-df30-4d4f-a427-b187535c5af6 tempest-CreateVolumesFromImageTest-775244685 None] Creating volume 1bd29f65-4f5a-4dfd-9fb9-c54e904e1437 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-28d1e3a8-df30-4d4f-a427-b187535c5af6 tempest-CreateVolumesFromImageTest-775244685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-28d1e3a8-df30-4d4f-a427-b187535c5af6 tempest-CreateVolumesFromImageTest-775244685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-28d1e3a8-df30-4d4f-a427-b187535c5af6 tempest-CreateVolumesFromImageTest-775244685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-28d1e3a8-df30-4d4f-a427-b187535c5af6 tempest-CreateVolumesFromImageTest-775244685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-28d1e3a8-df30-4d4f-a427-b187535c5af6 tempest-CreateVolumesFromImageTest-775244685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-28d1e3a8-df30-4d4f-a427-b187535c5af6 tempest-CreateVolumesFromImageTest-775244685 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:07:45 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-28d1e3a8-df30-4d4f-a427-b187535c5af6 tempest-CreateVolumesFromImageTest-775244685 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-28d1e3a8-df30-4d4f-a427-b187535c5af6 tempest-CreateVolumesFromImageTest-775244685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1bd29f65-4f5a-4dfd-9fb9-c54e904e1437 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81491634-f987-483d-9cc2-c443f9fbaec0 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c12e6030-89e5-482b-bca7-2ad02e0d1610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b9d6fd5-a7dc-4e96-ac06-3161123425a7', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81491634-f987-483d-9cc2-c443f9fbaec0 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f82107c0-162f-4254-a993-357d66117b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:45 devstack sudo[108668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1bd29f65-4f5a-4dfd-9fb9-c54e904e1437 1073741824 Aug 10 13:07:45 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:45 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-81491634-f987-483d-9cc2-c443f9fbaec0 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Volume volume-2b9d6fd5-a7dc-4e96-ac06-3161123425a7 (2b9d6fd5-a7dc-4e96-ac06-3161123425a7): created successfully Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81491634-f987-483d-9cc2-c443f9fbaec0 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f82107c0-162f-4254-a993-357d66117b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81491634-f987-483d-9cc2-c443f9fbaec0 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Flow 'volume_create_manager' (511b22ae-b3b9-4ad0-8ec0-e60b36319f7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:46 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-81491634-f987-483d-9cc2-c443f9fbaec0 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Created volume successfully. Aug 10 13:07:46 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-312c6062-52e9-40db-b6df-1ac47f1bff81 tempest-CreateVolumesFromImageTest-775244685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:07:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-312c6062-52e9-40db-b6df-1ac47f1bff81 tempest-CreateVolumesFromImageTest-775244685 None] Flow 'volume_create_manager' (3ab45684-8252-49ab-8ef7-361459a36428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-312c6062-52e9-40db-b6df-1ac47f1bff81 tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b49fd2ce-b17d-40dd-ae97-918cbb1bb42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-312c6062-52e9-40db-b6df-1ac47f1bff81 tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b49fd2ce-b17d-40dd-ae97-918cbb1bb42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1501245472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61391b1c-3c99-45b8-a72c-54bb66a2a04d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099dabcf3c2c4b638cb9daea2753f407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:46Z,use_quota=True,user_id='840f7b965ad8405dbba530f2c88b66cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-312c6062-52e9-40db-b6df-1ac47f1bff81 tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12860232-5f23-45da-92d3-dcb64c0e70a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-312c6062-52e9-40db-b6df-1ac47f1bff81 tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12860232-5f23-45da-92d3-dcb64c0e70a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-312c6062-52e9-40db-b6df-1ac47f1bff81 tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4410c74b-ad6c-4941-b51a-64c92cf9bf7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-312c6062-52e9-40db-b6df-1ac47f1bff81 tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4410c74b-ad6c-4941-b51a-64c92cf9bf7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61391b1c-3c99-45b8-a72c-54bb66a2a04d', 'volume_name': 'volume-61391b1c-3c99-45b8-a72c-54bb66a2a04d', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-312c6062-52e9-40db-b6df-1ac47f1bff81 tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d34e3f12-78bf-40b8-98f0-72d366ec2246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-312c6062-52e9-40db-b6df-1ac47f1bff81 tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d34e3f12-78bf-40b8-98f0-72d366ec2246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-312c6062-52e9-40db-b6df-1ac47f1bff81 tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e6c18cd-7c2a-4489-ba43-7ba0c7222610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:46 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-312c6062-52e9-40db-b6df-1ac47f1bff81 tempest-CreateVolumesFromImageTest-775244685 None] Volume 61391b1c-3c99-45b8-a72c-54bb66a2a04d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61391b1c-3c99-45b8-a72c-54bb66a2a04d', 'volume_size': 1} Aug 10 13:07:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-312c6062-52e9-40db-b6df-1ac47f1bff81 tempest-CreateVolumesFromImageTest-775244685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:46 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-298d3267-ec89-407f-9a21-6b0cf37f944d tempest-CreateVolumesFromImageTest-775244685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:07:46 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-298d3267-ec89-407f-9a21-6b0cf37f944d tempest-CreateVolumesFromImageTest-775244685 None] Flow 'volume_create_manager' (baa590d7-0008-4a2b-a3c1-51b0255902c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-298d3267-ec89-407f-9a21-6b0cf37f944d tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b83a01a1-b0cb-4ebc-a6f9-2666340b21a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-28d1e3a8-df30-4d4f-a427-b187535c5af6 tempest-CreateVolumesFromImageTest-775244685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1bd29f65-4f5a-4dfd-9fb9-c54e904e1437 1073741824" returned: 0 in 0.637s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-298d3267-ec89-407f-9a21-6b0cf37f944d tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b83a01a1-b0cb-4ebc-a6f9-2666340b21a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1599948992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dbcd67d-0b9e-48c9-94d2-9d847ee1dcf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099dabcf3c2c4b638cb9daea2753f407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:46Z,use_quota=True,user_id='840f7b965ad8405dbba530f2c88b66cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-298d3267-ec89-407f-9a21-6b0cf37f944d tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28079758-8331-4706-bf42-8b069cdd6f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-298d3267-ec89-407f-9a21-6b0cf37f944d tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28079758-8331-4706-bf42-8b069cdd6f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-298d3267-ec89-407f-9a21-6b0cf37f944d tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a23754-b127-4ff5-9dae-d6a67b3e83dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-298d3267-ec89-407f-9a21-6b0cf37f944d tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a23754-b127-4ff5-9dae-d6a67b3e83dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dbcd67d-0b9e-48c9-94d2-9d847ee1dcf8', 'volume_name': 'volume-1dbcd67d-0b9e-48c9-94d2-9d847ee1dcf8', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-298d3267-ec89-407f-9a21-6b0cf37f944d tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b55b876-3bca-47ca-91ab-731b5097c82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-298d3267-ec89-407f-9a21-6b0cf37f944d tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b55b876-3bca-47ca-91ab-731b5097c82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-298d3267-ec89-407f-9a21-6b0cf37f944d tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a9bf1cc-5477-4340-86a3-34bd6d273028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:46 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-298d3267-ec89-407f-9a21-6b0cf37f944d tempest-CreateVolumesFromImageTest-775244685 None] Volume 1dbcd67d-0b9e-48c9-94d2-9d847ee1dcf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dbcd67d-0b9e-48c9-94d2-9d847ee1dcf8', 'volume_size': 1} Aug 10 13:07:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-298d3267-ec89-407f-9a21-6b0cf37f944d tempest-CreateVolumesFromImageTest-775244685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-28d1e3a8-df30-4d4f-a427-b187535c5af6 tempest-CreateVolumesFromImageTest-775244685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1bd29f65-4f5a-4dfd-9fb9-c54e904e1437 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:46 devstack sudo[108673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1bd29f65-4f5a-4dfd-9fb9-c54e904e1437 Aug 10 13:07:46 devstack sudo[108673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:46 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cb2289f-da0c-4c42-9f91-721bbc20b49b tempest-CreateVolumesFromImageTest-775244685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:07:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6cb2289f-da0c-4c42-9f91-721bbc20b49b tempest-CreateVolumesFromImageTest-775244685 None] Flow 'volume_create_manager' (a06efd32-d45a-4036-959c-007afa07d0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6cb2289f-da0c-4c42-9f91-721bbc20b49b tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f148ecf-24ed-4881-8ea9-ddcc34b6f4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6cb2289f-da0c-4c42-9f91-721bbc20b49b tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f148ecf-24ed-4881-8ea9-ddcc34b6f4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1901481686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90e298f2-e37b-45a3-8727-354196410ef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099dabcf3c2c4b638cb9daea2753f407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:47Z,use_quota=True,user_id='840f7b965ad8405dbba530f2c88b66cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6cb2289f-da0c-4c42-9f91-721bbc20b49b tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (821cf3f9-aaf2-4fa0-a4bb-483432e9160f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6cb2289f-da0c-4c42-9f91-721bbc20b49b tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (821cf3f9-aaf2-4fa0-a4bb-483432e9160f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6cb2289f-da0c-4c42-9f91-721bbc20b49b tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736e57a1-e8ad-4820-8619-689f010b4174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6cb2289f-da0c-4c42-9f91-721bbc20b49b tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736e57a1-e8ad-4820-8619-689f010b4174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90e298f2-e37b-45a3-8727-354196410ef2', 'volume_name': 'volume-90e298f2-e37b-45a3-8727-354196410ef2', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6cb2289f-da0c-4c42-9f91-721bbc20b49b tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e634dc05-5110-42e1-9d36-5744c910b5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6cb2289f-da0c-4c42-9f91-721bbc20b49b tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e634dc05-5110-42e1-9d36-5744c910b5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6cb2289f-da0c-4c42-9f91-721bbc20b49b tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f7f835d-495a-4772-bac6-86af9504f6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:47 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-6cb2289f-da0c-4c42-9f91-721bbc20b49b tempest-CreateVolumesFromImageTest-775244685 None] Volume 90e298f2-e37b-45a3-8727-354196410ef2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90e298f2-e37b-45a3-8727-354196410ef2', 'volume_size': 1} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6cb2289f-da0c-4c42-9f91-721bbc20b49b tempest-CreateVolumesFromImageTest-775244685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:47 devstack sudo[108673]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-28d1e3a8-df30-4d4f-a427-b187535c5af6 tempest-CreateVolumesFromImageTest-775244685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1bd29f65-4f5a-4dfd-9fb9-c54e904e1437" returned: 0 in 0.414s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-28d1e3a8-df30-4d4f-a427-b187535c5af6 tempest-CreateVolumesFromImageTest-775244685 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-28d1e3a8-df30-4d4f-a427-b187535c5af6 tempest-CreateVolumesFromImageTest-775244685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-21fafd4a-00cd-4024-a3cd-a76c6a146acd tempest-CreateVolumesFromImageTest-775244685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.836s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-21fafd4a-00cd-4024-a3cd-a76c6a146acd tempest-CreateVolumesFromImageTest-775244685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1217012380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62b0bca5-2afc-4074-985b-2d8b52457b08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099dabcf3c2c4b638cb9daea2753f407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:45Z,use_quota=True,user_id='840f7b965ad8405dbba530f2c88b66cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-21fafd4a-00cd-4024-a3cd-a76c6a146acd tempest-CreateVolumesFromImageTest-775244685 None] Creating volume 62b0bca5-2afc-4074-985b-2d8b52457b08 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-21fafd4a-00cd-4024-a3cd-a76c6a146acd tempest-CreateVolumesFromImageTest-775244685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-21fafd4a-00cd-4024-a3cd-a76c6a146acd tempest-CreateVolumesFromImageTest-775244685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-21fafd4a-00cd-4024-a3cd-a76c6a146acd tempest-CreateVolumesFromImageTest-775244685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-21fafd4a-00cd-4024-a3cd-a76c6a146acd tempest-CreateVolumesFromImageTest-775244685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-21fafd4a-00cd-4024-a3cd-a76c6a146acd tempest-CreateVolumesFromImageTest-775244685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-21fafd4a-00cd-4024-a3cd-a76c6a146acd tempest-CreateVolumesFromImageTest-775244685 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:07:47 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-21fafd4a-00cd-4024-a3cd-a76c6a146acd tempest-CreateVolumesFromImageTest-775244685 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-21fafd4a-00cd-4024-a3cd-a76c6a146acd tempest-CreateVolumesFromImageTest-775244685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-62b0bca5-2afc-4074-985b-2d8b52457b08 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-28d1e3a8-df30-4d4f-a427-b187535c5af6 tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73fbcbd1-ecdb-4a1e-8438-7b25d06e67f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bd29f65-4f5a-4dfd-9fb9-c54e904e1437', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:47 devstack sudo[108676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-62b0bca5-2afc-4074-985b-2d8b52457b08 1073741824 Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-28d1e3a8-df30-4d4f-a427-b187535c5af6 tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64b7a789-50ed-40e8-8f00-d492127cccdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:47 devstack sudo[108676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:47 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-28d1e3a8-df30-4d4f-a427-b187535c5af6 tempest-CreateVolumesFromImageTest-775244685 None] Volume volume-1bd29f65-4f5a-4dfd-9fb9-c54e904e1437 (1bd29f65-4f5a-4dfd-9fb9-c54e904e1437): created successfully Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-28d1e3a8-df30-4d4f-a427-b187535c5af6 tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64b7a789-50ed-40e8-8f00-d492127cccdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-28d1e3a8-df30-4d4f-a427-b187535c5af6 tempest-CreateVolumesFromImageTest-775244685 None] Flow 'volume_create_manager' (6690f842-0665-45c4-9338-4c7fb28209ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:47 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-28d1e3a8-df30-4d4f-a427-b187535c5af6 tempest-CreateVolumesFromImageTest-775244685 None] Created volume successfully. Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8cc7187-a50c-4327-a87e-31900152475a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b8cc7187-a50c-4327-a87e-31900152475a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Flow 'volume_create_manager' (8c101bb4-449d-4e6d-bd27-518bb30a8e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b8cc7187-a50c-4327-a87e-31900152475a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c4c110e-7455-4081-9724-c3e8ada5250a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b8cc7187-a50c-4327-a87e-31900152475a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c4c110e-7455-4081-9724-c3e8ada5250a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1438019421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=390bf0aa-cfd1-4681-9698-b4a79d9db2c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca60da22eddc4711a8ddb7ab04f6bdac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:47Z,use_quota=True,user_id='073076aa29664a38b33a76c2622fd94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b8cc7187-a50c-4327-a87e-31900152475a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde17ac1-502d-47bb-82e8-020420c87150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b8cc7187-a50c-4327-a87e-31900152475a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde17ac1-502d-47bb-82e8-020420c87150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b8cc7187-a50c-4327-a87e-31900152475a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac92bcdf-f523-4859-aa95-f8ae001d1983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b8cc7187-a50c-4327-a87e-31900152475a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac92bcdf-f523-4859-aa95-f8ae001d1983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '390bf0aa-cfd1-4681-9698-b4a79d9db2c8', 'volume_name': 'volume-390bf0aa-cfd1-4681-9698-b4a79d9db2c8', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b8cc7187-a50c-4327-a87e-31900152475a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4604344-67c2-4e37-a8c8-4e8cc4f48d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b8cc7187-a50c-4327-a87e-31900152475a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4604344-67c2-4e37-a8c8-4e8cc4f48d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b8cc7187-a50c-4327-a87e-31900152475a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00fc3536-fb03-490e-9423-3d511e4a4d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:47 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-b8cc7187-a50c-4327-a87e-31900152475a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Volume 390bf0aa-cfd1-4681-9698-b4a79d9db2c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-390bf0aa-cfd1-4681-9698-b4a79d9db2c8', 'volume_size': 1} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b8cc7187-a50c-4327-a87e-31900152475a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-7335f8a1-40e3-4dfc-8134-33755c952479 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:07:47 devstack sudo[108676]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7335f8a1-40e3-4dfc-8134-33755c952479 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Flow 'volume_create_manager' (96550ff3-9bab-494f-b867-86ef8f7556ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7335f8a1-40e3-4dfc-8134-33755c952479 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (337056c7-3762-4f9e-a6e4-f17b2b1f5038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-21fafd4a-00cd-4024-a3cd-a76c6a146acd tempest-CreateVolumesFromImageTest-775244685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-62b0bca5-2afc-4074-985b-2d8b52457b08 1073741824" returned: 0 in 0.729s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7335f8a1-40e3-4dfc-8134-33755c952479 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (337056c7-3762-4f9e-a6e4-f17b2b1f5038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2063040932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a36f7d9b-f643-40c5-93ee-17a12cb01857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca60da22eddc4711a8ddb7ab04f6bdac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:48Z,use_quota=True,user_id='073076aa29664a38b33a76c2622fd94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7335f8a1-40e3-4dfc-8134-33755c952479 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff95560-daf8-4de8-8b16-35eb9881de8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7335f8a1-40e3-4dfc-8134-33755c952479 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff95560-daf8-4de8-8b16-35eb9881de8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7335f8a1-40e3-4dfc-8134-33755c952479 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75add8e3-2a78-4687-bed8-4c0b6ea9eb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7335f8a1-40e3-4dfc-8134-33755c952479 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75add8e3-2a78-4687-bed8-4c0b6ea9eb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a36f7d9b-f643-40c5-93ee-17a12cb01857', 'volume_name': 'volume-a36f7d9b-f643-40c5-93ee-17a12cb01857', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7335f8a1-40e3-4dfc-8134-33755c952479 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a185347e-6f9e-422c-9a21-aef18c8196bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7335f8a1-40e3-4dfc-8134-33755c952479 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a185347e-6f9e-422c-9a21-aef18c8196bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7335f8a1-40e3-4dfc-8134-33755c952479 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6a81f0b-c7cb-4c60-87dc-29438b8c458b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:47 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-7335f8a1-40e3-4dfc-8134-33755c952479 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Volume a36f7d9b-f643-40c5-93ee-17a12cb01857: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a36f7d9b-f643-40c5-93ee-17a12cb01857', 'volume_size': 1} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7335f8a1-40e3-4dfc-8134-33755c952479 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-21fafd4a-00cd-4024-a3cd-a76c6a146acd tempest-CreateVolumesFromImageTest-775244685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-62b0bca5-2afc-4074-985b-2d8b52457b08 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:47 devstack sudo[108682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-62b0bca5-2afc-4074-985b-2d8b52457b08 Aug 10 13:07:47 devstack sudo[108682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-762571f6-099d-485d-bc75-a3eba7500f07 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:07:48 devstack sudo[108682]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-762571f6-099d-485d-bc75-a3eba7500f07 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Flow 'volume_create_manager' (cc768661-073d-4947-b17a-fea1abcd3cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-762571f6-099d-485d-bc75-a3eba7500f07 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d2912be-8e6c-40aa-bef4-b8601bba6394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-21fafd4a-00cd-4024-a3cd-a76c6a146acd tempest-CreateVolumesFromImageTest-775244685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-62b0bca5-2afc-4074-985b-2d8b52457b08" returned: 0 in 0.349s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-21fafd4a-00cd-4024-a3cd-a76c6a146acd tempest-CreateVolumesFromImageTest-775244685 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-21fafd4a-00cd-4024-a3cd-a76c6a146acd tempest-CreateVolumesFromImageTest-775244685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-953c2204-6fbc-4187-b6db-b18ab3fe9454 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.845s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-953c2204-6fbc-4187-b6db-b18ab3fe9454 tempest-CreateVolumesFromSnapshotTest-1515277745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1180002706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0caaa217-71bf-4549-9e72-4554f4fbaa1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53f6576b7a0f40c692116c9034dd19cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:45Z,use_quota=True,user_id='9c7096c16fd844c792368b1733d669fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-953c2204-6fbc-4187-b6db-b18ab3fe9454 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Creating volume 0caaa217-71bf-4549-9e72-4554f4fbaa1e {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-953c2204-6fbc-4187-b6db-b18ab3fe9454 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-953c2204-6fbc-4187-b6db-b18ab3fe9454 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-953c2204-6fbc-4187-b6db-b18ab3fe9454 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-953c2204-6fbc-4187-b6db-b18ab3fe9454 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-953c2204-6fbc-4187-b6db-b18ab3fe9454 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-953c2204-6fbc-4187-b6db-b18ab3fe9454 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:07:48 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-953c2204-6fbc-4187-b6db-b18ab3fe9454 tempest-CreateVolumesFromSnapshotTest-1515277745 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-953c2204-6fbc-4187-b6db-b18ab3fe9454 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-21fafd4a-00cd-4024-a3cd-a76c6a146acd tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc7a3f0-6ada-415c-a944-e2c4f43fbd5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62b0bca5-2afc-4074-985b-2d8b52457b08', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-21fafd4a-00cd-4024-a3cd-a76c6a146acd tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4df30211-2fe4-4787-a506-3d586a2fa590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:48 devstack sudo[108685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e 1073741824 Aug 10 13:07:48 devstack sudo[108685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-762571f6-099d-485d-bc75-a3eba7500f07 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d2912be-8e6c-40aa-bef4-b8601bba6394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1645359912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfa86910-fb1f-4567-936b-6c24f0674415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca60da22eddc4711a8ddb7ab04f6bdac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:48Z,use_quota=True,user_id='073076aa29664a38b33a76c2622fd94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-762571f6-099d-485d-bc75-a3eba7500f07 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0decf98c-190f-4952-abd5-0d5059a04af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-762571f6-099d-485d-bc75-a3eba7500f07 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0decf98c-190f-4952-abd5-0d5059a04af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-762571f6-099d-485d-bc75-a3eba7500f07 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08470f90-34fc-4f98-abf3-36a07fbea078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-762571f6-099d-485d-bc75-a3eba7500f07 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08470f90-34fc-4f98-abf3-36a07fbea078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfa86910-fb1f-4567-936b-6c24f0674415', 'volume_name': 'volume-cfa86910-fb1f-4567-936b-6c24f0674415', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-762571f6-099d-485d-bc75-a3eba7500f07 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd212487-44d6-4937-9863-fada62eaad24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-762571f6-099d-485d-bc75-a3eba7500f07 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd212487-44d6-4937-9863-fada62eaad24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-762571f6-099d-485d-bc75-a3eba7500f07 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e93003fa-3c14-4b0c-9ef1-b422104f1d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:48 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-762571f6-099d-485d-bc75-a3eba7500f07 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Volume cfa86910-fb1f-4567-936b-6c24f0674415: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfa86910-fb1f-4567-936b-6c24f0674415', 'volume_size': 1} Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-762571f6-099d-485d-bc75-a3eba7500f07 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:48 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-21fafd4a-00cd-4024-a3cd-a76c6a146acd tempest-CreateVolumesFromImageTest-775244685 None] Volume volume-62b0bca5-2afc-4074-985b-2d8b52457b08 (62b0bca5-2afc-4074-985b-2d8b52457b08): created successfully Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-21fafd4a-00cd-4024-a3cd-a76c6a146acd tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4df30211-2fe4-4787-a506-3d586a2fa590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-21fafd4a-00cd-4024-a3cd-a76c6a146acd tempest-CreateVolumesFromImageTest-775244685 None] Flow 'volume_create_manager' (8f67bd05-dd85-48d4-8c95-1b38d3da48c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:48 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-21fafd4a-00cd-4024-a3cd-a76c6a146acd tempest-CreateVolumesFromImageTest-775244685 None] Created volume successfully. Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb441699-447a-46f6-b383-619983907e27 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-cb441699-447a-46f6-b383-619983907e27 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Flow 'volume_create_manager' (0123e443-7e75-44ca-adf5-eeb5219c4e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-cb441699-447a-46f6-b383-619983907e27 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ad548ef-4f89-484e-acc6-39546694344a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-cb441699-447a-46f6-b383-619983907e27 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ad548ef-4f89-484e-acc6-39546694344a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-527163699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a8fe1a1-6d55-4054-bb65-61f10aeb879d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca60da22eddc4711a8ddb7ab04f6bdac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:48Z,use_quota=True,user_id='073076aa29664a38b33a76c2622fd94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-cb441699-447a-46f6-b383-619983907e27 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb86cfcf-d620-4223-bc1b-56d8f01cb1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-cb441699-447a-46f6-b383-619983907e27 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb86cfcf-d620-4223-bc1b-56d8f01cb1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-cb441699-447a-46f6-b383-619983907e27 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c21904b-805d-4d13-b103-560adf3fde72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-cb441699-447a-46f6-b383-619983907e27 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c21904b-805d-4d13-b103-560adf3fde72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a8fe1a1-6d55-4054-bb65-61f10aeb879d', 'volume_name': 'volume-9a8fe1a1-6d55-4054-bb65-61f10aeb879d', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-cb441699-447a-46f6-b383-619983907e27 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48f973fe-2436-4377-8c63-ff8ea4c2bd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-cb441699-447a-46f6-b383-619983907e27 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48f973fe-2436-4377-8c63-ff8ea4c2bd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-cb441699-447a-46f6-b383-619983907e27 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b115c89b-84de-47c6-a9b4-24f6facca297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:48 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-cb441699-447a-46f6-b383-619983907e27 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Volume 9a8fe1a1-6d55-4054-bb65-61f10aeb879d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a8fe1a1-6d55-4054-bb65-61f10aeb879d', 'volume_size': 1} Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-cb441699-447a-46f6-b383-619983907e27 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a30ff9f-47e9-40e5-9d62-f61fdf285d00 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6a30ff9f-47e9-40e5-9d62-f61fdf285d00 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Flow 'volume_create_manager' (5264efd4-e514-4599-a743-eabf9e3fb953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6a30ff9f-47e9-40e5-9d62-f61fdf285d00 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e623d56-db6f-4fd6-9b55-3afc23a33968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:48 devstack sudo[108685]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6a30ff9f-47e9-40e5-9d62-f61fdf285d00 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e623d56-db6f-4fd6-9b55-3afc23a33968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-320587299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a66cbd-8526-4bcc-9c7a-8e859aed818c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca60da22eddc4711a8ddb7ab04f6bdac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:49Z,use_quota=True,user_id='073076aa29664a38b33a76c2622fd94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6a30ff9f-47e9-40e5-9d62-f61fdf285d00 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b9c7b79-bab0-4f28-825d-b25418c5813d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6a30ff9f-47e9-40e5-9d62-f61fdf285d00 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b9c7b79-bab0-4f28-825d-b25418c5813d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6a30ff9f-47e9-40e5-9d62-f61fdf285d00 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d2acde8-f34a-4105-83a7-c86021a8cd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6a30ff9f-47e9-40e5-9d62-f61fdf285d00 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d2acde8-f34a-4105-83a7-c86021a8cd60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6a66cbd-8526-4bcc-9c7a-8e859aed818c', 'volume_name': 'volume-a6a66cbd-8526-4bcc-9c7a-8e859aed818c', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6a30ff9f-47e9-40e5-9d62-f61fdf285d00 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf9df7c-1d8d-47fb-837a-bcc9141bb121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6a30ff9f-47e9-40e5-9d62-f61fdf285d00 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf9df7c-1d8d-47fb-837a-bcc9141bb121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6a30ff9f-47e9-40e5-9d62-f61fdf285d00 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e71a4078-2f32-403b-862b-a83421949aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:49 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-6a30ff9f-47e9-40e5-9d62-f61fdf285d00 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Volume a6a66cbd-8526-4bcc-9c7a-8e859aed818c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6a66cbd-8526-4bcc-9c7a-8e859aed818c', 'volume_size': 1} Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6a30ff9f-47e9-40e5-9d62-f61fdf285d00 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-953c2204-6fbc-4187-b6db-b18ab3fe9454 tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e 1073741824" returned: 0 in 0.722s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-953c2204-6fbc-4187-b6db-b18ab3fe9454 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:49 devstack sudo[108692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e Aug 10 13:07:49 devstack sudo[108692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:49 devstack sudo[108692]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-953c2204-6fbc-4187-b6db-b18ab3fe9454 tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e" returned: 0 in 0.256s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-953c2204-6fbc-4187-b6db-b18ab3fe9454 tempest-CreateVolumesFromSnapshotTest-1515277745 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-953c2204-6fbc-4187-b6db-b18ab3fe9454 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-312c6062-52e9-40db-b6df-1ac47f1bff81 tempest-CreateVolumesFromImageTest-775244685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.168s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-312c6062-52e9-40db-b6df-1ac47f1bff81 tempest-CreateVolumesFromImageTest-775244685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1501245472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61391b1c-3c99-45b8-a72c-54bb66a2a04d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099dabcf3c2c4b638cb9daea2753f407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:46Z,use_quota=True,user_id='840f7b965ad8405dbba530f2c88b66cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-312c6062-52e9-40db-b6df-1ac47f1bff81 tempest-CreateVolumesFromImageTest-775244685 None] Creating volume 61391b1c-3c99-45b8-a72c-54bb66a2a04d {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-312c6062-52e9-40db-b6df-1ac47f1bff81 tempest-CreateVolumesFromImageTest-775244685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-312c6062-52e9-40db-b6df-1ac47f1bff81 tempest-CreateVolumesFromImageTest-775244685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-312c6062-52e9-40db-b6df-1ac47f1bff81 tempest-CreateVolumesFromImageTest-775244685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-312c6062-52e9-40db-b6df-1ac47f1bff81 tempest-CreateVolumesFromImageTest-775244685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-312c6062-52e9-40db-b6df-1ac47f1bff81 tempest-CreateVolumesFromImageTest-775244685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-312c6062-52e9-40db-b6df-1ac47f1bff81 tempest-CreateVolumesFromImageTest-775244685 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:07:49 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-312c6062-52e9-40db-b6df-1ac47f1bff81 tempest-CreateVolumesFromImageTest-775244685 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-312c6062-52e9-40db-b6df-1ac47f1bff81 tempest-CreateVolumesFromImageTest-775244685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-61391b1c-3c99-45b8-a72c-54bb66a2a04d 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:49 devstack sudo[108695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-61391b1c-3c99-45b8-a72c-54bb66a2a04d 1073741824 Aug 10 13:07:49 devstack sudo[108695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-953c2204-6fbc-4187-b6db-b18ab3fe9454 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3804bed4-1beb-41c6-8430-882220187886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-953c2204-6fbc-4187-b6db-b18ab3fe9454 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8afe996d-ca7f-4fc3-83df-a17b810391ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:49 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-953c2204-6fbc-4187-b6db-b18ab3fe9454 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Volume volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e (0caaa217-71bf-4549-9e72-4554f4fbaa1e): created successfully Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-953c2204-6fbc-4187-b6db-b18ab3fe9454 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8afe996d-ca7f-4fc3-83df-a17b810391ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-953c2204-6fbc-4187-b6db-b18ab3fe9454 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Flow 'volume_create_manager' (18c8a4d9-22b8-444a-bb33-720cab55790f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Flow 'volume_create_manager' (def75c87-c1b8-4840-b314-3fe11f7ebf9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c410263-1f4b-4a92-8640-f1dbec6cb488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:49 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-953c2204-6fbc-4187-b6db-b18ab3fe9454 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Created volume successfully. Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c410263-1f4b-4a92-8640-f1dbec6cb488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cface6a3-621c-4652-8f57-97160aab1e62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3985da827b3846c89088f34461297c5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:49Z,use_quota=True,user_id='0cb899ca5895418cbb012fd5968ef3ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(738696ea-8851-4ed0-bed4-64449eccdc0a),volume_type_id=738696ea-8851-4ed0-bed4-64449eccdc0a)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (625f495d-d15e-4f18-9ca8-61948887dc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (625f495d-d15e-4f18-9ca8-61948887dc45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4641b427-beda-4c33-88ea-b77809b209f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG cinder.image.glance [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Creating Keystone auth plugin from conf {{(pid=89096) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4641b427-beda-4c33-88ea-b77809b209f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cface6a3-621c-4652-8f57-97160aab1e62', 'volume_name': 'volume-cface6a3-621c-4652-8f57-97160aab1e62', 'volume_size': 1, 'image_id': '5cc72b8f-917b-4e61-9345-d0d1361d99d2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5cc72b8f-917b-4e61-9345-d0d1361d99d2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0d1337b60149655efb302abbf7e0463a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3985da827b3846c89088f34461297c5e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dd8e716adea9a2b8f31c1dec4595b632dcb53d1144a80d45901b71f80f396b9596f4ff0d0ba4dcac5f5e318c7a64723e49342b96658b428129d04a7a1bb16e34', 'id': '5cc72b8f-917b-4e61-9345-d0d1361d99d2', 'created_at': datetime.datetime(2026, 8, 10, 11, 7, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 11, 7, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5cc72b8f-917b-4e61-9345-d0d1361d99d2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5c7d3de-15e6-45da-b8b8-067d8041329e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5c7d3de-15e6-45da-b8b8-067d8041329e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fd7fbdc-35af-4005-8bb4-0560bc93de1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:49 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Volume cface6a3-621c-4652-8f57-97160aab1e62: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cface6a3-621c-4652-8f57-97160aab1e62', 'volume_size': 1, 'image_id': '5cc72b8f-917b-4e61-9345-d0d1361d99d2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5cc72b8f-917b-4e61-9345-d0d1361d99d2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0d1337b60149655efb302abbf7e0463a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3985da827b3846c89088f34461297c5e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dd8e716adea9a2b8f31c1dec4595b632dcb53d1144a80d45901b71f80f396b9596f4ff0d0ba4dcac5f5e318c7a64723e49342b96658b428129d04a7a1bb16e34', 'id': '5cc72b8f-917b-4e61-9345-d0d1361d99d2', 'created_at': datetime.datetime(2026, 8, 10, 11, 7, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 11, 7, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5cc72b8f-917b-4e61-9345-d0d1361d99d2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Trying to clone cface6a3-621c-4652-8f57-97160aab1e62 from image 5cc72b8f-917b-4e61-9345-d0d1361d99d2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5cc72b8f-917b-4e61-9345-d0d1361d99d2', 'metadata': {}}]). {{(pid=89096) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 10 13:07:49 devstack sudo[108695]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-312c6062-52e9-40db-b6df-1ac47f1bff81 tempest-CreateVolumesFromImageTest-775244685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-61391b1c-3c99-45b8-a72c-54bb66a2a04d 1073741824" returned: 0 in 0.433s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5cc72b8f-917b-4e61-9345-d0d1361d99d2_fseqa521devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89096) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 10 13:07:49 devstack cinder-volume[89096]: INFO cinder.image.image_utils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Image download 0.00 MB at 0.00 MB/s Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-312c6062-52e9-40db-b6df-1ac47f1bff81 tempest-CreateVolumesFromImageTest-775244685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-61391b1c-3c99-45b8-a72c-54bb66a2a04d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:49 devstack sudo[108701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-61391b1c-3c99-45b8-a72c-54bb66a2a04d Aug 10 13:07:49 devstack sudo[108701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1699f5-57aa-4f5c-b78d-ee2ff868d79f]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:07:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5cc72b8f-917b-4e61-9345-d0d1361d99d2_fseqa521devstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:49 devstack sudo[108703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5cc72b8f-917b-4e61-9345-d0d1361d99d2_fseqa521devstack@QuobyteHD Aug 10 13:07:49 devstack sudo[108703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:50 devstack sudo[108701]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-312c6062-52e9-40db-b6df-1ac47f1bff81 tempest-CreateVolumesFromImageTest-775244685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-61391b1c-3c99-45b8-a72c-54bb66a2a04d" returned: 0 in 0.300s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-312c6062-52e9-40db-b6df-1ac47f1bff81 tempest-CreateVolumesFromImageTest-775244685 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-312c6062-52e9-40db-b6df-1ac47f1bff81 tempest-CreateVolumesFromImageTest-775244685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-298d3267-ec89-407f-9a21-6b0cf37f944d tempest-CreateVolumesFromImageTest-775244685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.515s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-298d3267-ec89-407f-9a21-6b0cf37f944d tempest-CreateVolumesFromImageTest-775244685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1599948992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dbcd67d-0b9e-48c9-94d2-9d847ee1dcf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099dabcf3c2c4b638cb9daea2753f407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:46Z,use_quota=True,user_id='840f7b965ad8405dbba530f2c88b66cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-298d3267-ec89-407f-9a21-6b0cf37f944d tempest-CreateVolumesFromImageTest-775244685 None] Creating volume 1dbcd67d-0b9e-48c9-94d2-9d847ee1dcf8 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-298d3267-ec89-407f-9a21-6b0cf37f944d tempest-CreateVolumesFromImageTest-775244685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-298d3267-ec89-407f-9a21-6b0cf37f944d tempest-CreateVolumesFromImageTest-775244685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-298d3267-ec89-407f-9a21-6b0cf37f944d tempest-CreateVolumesFromImageTest-775244685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-298d3267-ec89-407f-9a21-6b0cf37f944d tempest-CreateVolumesFromImageTest-775244685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-298d3267-ec89-407f-9a21-6b0cf37f944d tempest-CreateVolumesFromImageTest-775244685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-298d3267-ec89-407f-9a21-6b0cf37f944d tempest-CreateVolumesFromImageTest-775244685 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:07:50 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-298d3267-ec89-407f-9a21-6b0cf37f944d tempest-CreateVolumesFromImageTest-775244685 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-298d3267-ec89-407f-9a21-6b0cf37f944d tempest-CreateVolumesFromImageTest-775244685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1dbcd67d-0b9e-48c9-94d2-9d847ee1dcf8 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:50 devstack sudo[108706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1dbcd67d-0b9e-48c9-94d2-9d847ee1dcf8 1073741824 Aug 10 13:07:50 devstack sudo[108706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-312c6062-52e9-40db-b6df-1ac47f1bff81 tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e6c18cd-7c2a-4489-ba43-7ba0c7222610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61391b1c-3c99-45b8-a72c-54bb66a2a04d', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-312c6062-52e9-40db-b6df-1ac47f1bff81 tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43c46bd5-9328-4c2a-91a1-12a771fe7c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-fb4831a2-01fb-4e40-9705-7103d0696942 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:50 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-312c6062-52e9-40db-b6df-1ac47f1bff81 tempest-CreateVolumesFromImageTest-775244685 None] Volume volume-61391b1c-3c99-45b8-a72c-54bb66a2a04d (61391b1c-3c99-45b8-a72c-54bb66a2a04d): created successfully Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-312c6062-52e9-40db-b6df-1ac47f1bff81 tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43c46bd5-9328-4c2a-91a1-12a771fe7c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-312c6062-52e9-40db-b6df-1ac47f1bff81 tempest-CreateVolumesFromImageTest-775244685 None] Flow 'volume_create_manager' (3ab45684-8252-49ab-8ef7-361459a36428) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:50 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-312c6062-52e9-40db-b6df-1ac47f1bff81 tempest-CreateVolumesFromImageTest-775244685 None] Created volume successfully. Aug 10 13:07:50 devstack sudo[108703]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5cc72b8f-917b-4e61-9345-d0d1361d99d2_fseqa521devstack@QuobyteHD" returned: 0 in 0.396s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5cc72b8f-917b-4e61-9345-d0d1361d99d2_fseqa521devstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:50 devstack sudo[108710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5cc72b8f-917b-4e61-9345-d0d1361d99d2_fseqa521devstack@QuobyteHD Aug 10 13:07:50 devstack sudo[108710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:50 devstack sudo[108706]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-298d3267-ec89-407f-9a21-6b0cf37f944d tempest-CreateVolumesFromImageTest-775244685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1dbcd67d-0b9e-48c9-94d2-9d847ee1dcf8 1073741824" returned: 0 in 0.400s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-298d3267-ec89-407f-9a21-6b0cf37f944d tempest-CreateVolumesFromImageTest-775244685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1dbcd67d-0b9e-48c9-94d2-9d847ee1dcf8 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:50 devstack sudo[108710]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:50 devstack sudo[108719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1dbcd67d-0b9e-48c9-94d2-9d847ee1dcf8 Aug 10 13:07:50 devstack sudo[108719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5cc72b8f-917b-4e61-9345-d0d1361d99d2_fseqa521devstack@QuobyteHD" returned: 1 in 0.355s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5cc72b8f-917b-4e61-9345-d0d1361d99d2_fseqa521devstack@QuobyteHD' failed. Not Retrying. {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Temporary image 5cc72b8f-917b-4e61-9345-d0d1361d99d2 is fetched for user 0cb899ca5895418cbb012fd5968ef3ad. {{(pid=89096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[d412a26e-1752-4f3f-a669-543718409c1e]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5cc72b8f-917b-4e61-9345-d0d1361d99d2_fseqa521devstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:50 devstack sudo[108721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5cc72b8f-917b-4e61-9345-d0d1361d99d2_fseqa521devstack@QuobyteHD Aug 10 13:07:50 devstack sudo[108721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:50 devstack sudo[108719]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-298d3267-ec89-407f-9a21-6b0cf37f944d tempest-CreateVolumesFromImageTest-775244685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1dbcd67d-0b9e-48c9-94d2-9d847ee1dcf8" returned: 0 in 0.261s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-298d3267-ec89-407f-9a21-6b0cf37f944d tempest-CreateVolumesFromImageTest-775244685 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-298d3267-ec89-407f-9a21-6b0cf37f944d tempest-CreateVolumesFromImageTest-775244685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6cb2289f-da0c-4c42-9f91-721bbc20b49b tempest-CreateVolumesFromImageTest-775244685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.801s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6cb2289f-da0c-4c42-9f91-721bbc20b49b tempest-CreateVolumesFromImageTest-775244685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1901481686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90e298f2-e37b-45a3-8727-354196410ef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099dabcf3c2c4b638cb9daea2753f407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:47Z,use_quota=True,user_id='840f7b965ad8405dbba530f2c88b66cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-6cb2289f-da0c-4c42-9f91-721bbc20b49b tempest-CreateVolumesFromImageTest-775244685 None] Creating volume 90e298f2-e37b-45a3-8727-354196410ef2 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6cb2289f-da0c-4c42-9f91-721bbc20b49b tempest-CreateVolumesFromImageTest-775244685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6cb2289f-da0c-4c42-9f91-721bbc20b49b tempest-CreateVolumesFromImageTest-775244685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6cb2289f-da0c-4c42-9f91-721bbc20b49b tempest-CreateVolumesFromImageTest-775244685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6cb2289f-da0c-4c42-9f91-721bbc20b49b tempest-CreateVolumesFromImageTest-775244685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6cb2289f-da0c-4c42-9f91-721bbc20b49b tempest-CreateVolumesFromImageTest-775244685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6cb2289f-da0c-4c42-9f91-721bbc20b49b tempest-CreateVolumesFromImageTest-775244685 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:07:50 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-6cb2289f-da0c-4c42-9f91-721bbc20b49b tempest-CreateVolumesFromImageTest-775244685 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6cb2289f-da0c-4c42-9f91-721bbc20b49b tempest-CreateVolumesFromImageTest-775244685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-90e298f2-e37b-45a3-8727-354196410ef2 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-298d3267-ec89-407f-9a21-6b0cf37f944d tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a9bf1cc-5477-4340-86a3-34bd6d273028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dbcd67d-0b9e-48c9-94d2-9d847ee1dcf8', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:50 devstack sudo[108724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-90e298f2-e37b-45a3-8727-354196410ef2 1073741824 Aug 10 13:07:50 devstack sudo[108724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-298d3267-ec89-407f-9a21-6b0cf37f944d tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29fe851c-6d42-4c05-a209-0a7b813b162c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:50 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-298d3267-ec89-407f-9a21-6b0cf37f944d tempest-CreateVolumesFromImageTest-775244685 None] Volume volume-1dbcd67d-0b9e-48c9-94d2-9d847ee1dcf8 (1dbcd67d-0b9e-48c9-94d2-9d847ee1dcf8): created successfully Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-298d3267-ec89-407f-9a21-6b0cf37f944d tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29fe851c-6d42-4c05-a209-0a7b813b162c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:50 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-298d3267-ec89-407f-9a21-6b0cf37f944d tempest-CreateVolumesFromImageTest-775244685 None] Flow 'volume_create_manager' (baa590d7-0008-4a2b-a3c1-51b0255902c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:50 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-298d3267-ec89-407f-9a21-6b0cf37f944d tempest-CreateVolumesFromImageTest-775244685 None] Created volume successfully. Aug 10 13:07:51 devstack sudo[108721]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5cc72b8f-917b-4e61-9345-d0d1361d99d2_fseqa521devstack@QuobyteHD" returned: 0 in 0.339s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5cc72b8f-917b-4e61-9345-d0d1361d99d2_fseqa521devstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:51 devstack sudo[108728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5cc72b8f-917b-4e61-9345-d0d1361d99d2_fseqa521devstack@QuobyteHD Aug 10 13:07:51 devstack sudo[108728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:51 devstack sudo[108724]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6cb2289f-da0c-4c42-9f91-721bbc20b49b tempest-CreateVolumesFromImageTest-775244685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-90e298f2-e37b-45a3-8727-354196410ef2 1073741824" returned: 0 in 0.495s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:51 devstack sudo[108728]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5cc72b8f-917b-4e61-9345-d0d1361d99d2_fseqa521devstack@QuobyteHD" returned: 1 in 0.360s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5cc72b8f-917b-4e61-9345-d0d1361d99d2_fseqa521devstack@QuobyteHD' failed. Not Retrying. {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 13:07:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6cb2289f-da0c-4c42-9f91-721bbc20b49b tempest-CreateVolumesFromImageTest-775244685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-90e298f2-e37b-45a3-8727-354196410ef2 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:51 devstack sudo[108737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-90e298f2-e37b-45a3-8727-354196410ef2 Aug 10 13:07:51 devstack sudo[108737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:51 devstack sudo[108737]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6cb2289f-da0c-4c42-9f91-721bbc20b49b tempest-CreateVolumesFromImageTest-775244685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-90e298f2-e37b-45a3-8727-354196410ef2" returned: 0 in 0.247s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:51 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6cb2289f-da0c-4c42-9f91-721bbc20b49b tempest-CreateVolumesFromImageTest-775244685 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:07:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6cb2289f-da0c-4c42-9f91-721bbc20b49b tempest-CreateVolumesFromImageTest-775244685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b8cc7187-a50c-4327-a87e-31900152475a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.225s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:51 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b8cc7187-a50c-4327-a87e-31900152475a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1438019421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=390bf0aa-cfd1-4681-9698-b4a79d9db2c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca60da22eddc4711a8ddb7ab04f6bdac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:47Z,use_quota=True,user_id='073076aa29664a38b33a76c2622fd94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:07:51 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-b8cc7187-a50c-4327-a87e-31900152475a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Creating volume 390bf0aa-cfd1-4681-9698-b4a79d9db2c8 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:07:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b8cc7187-a50c-4327-a87e-31900152475a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b8cc7187-a50c-4327-a87e-31900152475a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:51 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b8cc7187-a50c-4327-a87e-31900152475a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:07:51 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b8cc7187-a50c-4327-a87e-31900152475a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:07:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b8cc7187-a50c-4327-a87e-31900152475a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:51 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b8cc7187-a50c-4327-a87e-31900152475a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:07:51 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-b8cc7187-a50c-4327-a87e-31900152475a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:07:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b8cc7187-a50c-4327-a87e-31900152475a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-390bf0aa-cfd1-4681-9698-b4a79d9db2c8 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:51 devstack sudo[108740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-390bf0aa-cfd1-4681-9698-b4a79d9db2c8 1073741824 Aug 10 13:07:51 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6cb2289f-da0c-4c42-9f91-721bbc20b49b tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f7f835d-495a-4772-bac6-86af9504f6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90e298f2-e37b-45a3-8727-354196410ef2', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:51 devstack sudo[108740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:51 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6cb2289f-da0c-4c42-9f91-721bbc20b49b tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a82c5afb-86c7-4ef3-a307-19b15f8a7142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:51 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-6cb2289f-da0c-4c42-9f91-721bbc20b49b tempest-CreateVolumesFromImageTest-775244685 None] Volume volume-90e298f2-e37b-45a3-8727-354196410ef2 (90e298f2-e37b-45a3-8727-354196410ef2): created successfully Aug 10 13:07:51 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6cb2289f-da0c-4c42-9f91-721bbc20b49b tempest-CreateVolumesFromImageTest-775244685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a82c5afb-86c7-4ef3-a307-19b15f8a7142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:51 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6cb2289f-da0c-4c42-9f91-721bbc20b49b tempest-CreateVolumesFromImageTest-775244685 None] Flow 'volume_create_manager' (a06efd32-d45a-4036-959c-007afa07d0b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:51 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-6cb2289f-da0c-4c42-9f91-721bbc20b49b tempest-CreateVolumesFromImageTest-775244685 None] Created volume successfully. Aug 10 13:07:52 devstack sudo[108740]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b8cc7187-a50c-4327-a87e-31900152475a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-390bf0aa-cfd1-4681-9698-b4a79d9db2c8 1073741824" returned: 0 in 0.413s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b8cc7187-a50c-4327-a87e-31900152475a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-390bf0aa-cfd1-4681-9698-b4a79d9db2c8 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:52 devstack sudo[108745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-390bf0aa-cfd1-4681-9698-b4a79d9db2c8 Aug 10 13:07:52 devstack sudo[108745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:52 devstack sudo[108745]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b8cc7187-a50c-4327-a87e-31900152475a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-390bf0aa-cfd1-4681-9698-b4a79d9db2c8" returned: 0 in 0.259s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:52 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b8cc7187-a50c-4327-a87e-31900152475a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:07:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b8cc7187-a50c-4327-a87e-31900152475a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7335f8a1-40e3-4dfc-8134-33755c952479 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.451s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:52 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-7335f8a1-40e3-4dfc-8134-33755c952479 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2063040932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a36f7d9b-f643-40c5-93ee-17a12cb01857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca60da22eddc4711a8ddb7ab04f6bdac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:48Z,use_quota=True,user_id='073076aa29664a38b33a76c2622fd94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:07:52 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-7335f8a1-40e3-4dfc-8134-33755c952479 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Creating volume a36f7d9b-f643-40c5-93ee-17a12cb01857 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:07:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7335f8a1-40e3-4dfc-8134-33755c952479 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7335f8a1-40e3-4dfc-8134-33755c952479 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:52 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-7335f8a1-40e3-4dfc-8134-33755c952479 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:07:52 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-7335f8a1-40e3-4dfc-8134-33755c952479 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:07:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7335f8a1-40e3-4dfc-8134-33755c952479 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:52 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-7335f8a1-40e3-4dfc-8134-33755c952479 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:07:52 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-7335f8a1-40e3-4dfc-8134-33755c952479 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:07:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7335f8a1-40e3-4dfc-8134-33755c952479 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a36f7d9b-f643-40c5-93ee-17a12cb01857 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b8cc7187-a50c-4327-a87e-31900152475a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00fc3536-fb03-490e-9423-3d511e4a4d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-390bf0aa-cfd1-4681-9698-b4a79d9db2c8', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b8cc7187-a50c-4327-a87e-31900152475a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d8d97e-4752-4fb4-9234-8c703f424aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:52 devstack sudo[108748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a36f7d9b-f643-40c5-93ee-17a12cb01857 1073741824 Aug 10 13:07:52 devstack sudo[108748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:52 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-b8cc7187-a50c-4327-a87e-31900152475a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Volume volume-390bf0aa-cfd1-4681-9698-b4a79d9db2c8 (390bf0aa-cfd1-4681-9698-b4a79d9db2c8): created successfully Aug 10 13:07:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b8cc7187-a50c-4327-a87e-31900152475a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d8d97e-4752-4fb4-9234-8c703f424aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b8cc7187-a50c-4327-a87e-31900152475a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Flow 'volume_create_manager' (8c101bb4-449d-4e6d-bd27-518bb30a8e49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:52 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-44858bbd-4afe-4725-ab6f-2dc0b6fa36b4 tempest-CreateVolumesFromImageTest-775244685 None] Acquiring lock "cinder-90e298f2-e37b-45a3-8727-354196410ef2-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:07:52 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-b8cc7187-a50c-4327-a87e-31900152475a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Created volume successfully. Aug 10 13:07:52 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-44858bbd-4afe-4725-ab6f-2dc0b6fa36b4 tempest-CreateVolumesFromImageTest-775244685 None] Lock "cinder-90e298f2-e37b-45a3-8727-354196410ef2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:07:52 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-44858bbd-4afe-4725-ab6f-2dc0b6fa36b4 tempest-CreateVolumesFromImageTest-775244685 None] Acquiring lock "cinder-quobyte-90e298f2-e37b-45a3-8727-354196410ef2" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:07:52 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-44858bbd-4afe-4725-ab6f-2dc0b6fa36b4 tempest-CreateVolumesFromImageTest-775244685 None] Lock "cinder-quobyte-90e298f2-e37b-45a3-8727-354196410ef2" acquired by "delete_volume" :: waited 0.017s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:07:52 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47f2298-0840-485c-87ea-ff832daf8b6a]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:07:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-44858bbd-4afe-4725-ab6f-2dc0b6fa36b4 tempest-CreateVolumesFromImageTest-775244685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-90e298f2-e37b-45a3-8727-354196410ef2 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:52 devstack sudo[108750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-90e298f2-e37b-45a3-8727-354196410ef2 Aug 10 13:07:52 devstack sudo[108750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:52 devstack sudo[108748]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7335f8a1-40e3-4dfc-8134-33755c952479 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a36f7d9b-f643-40c5-93ee-17a12cb01857 1073741824" returned: 0 in 0.496s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7335f8a1-40e3-4dfc-8134-33755c952479 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a36f7d9b-f643-40c5-93ee-17a12cb01857 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:52 devstack sudo[108756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a36f7d9b-f643-40c5-93ee-17a12cb01857 Aug 10 13:07:52 devstack sudo[108756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:52 devstack sudo[108750]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-44858bbd-4afe-4725-ab6f-2dc0b6fa36b4 tempest-CreateVolumesFromImageTest-775244685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-90e298f2-e37b-45a3-8727-354196410ef2" returned: 0 in 0.371s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-44858bbd-4afe-4725-ab6f-2dc0b6fa36b4 tempest-CreateVolumesFromImageTest-775244685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-90e298f2-e37b-45a3-8727-354196410ef2 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:53 devstack sudo[108761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-90e298f2-e37b-45a3-8727-354196410ef2 Aug 10 13:07:53 devstack sudo[108761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:53 devstack sudo[108756]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7335f8a1-40e3-4dfc-8134-33755c952479 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a36f7d9b-f643-40c5-93ee-17a12cb01857" returned: 0 in 0.257s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:53 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-7335f8a1-40e3-4dfc-8134-33755c952479 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:07:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7335f8a1-40e3-4dfc-8134-33755c952479 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-762571f6-099d-485d-bc75-a3eba7500f07 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.751s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:53 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-762571f6-099d-485d-bc75-a3eba7500f07 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1645359912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfa86910-fb1f-4567-936b-6c24f0674415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca60da22eddc4711a8ddb7ab04f6bdac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:48Z,use_quota=True,user_id='073076aa29664a38b33a76c2622fd94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:07:53 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-762571f6-099d-485d-bc75-a3eba7500f07 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Creating volume cfa86910-fb1f-4567-936b-6c24f0674415 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:07:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-762571f6-099d-485d-bc75-a3eba7500f07 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-762571f6-099d-485d-bc75-a3eba7500f07 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:53 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-762571f6-099d-485d-bc75-a3eba7500f07 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:07:53 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-762571f6-099d-485d-bc75-a3eba7500f07 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:07:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-762571f6-099d-485d-bc75-a3eba7500f07 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:53 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-762571f6-099d-485d-bc75-a3eba7500f07 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:07:53 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-762571f6-099d-485d-bc75-a3eba7500f07 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:07:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-762571f6-099d-485d-bc75-a3eba7500f07 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cfa86910-fb1f-4567-936b-6c24f0674415 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7335f8a1-40e3-4dfc-8134-33755c952479 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6a81f0b-c7cb-4c60-87dc-29438b8c458b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a36f7d9b-f643-40c5-93ee-17a12cb01857', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:53 devstack sudo[108764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cfa86910-fb1f-4567-936b-6c24f0674415 1073741824 Aug 10 13:07:53 devstack sudo[108764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7335f8a1-40e3-4dfc-8134-33755c952479 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66afbe27-4642-405f-9fa9-4356bc29ae3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:53 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-7335f8a1-40e3-4dfc-8134-33755c952479 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Volume volume-a36f7d9b-f643-40c5-93ee-17a12cb01857 (a36f7d9b-f643-40c5-93ee-17a12cb01857): created successfully Aug 10 13:07:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7335f8a1-40e3-4dfc-8134-33755c952479 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66afbe27-4642-405f-9fa9-4356bc29ae3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-7335f8a1-40e3-4dfc-8134-33755c952479 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Flow 'volume_create_manager' (96550ff3-9bab-494f-b867-86ef8f7556ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:53 devstack sudo[108761]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-44858bbd-4afe-4725-ab6f-2dc0b6fa36b4 tempest-CreateVolumesFromImageTest-775244685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-90e298f2-e37b-45a3-8727-354196410ef2" returned: 0 in 0.264s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:53 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-7335f8a1-40e3-4dfc-8134-33755c952479 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Created volume successfully. Aug 10 13:07:53 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-44858bbd-4afe-4725-ab6f-2dc0b6fa36b4 tempest-CreateVolumesFromImageTest-775244685 None] Lock "cinder-quobyte-90e298f2-e37b-45a3-8727-354196410ef2" released by "delete_volume" :: held 0.684s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:07:53 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-44858bbd-4afe-4725-ab6f-2dc0b6fa36b4 tempest-CreateVolumesFromImageTest-775244685 None] Created reservations ['d3626d74-f854-4d16-9bec-410f87e3a23f', 'b6423096-a46f-44c6-8b13-bcbbea94de26', '0109b6e8-3182-4e4f-b2bb-1dea98362c70', '28dd0f7c-63ad-4cc4-9e9a-675c7b979426'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:07:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-44858bbd-4afe-4725-ab6f-2dc0b6fa36b4 tempest-CreateVolumesFromImageTest-775244685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-44858bbd-4afe-4725-ab6f-2dc0b6fa36b4 tempest-CreateVolumesFromImageTest-775244685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:53 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-44858bbd-4afe-4725-ab6f-2dc0b6fa36b4 tempest-CreateVolumesFromImageTest-775244685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:07:53 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-44858bbd-4afe-4725-ab6f-2dc0b6fa36b4 tempest-CreateVolumesFromImageTest-775244685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:07:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-44858bbd-4afe-4725-ab6f-2dc0b6fa36b4 tempest-CreateVolumesFromImageTest-775244685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-44858bbd-4afe-4725-ab6f-2dc0b6fa36b4 tempest-CreateVolumesFromImageTest-775244685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:53 devstack sudo[108767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:07:53 devstack sudo[108767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:53 devstack sudo[108767]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-44858bbd-4afe-4725-ab6f-2dc0b6fa36b4 tempest-CreateVolumesFromImageTest-775244685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.278s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:53 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-44858bbd-4afe-4725-ab6f-2dc0b6fa36b4 tempest-CreateVolumesFromImageTest-775244685 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:07:53 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-44858bbd-4afe-4725-ab6f-2dc0b6fa36b4 tempest-CreateVolumesFromImageTest-775244685 None] Deleted volume successfully. Aug 10 13:07:53 devstack sudo[108764]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:53 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-1fe1de3b-d67a-4579-990f-a5164674c646 tempest-CreateVolumesFromImageTest-775244685 None] Acquiring lock "cinder-1dbcd67d-0b9e-48c9-94d2-9d847ee1dcf8-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:07:53 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-44858bbd-4afe-4725-ab6f-2dc0b6fa36b4 tempest-CreateVolumesFromImageTest-775244685 None] Lock "cinder-90e298f2-e37b-45a3-8727-354196410ef2-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:07:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-762571f6-099d-485d-bc75-a3eba7500f07 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cfa86910-fb1f-4567-936b-6c24f0674415 1073741824" returned: 0 in 0.516s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:53 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-1fe1de3b-d67a-4579-990f-a5164674c646 tempest-CreateVolumesFromImageTest-775244685 None] Lock "cinder-1dbcd67d-0b9e-48c9-94d2-9d847ee1dcf8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:07:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-762571f6-099d-485d-bc75-a3eba7500f07 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cfa86910-fb1f-4567-936b-6c24f0674415 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:53 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-1fe1de3b-d67a-4579-990f-a5164674c646 tempest-CreateVolumesFromImageTest-775244685 None] Acquiring lock "cinder-quobyte-1dbcd67d-0b9e-48c9-94d2-9d847ee1dcf8" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:07:53 devstack sudo[108774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cfa86910-fb1f-4567-936b-6c24f0674415 Aug 10 13:07:53 devstack sudo[108774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:53 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-1fe1de3b-d67a-4579-990f-a5164674c646 tempest-CreateVolumesFromImageTest-775244685 None] Lock "cinder-quobyte-1dbcd67d-0b9e-48c9-94d2-9d847ee1dcf8" acquired by "delete_volume" :: waited 0.016s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:07:53 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6097434-2cbb-463d-a4ca-6c3eb0181950]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:07:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1fe1de3b-d67a-4579-990f-a5164674c646 tempest-CreateVolumesFromImageTest-775244685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1dbcd67d-0b9e-48c9-94d2-9d847ee1dcf8 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:53 devstack sudo[108776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1dbcd67d-0b9e-48c9-94d2-9d847ee1dcf8 Aug 10 13:07:53 devstack sudo[108776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:54 devstack sudo[108774]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-762571f6-099d-485d-bc75-a3eba7500f07 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cfa86910-fb1f-4567-936b-6c24f0674415" returned: 0 in 0.255s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-762571f6-099d-485d-bc75-a3eba7500f07 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-762571f6-099d-485d-bc75-a3eba7500f07 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-cb441699-447a-46f6-b383-619983907e27 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.400s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-cb441699-447a-46f6-b383-619983907e27 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-527163699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a8fe1a1-6d55-4054-bb65-61f10aeb879d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca60da22eddc4711a8ddb7ab04f6bdac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:48Z,use_quota=True,user_id='073076aa29664a38b33a76c2622fd94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-cb441699-447a-46f6-b383-619983907e27 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Creating volume 9a8fe1a1-6d55-4054-bb65-61f10aeb879d {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-cb441699-447a-46f6-b383-619983907e27 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-cb441699-447a-46f6-b383-619983907e27 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-cb441699-447a-46f6-b383-619983907e27 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-cb441699-447a-46f6-b383-619983907e27 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-cb441699-447a-46f6-b383-619983907e27 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-cb441699-447a-46f6-b383-619983907e27 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:07:54 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-cb441699-447a-46f6-b383-619983907e27 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-cb441699-447a-46f6-b383-619983907e27 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9a8fe1a1-6d55-4054-bb65-61f10aeb879d 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-762571f6-099d-485d-bc75-a3eba7500f07 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e93003fa-3c14-4b0c-9ef1-b422104f1d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfa86910-fb1f-4567-936b-6c24f0674415', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:54 devstack sudo[108779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9a8fe1a1-6d55-4054-bb65-61f10aeb879d 1073741824 Aug 10 13:07:54 devstack sudo[108779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-762571f6-099d-485d-bc75-a3eba7500f07 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf1d6da-b373-482a-a1c7-ce50268d3574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:54 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-762571f6-099d-485d-bc75-a3eba7500f07 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Volume volume-cfa86910-fb1f-4567-936b-6c24f0674415 (cfa86910-fb1f-4567-936b-6c24f0674415): created successfully Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-762571f6-099d-485d-bc75-a3eba7500f07 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf1d6da-b373-482a-a1c7-ce50268d3574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-762571f6-099d-485d-bc75-a3eba7500f07 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Flow 'volume_create_manager' (cc768661-073d-4947-b17a-fea1abcd3cc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:54 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-762571f6-099d-485d-bc75-a3eba7500f07 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Created volume successfully. Aug 10 13:07:54 devstack sudo[108776]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1fe1de3b-d67a-4579-990f-a5164674c646 tempest-CreateVolumesFromImageTest-775244685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1dbcd67d-0b9e-48c9-94d2-9d847ee1dcf8" returned: 0 in 0.379s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1fe1de3b-d67a-4579-990f-a5164674c646 tempest-CreateVolumesFromImageTest-775244685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1dbcd67d-0b9e-48c9-94d2-9d847ee1dcf8 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:54 devstack sudo[108784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1dbcd67d-0b9e-48c9-94d2-9d847ee1dcf8 Aug 10 13:07:54 devstack sudo[108784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:54 devstack sudo[108784]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1fe1de3b-d67a-4579-990f-a5164674c646 tempest-CreateVolumesFromImageTest-775244685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1dbcd67d-0b9e-48c9-94d2-9d847ee1dcf8" returned: 0 in 0.290s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:54 devstack sudo[108779]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-1fe1de3b-d67a-4579-990f-a5164674c646 tempest-CreateVolumesFromImageTest-775244685 None] Lock "cinder-quobyte-1dbcd67d-0b9e-48c9-94d2-9d847ee1dcf8" released by "delete_volume" :: held 0.708s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-cb441699-447a-46f6-b383-619983907e27 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9a8fe1a1-6d55-4054-bb65-61f10aeb879d 1073741824" returned: 0 in 0.480s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-cb441699-447a-46f6-b383-619983907e27 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9a8fe1a1-6d55-4054-bb65-61f10aeb879d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-1fe1de3b-d67a-4579-990f-a5164674c646 tempest-CreateVolumesFromImageTest-775244685 None] Created reservations ['b36dd416-d3a2-4c97-b7cb-50807bea392e', '2f135e2c-b7af-4c25-90e6-3be88cff8400', '452fb41f-3ed7-4ab3-aadb-da0bfb088c48', 'b672c653-1680-4395-8a01-36f6fcca406b'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:07:54 devstack sudo[108790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9a8fe1a1-6d55-4054-bb65-61f10aeb879d Aug 10 13:07:54 devstack sudo[108790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1fe1de3b-d67a-4579-990f-a5164674c646 tempest-CreateVolumesFromImageTest-775244685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1fe1de3b-d67a-4579-990f-a5164674c646 tempest-CreateVolumesFromImageTest-775244685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1fe1de3b-d67a-4579-990f-a5164674c646 tempest-CreateVolumesFromImageTest-775244685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1fe1de3b-d67a-4579-990f-a5164674c646 tempest-CreateVolumesFromImageTest-775244685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1fe1de3b-d67a-4579-990f-a5164674c646 tempest-CreateVolumesFromImageTest-775244685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1fe1de3b-d67a-4579-990f-a5164674c646 tempest-CreateVolumesFromImageTest-775244685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:54 devstack sudo[108792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:07:54 devstack sudo[108792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:54 devstack sudo[108790]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-cb441699-447a-46f6-b383-619983907e27 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9a8fe1a1-6d55-4054-bb65-61f10aeb879d" returned: 0 in 0.272s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-cb441699-447a-46f6-b383-619983907e27 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-cb441699-447a-46f6-b383-619983907e27 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6a30ff9f-47e9-40e5-9d62-f61fdf285d00 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.807s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6a30ff9f-47e9-40e5-9d62-f61fdf285d00 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-320587299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a66cbd-8526-4bcc-9c7a-8e859aed818c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca60da22eddc4711a8ddb7ab04f6bdac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:49Z,use_quota=True,user_id='073076aa29664a38b33a76c2622fd94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-6a30ff9f-47e9-40e5-9d62-f61fdf285d00 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Creating volume a6a66cbd-8526-4bcc-9c7a-8e859aed818c {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6a30ff9f-47e9-40e5-9d62-f61fdf285d00 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6a30ff9f-47e9-40e5-9d62-f61fdf285d00 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6a30ff9f-47e9-40e5-9d62-f61fdf285d00 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6a30ff9f-47e9-40e5-9d62-f61fdf285d00 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6a30ff9f-47e9-40e5-9d62-f61fdf285d00 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6a30ff9f-47e9-40e5-9d62-f61fdf285d00 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:07:54 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-6a30ff9f-47e9-40e5-9d62-f61fdf285d00 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6a30ff9f-47e9-40e5-9d62-f61fdf285d00 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a6a66cbd-8526-4bcc-9c7a-8e859aed818c 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-cb441699-447a-46f6-b383-619983907e27 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b115c89b-84de-47c6-a9b4-24f6facca297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a8fe1a1-6d55-4054-bb65-61f10aeb879d', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:54 devstack sudo[108795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a6a66cbd-8526-4bcc-9c7a-8e859aed818c 1073741824 Aug 10 13:07:54 devstack sudo[108795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-cb441699-447a-46f6-b383-619983907e27 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b759065-97d1-4591-8e38-b698ee64cd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-bfe33b9a-deb3-47ed-9b6b-f60d6e8b4fcb tempest-CreateVolumesFromImageTest-775244685 None] Acquiring lock "cinder-61391b1c-3c99-45b8-a72c-54bb66a2a04d-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:07:54 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-cb441699-447a-46f6-b383-619983907e27 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Volume volume-9a8fe1a1-6d55-4054-bb65-61f10aeb879d (9a8fe1a1-6d55-4054-bb65-61f10aeb879d): created successfully Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-cb441699-447a-46f6-b383-619983907e27 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b759065-97d1-4591-8e38-b698ee64cd08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:54 devstack sudo[108792]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-cb441699-447a-46f6-b383-619983907e27 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Flow 'volume_create_manager' (0123e443-7e75-44ca-adf5-eeb5219c4e57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-bfe33b9a-deb3-47ed-9b6b-f60d6e8b4fcb tempest-CreateVolumesFromImageTest-775244685 None] Lock "cinder-61391b1c-3c99-45b8-a72c-54bb66a2a04d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1fe1de3b-d67a-4579-990f-a5164674c646 tempest-CreateVolumesFromImageTest-775244685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.301s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:54 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-1fe1de3b-d67a-4579-990f-a5164674c646 tempest-CreateVolumesFromImageTest-775244685 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:07:54 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-cb441699-447a-46f6-b383-619983907e27 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Created volume successfully. Aug 10 13:07:54 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-1fe1de3b-d67a-4579-990f-a5164674c646 tempest-CreateVolumesFromImageTest-775244685 None] Deleted volume successfully. Aug 10 13:07:55 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-bfe33b9a-deb3-47ed-9b6b-f60d6e8b4fcb tempest-CreateVolumesFromImageTest-775244685 None] Acquiring lock "cinder-quobyte-61391b1c-3c99-45b8-a72c-54bb66a2a04d" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:07:55 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-1fe1de3b-d67a-4579-990f-a5164674c646 tempest-CreateVolumesFromImageTest-775244685 None] Lock "cinder-1dbcd67d-0b9e-48c9-94d2-9d847ee1dcf8-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:07:55 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-bfe33b9a-deb3-47ed-9b6b-f60d6e8b4fcb tempest-CreateVolumesFromImageTest-775244685 None] Lock "cinder-quobyte-61391b1c-3c99-45b8-a72c-54bb66a2a04d" acquired by "delete_volume" :: waited 0.019s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:07:55 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b2fecb-bcab-42ff-b3b4-704a2762da1b]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:07:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-bfe33b9a-deb3-47ed-9b6b-f60d6e8b4fcb tempest-CreateVolumesFromImageTest-775244685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-61391b1c-3c99-45b8-a72c-54bb66a2a04d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:55 devstack sudo[108798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-61391b1c-3c99-45b8-a72c-54bb66a2a04d Aug 10 13:07:55 devstack sudo[108798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:55 devstack sudo[108795]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6a30ff9f-47e9-40e5-9d62-f61fdf285d00 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a6a66cbd-8526-4bcc-9c7a-8e859aed818c 1073741824" returned: 0 in 0.488s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6a30ff9f-47e9-40e5-9d62-f61fdf285d00 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a6a66cbd-8526-4bcc-9c7a-8e859aed818c {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:55 devstack sudo[108804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a6a66cbd-8526-4bcc-9c7a-8e859aed818c Aug 10 13:07:55 devstack sudo[108804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:55 devstack sudo[108798]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-bfe33b9a-deb3-47ed-9b6b-f60d6e8b4fcb tempest-CreateVolumesFromImageTest-775244685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-61391b1c-3c99-45b8-a72c-54bb66a2a04d" returned: 0 in 0.433s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-bfe33b9a-deb3-47ed-9b6b-f60d6e8b4fcb tempest-CreateVolumesFromImageTest-775244685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-61391b1c-3c99-45b8-a72c-54bb66a2a04d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:55 devstack sudo[108809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-61391b1c-3c99-45b8-a72c-54bb66a2a04d Aug 10 13:07:55 devstack sudo[108809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:55 devstack sudo[108804]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6a30ff9f-47e9-40e5-9d62-f61fdf285d00 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a6a66cbd-8526-4bcc-9c7a-8e859aed818c" returned: 0 in 0.273s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:55 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6a30ff9f-47e9-40e5-9d62-f61fdf285d00 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:07:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6a30ff9f-47e9-40e5-9d62-f61fdf285d00 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-fb4831a2-01fb-4e40-9705-7103d0696942 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.480s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:55 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-fb4831a2-01fb-4e40-9705-7103d0696942 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Creating offline snapshot d31dba92-467a-4396-96d2-0c896017fdc3 of volume 0caaa217-71bf-4549-9e72-4554f4fbaa1e {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 13:07:55 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6a30ff9f-47e9-40e5-9d62-f61fdf285d00 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e71a4078-2f32-403b-862b-a83421949aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6a66cbd-8526-4bcc-9c7a-8e859aed818c', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:55 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6a30ff9f-47e9-40e5-9d62-f61fdf285d00 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dce68da-e1ef-4797-a80f-49ddf4d3af8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:55 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f930599-5988-4a31-a766-0a105f07efdc]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:07:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fb4831a2-01fb-4e40-9705-7103d0696942 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:55 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-6a30ff9f-47e9-40e5-9d62-f61fdf285d00 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Volume volume-a6a66cbd-8526-4bcc-9c7a-8e859aed818c (a6a66cbd-8526-4bcc-9c7a-8e859aed818c): created successfully Aug 10 13:07:55 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6a30ff9f-47e9-40e5-9d62-f61fdf285d00 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dce68da-e1ef-4797-a80f-49ddf4d3af8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:55 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6a30ff9f-47e9-40e5-9d62-f61fdf285d00 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Flow 'volume_create_manager' (5264efd4-e514-4599-a743-eabf9e3fb953) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:55 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-6a30ff9f-47e9-40e5-9d62-f61fdf285d00 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Created volume successfully. Aug 10 13:07:55 devstack sudo[108809]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-bfe33b9a-deb3-47ed-9b6b-f60d6e8b4fcb tempest-CreateVolumesFromImageTest-775244685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-61391b1c-3c99-45b8-a72c-54bb66a2a04d" returned: 0 in 0.271s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:55 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-bfe33b9a-deb3-47ed-9b6b-f60d6e8b4fcb tempest-CreateVolumesFromImageTest-775244685 None] Lock "cinder-quobyte-61391b1c-3c99-45b8-a72c-54bb66a2a04d" released by "delete_volume" :: held 0.744s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:07:55 devstack sudo[108812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e Aug 10 13:07:55 devstack sudo[108812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:55 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-bfe33b9a-deb3-47ed-9b6b-f60d6e8b4fcb tempest-CreateVolumesFromImageTest-775244685 None] Created reservations ['a897053c-0baa-41db-a217-b01a37452d82', 'a40a85ca-e65b-4202-be06-9d5be6fb221e', 'b9ad8365-89ac-41ed-aa3b-f76d8d433394', '23359ae8-73c1-4788-8097-464b1568f72d'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:07:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-bfe33b9a-deb3-47ed-9b6b-f60d6e8b4fcb tempest-CreateVolumesFromImageTest-775244685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-bfe33b9a-deb3-47ed-9b6b-f60d6e8b4fcb tempest-CreateVolumesFromImageTest-775244685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:55 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-bfe33b9a-deb3-47ed-9b6b-f60d6e8b4fcb tempest-CreateVolumesFromImageTest-775244685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:07:55 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-bfe33b9a-deb3-47ed-9b6b-f60d6e8b4fcb tempest-CreateVolumesFromImageTest-775244685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:07:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-bfe33b9a-deb3-47ed-9b6b-f60d6e8b4fcb tempest-CreateVolumesFromImageTest-775244685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-bfe33b9a-deb3-47ed-9b6b-f60d6e8b4fcb tempest-CreateVolumesFromImageTest-775244685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:55 devstack sudo[108815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:07:55 devstack sudo[108815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:56 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f5b9044c-a91b-4566-b260-4e5b98d9a608 tempest-CreateVolumesFromImageTest-775244685 None] Acquiring lock "cinder-62b0bca5-2afc-4074-985b-2d8b52457b08-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:07:56 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f5b9044c-a91b-4566-b260-4e5b98d9a608 tempest-CreateVolumesFromImageTest-775244685 None] Lock "cinder-62b0bca5-2afc-4074-985b-2d8b52457b08-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:07:56 devstack sudo[108812]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fb4831a2-01fb-4e40-9705-7103d0696942 tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e" returned: 0 in 0.422s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fb4831a2-01fb-4e40-9705-7103d0696942 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e.d31dba92-467a-4396-96d2-0c896017fdc3 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:56 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f5b9044c-a91b-4566-b260-4e5b98d9a608 tempest-CreateVolumesFromImageTest-775244685 None] Acquiring lock "cinder-quobyte-62b0bca5-2afc-4074-985b-2d8b52457b08" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:07:56 devstack sudo[108820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e.d31dba92-467a-4396-96d2-0c896017fdc3 1G Aug 10 13:07:56 devstack sudo[108820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:56 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f5b9044c-a91b-4566-b260-4e5b98d9a608 tempest-CreateVolumesFromImageTest-775244685 None] Lock "cinder-quobyte-62b0bca5-2afc-4074-985b-2d8b52457b08" acquired by "delete_volume" :: waited 0.023s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:07:56 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d19597c-0cce-4ada-b679-6bea7b272f38]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:07:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f5b9044c-a91b-4566-b260-4e5b98d9a608 tempest-CreateVolumesFromImageTest-775244685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-62b0bca5-2afc-4074-985b-2d8b52457b08 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:56 devstack sudo[108815]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-bfe33b9a-deb3-47ed-9b6b-f60d6e8b4fcb tempest-CreateVolumesFromImageTest-775244685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.297s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:56 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-bfe33b9a-deb3-47ed-9b6b-f60d6e8b4fcb tempest-CreateVolumesFromImageTest-775244685 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:07:56 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-bfe33b9a-deb3-47ed-9b6b-f60d6e8b4fcb tempest-CreateVolumesFromImageTest-775244685 None] Deleted volume successfully. Aug 10 13:07:56 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-bfe33b9a-deb3-47ed-9b6b-f60d6e8b4fcb tempest-CreateVolumesFromImageTest-775244685 None] Lock "cinder-61391b1c-3c99-45b8-a72c-54bb66a2a04d-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:07:56 devstack sudo[108823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-62b0bca5-2afc-4074-985b-2d8b52457b08 Aug 10 13:07:56 devstack sudo[108823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:56 devstack sudo[108820]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fb4831a2-01fb-4e40-9705-7103d0696942 tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e.d31dba92-467a-4396-96d2-0c896017fdc3 1G" returned: 0 in 0.421s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fb4831a2-01fb-4e40-9705-7103d0696942 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e.d31dba92-467a-4396-96d2-0c896017fdc3 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:56 devstack sudo[108830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e.d31dba92-467a-4396-96d2-0c896017fdc3 Aug 10 13:07:56 devstack sudo[108830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:56 devstack sudo[108823]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f5b9044c-a91b-4566-b260-4e5b98d9a608 tempest-CreateVolumesFromImageTest-775244685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-62b0bca5-2afc-4074-985b-2d8b52457b08" returned: 0 in 0.450s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f5b9044c-a91b-4566-b260-4e5b98d9a608 tempest-CreateVolumesFromImageTest-775244685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-62b0bca5-2afc-4074-985b-2d8b52457b08 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:56 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-57ee2a11-afe2-40d5-bf3b-e6e6a60d026a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Acquiring lock "cinder-a6a66cbd-8526-4bcc-9c7a-8e859aed818c-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:07:56 devstack sudo[108833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-62b0bca5-2afc-4074-985b-2d8b52457b08 Aug 10 13:07:56 devstack sudo[108833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:56 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-57ee2a11-afe2-40d5-bf3b-e6e6a60d026a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "cinder-a6a66cbd-8526-4bcc-9c7a-8e859aed818c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:07:56 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-57ee2a11-afe2-40d5-bf3b-e6e6a60d026a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Acquiring lock "cinder-quobyte-a6a66cbd-8526-4bcc-9c7a-8e859aed818c" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:07:56 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-57ee2a11-afe2-40d5-bf3b-e6e6a60d026a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "cinder-quobyte-a6a66cbd-8526-4bcc-9c7a-8e859aed818c" acquired by "delete_volume" :: waited 0.016s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:07:56 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[02813d89-250a-4172-9f4b-ec3e12a782c7]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:07:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-57ee2a11-afe2-40d5-bf3b-e6e6a60d026a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a6a66cbd-8526-4bcc-9c7a-8e859aed818c {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:56 devstack sudo[108830]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fb4831a2-01fb-4e40-9705-7103d0696942 tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e.d31dba92-467a-4396-96d2-0c896017fdc3" returned: 0 in 0.339s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:56 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-fb4831a2-01fb-4e40-9705-7103d0696942 tempest-CreateVolumesFromSnapshotTest-1515277745 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e.d31dba92-467a-4396-96d2-0c896017fdc3 is being set with open permissions: ugo+rw Aug 10 13:07:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fb4831a2-01fb-4e40-9705-7103d0696942 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e.d31dba92-467a-4396-96d2-0c896017fdc3 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:56 devstack sudo[108840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e.d31dba92-467a-4396-96d2-0c896017fdc3 Aug 10 13:07:56 devstack sudo[108840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:56 devstack sudo[108837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a6a66cbd-8526-4bcc-9c7a-8e859aed818c Aug 10 13:07:56 devstack sudo[108837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:56 devstack sudo[108833]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f5b9044c-a91b-4566-b260-4e5b98d9a608 tempest-CreateVolumesFromImageTest-775244685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-62b0bca5-2afc-4074-985b-2d8b52457b08" returned: 0 in 0.296s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:56 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f5b9044c-a91b-4566-b260-4e5b98d9a608 tempest-CreateVolumesFromImageTest-775244685 None] Lock "cinder-quobyte-62b0bca5-2afc-4074-985b-2d8b52457b08" released by "delete_volume" :: held 0.801s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-f5b9044c-a91b-4566-b260-4e5b98d9a608 tempest-CreateVolumesFromImageTest-775244685 None] Created reservations ['72890b02-4337-4575-829a-99b6680790e8', '567e8ae1-0fd3-413e-b084-dac1534bddbe', '18c07438-3784-4560-ba32-8bd27f72bf09', 'e27cec26-c9b2-4c40-8f13-9c1be688b0ea'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f5b9044c-a91b-4566-b260-4e5b98d9a608 tempest-CreateVolumesFromImageTest-775244685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f5b9044c-a91b-4566-b260-4e5b98d9a608 tempest-CreateVolumesFromImageTest-775244685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f5b9044c-a91b-4566-b260-4e5b98d9a608 tempest-CreateVolumesFromImageTest-775244685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f5b9044c-a91b-4566-b260-4e5b98d9a608 tempest-CreateVolumesFromImageTest-775244685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f5b9044c-a91b-4566-b260-4e5b98d9a608 tempest-CreateVolumesFromImageTest-775244685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f5b9044c-a91b-4566-b260-4e5b98d9a608 tempest-CreateVolumesFromImageTest-775244685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:57 devstack sudo[108843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:07:57 devstack sudo[108843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:57 devstack sudo[108840]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fb4831a2-01fb-4e40-9705-7103d0696942 tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e.d31dba92-467a-4396-96d2-0c896017fdc3" returned: 0 in 0.278s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fb4831a2-01fb-4e40-9705-7103d0696942 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:57 devstack sudo[108849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e.info Aug 10 13:07:57 devstack sudo[108849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-551bdfbf-4a37-4ae5-997c-974d3648aa7a tempest-CreateVolumesFromImageTest-775244685 None] Acquiring lock "cinder-1bd29f65-4f5a-4dfd-9fb9-c54e904e1437-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:07:57 devstack sudo[108837]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-57ee2a11-afe2-40d5-bf3b-e6e6a60d026a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a6a66cbd-8526-4bcc-9c7a-8e859aed818c" returned: 0 in 0.462s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-57ee2a11-afe2-40d5-bf3b-e6e6a60d026a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a6a66cbd-8526-4bcc-9c7a-8e859aed818c {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-551bdfbf-4a37-4ae5-997c-974d3648aa7a tempest-CreateVolumesFromImageTest-775244685 None] Lock "cinder-1bd29f65-4f5a-4dfd-9fb9-c54e904e1437-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:07:57 devstack sudo[108851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a6a66cbd-8526-4bcc-9c7a-8e859aed818c Aug 10 13:07:57 devstack sudo[108851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:57 devstack sudo[108843]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-551bdfbf-4a37-4ae5-997c-974d3648aa7a tempest-CreateVolumesFromImageTest-775244685 None] Acquiring lock "cinder-quobyte-1bd29f65-4f5a-4dfd-9fb9-c54e904e1437" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f5b9044c-a91b-4566-b260-4e5b98d9a608 tempest-CreateVolumesFromImageTest-775244685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.296s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-f5b9044c-a91b-4566-b260-4e5b98d9a608 tempest-CreateVolumesFromImageTest-775244685 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:07:57 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-f5b9044c-a91b-4566-b260-4e5b98d9a608 tempest-CreateVolumesFromImageTest-775244685 None] Deleted volume successfully. Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-551bdfbf-4a37-4ae5-997c-974d3648aa7a tempest-CreateVolumesFromImageTest-775244685 None] Lock "cinder-quobyte-1bd29f65-4f5a-4dfd-9fb9-c54e904e1437" acquired by "delete_volume" :: waited 0.031s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f5b9044c-a91b-4566-b260-4e5b98d9a608 tempest-CreateVolumesFromImageTest-775244685 None] Lock "cinder-62b0bca5-2afc-4074-985b-2d8b52457b08-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f655769-7d07-4109-abe0-751afcba420e]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-551bdfbf-4a37-4ae5-997c-974d3648aa7a tempest-CreateVolumesFromImageTest-775244685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1bd29f65-4f5a-4dfd-9fb9-c54e904e1437 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:57 devstack sudo[108849]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:57 devstack sudo[108854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1bd29f65-4f5a-4dfd-9fb9-c54e904e1437 Aug 10 13:07:57 devstack sudo[108854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fb4831a2-01fb-4e40-9705-7103d0696942 tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e.info" returned: 0 in 0.357s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:57 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-fb4831a2-01fb-4e40-9705-7103d0696942 tempest-CreateVolumesFromSnapshotTest-1515277745 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e.info is being set with open permissions: ugo+rw Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fb4831a2-01fb-4e40-9705-7103d0696942 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:57 devstack sudo[108851]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-57ee2a11-afe2-40d5-bf3b-e6e6a60d026a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a6a66cbd-8526-4bcc-9c7a-8e859aed818c" returned: 0 in 0.320s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:57 devstack sudo[108858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e.info Aug 10 13:07:57 devstack sudo[108858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-57ee2a11-afe2-40d5-bf3b-e6e6a60d026a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "cinder-quobyte-a6a66cbd-8526-4bcc-9c7a-8e859aed818c" released by "delete_volume" :: held 0.839s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-57ee2a11-afe2-40d5-bf3b-e6e6a60d026a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Created reservations ['ca621835-a964-4ed9-a707-7ccaca9a1ece', 'e8e0efc0-bd56-40e8-af8d-7e97ac6d36df', 'c2f41e6e-b362-4b4f-98f8-e568b6c750b5', 'b6e005c5-b29e-419a-aac1-64d14a59c603'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-57ee2a11-afe2-40d5-bf3b-e6e6a60d026a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-57ee2a11-afe2-40d5-bf3b-e6e6a60d026a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-57ee2a11-afe2-40d5-bf3b-e6e6a60d026a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-57ee2a11-afe2-40d5-bf3b-e6e6a60d026a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-57ee2a11-afe2-40d5-bf3b-e6e6a60d026a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-57ee2a11-afe2-40d5-bf3b-e6e6a60d026a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:57 devstack sudo[108860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:07:57 devstack sudo[108860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:57 devstack sudo[108858]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fb4831a2-01fb-4e40-9705-7103d0696942 tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e.info" returned: 0 in 0.299s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:57 devstack sudo[108854]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-fb4831a2-01fb-4e40-9705-7103d0696942 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.227s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.518s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cface6a3-621c-4652-8f57-97160aab1e62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3985da827b3846c89088f34461297c5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:49Z,use_quota=True,user_id='0cb899ca5895418cbb012fd5968ef3ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(738696ea-8851-4ed0-bed4-64449eccdc0a),volume_type_id=738696ea-8851-4ed0-bed4-64449eccdc0a)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Creating volume cface6a3-621c-4652-8f57-97160aab1e62 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:07:57 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cface6a3-621c-4652-8f57-97160aab1e62 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c97bb143-a1f3-431a-a080-5ec99fe79b56 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Acquiring lock "cinder-9a8fe1a1-6d55-4054-bb65-61f10aeb879d-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-551bdfbf-4a37-4ae5-997c-974d3648aa7a tempest-CreateVolumesFromImageTest-775244685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1bd29f65-4f5a-4dfd-9fb9-c54e904e1437" returned: 0 in 0.480s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-551bdfbf-4a37-4ae5-997c-974d3648aa7a tempest-CreateVolumesFromImageTest-775244685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1bd29f65-4f5a-4dfd-9fb9-c54e904e1437 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:57 devstack sudo[108867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cface6a3-621c-4652-8f57-97160aab1e62 1073741824 Aug 10 13:07:57 devstack sudo[108867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:57 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c97bb143-a1f3-431a-a080-5ec99fe79b56 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "cinder-9a8fe1a1-6d55-4054-bb65-61f10aeb879d-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:07:57 devstack sudo[108869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1bd29f65-4f5a-4dfd-9fb9-c54e904e1437 Aug 10 13:07:57 devstack sudo[108869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:57 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-fb4831a2-01fb-4e40-9705-7103d0696942 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Create snapshot completed successfully Aug 10 13:07:58 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c97bb143-a1f3-431a-a080-5ec99fe79b56 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Acquiring lock "cinder-quobyte-9a8fe1a1-6d55-4054-bb65-61f10aeb879d" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:07:58 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c97bb143-a1f3-431a-a080-5ec99fe79b56 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "cinder-quobyte-9a8fe1a1-6d55-4054-bb65-61f10aeb879d" acquired by "delete_volume" :: waited 0.022s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:07:58 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8fc28f-6106-4ce7-807c-097caa96cd34]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:07:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c97bb143-a1f3-431a-a080-5ec99fe79b56 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9a8fe1a1-6d55-4054-bb65-61f10aeb879d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:58 devstack sudo[108860]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-57ee2a11-afe2-40d5-bf3b-e6e6a60d026a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.330s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:58 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-57ee2a11-afe2-40d5-bf3b-e6e6a60d026a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:07:58 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-57ee2a11-afe2-40d5-bf3b-e6e6a60d026a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Deleted volume successfully. Aug 10 13:07:58 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-57ee2a11-afe2-40d5-bf3b-e6e6a60d026a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "cinder-a6a66cbd-8526-4bcc-9c7a-8e859aed818c-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:07:58 devstack sudo[108872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9a8fe1a1-6d55-4054-bb65-61f10aeb879d Aug 10 13:07:58 devstack sudo[108872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:58 devstack sudo[108869]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-551bdfbf-4a37-4ae5-997c-974d3648aa7a tempest-CreateVolumesFromImageTest-775244685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1bd29f65-4f5a-4dfd-9fb9-c54e904e1437" returned: 0 in 0.351s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:58 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-551bdfbf-4a37-4ae5-997c-974d3648aa7a tempest-CreateVolumesFromImageTest-775244685 None] Lock "cinder-quobyte-1bd29f65-4f5a-4dfd-9fb9-c54e904e1437" released by "delete_volume" :: held 0.884s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:07:58 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-551bdfbf-4a37-4ae5-997c-974d3648aa7a tempest-CreateVolumesFromImageTest-775244685 None] Created reservations ['e13f7d5b-22fc-4cee-8e71-ed62cd0429a3', 'be54f45d-49d9-4cdb-94a7-376b6526d7cb', 'b41f26b7-161e-4259-b21d-e3ade35bf4ff', '507a0bff-7872-4516-87e6-941671e634b5'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:07:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-551bdfbf-4a37-4ae5-997c-974d3648aa7a tempest-CreateVolumesFromImageTest-775244685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-551bdfbf-4a37-4ae5-997c-974d3648aa7a tempest-CreateVolumesFromImageTest-775244685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:58 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-551bdfbf-4a37-4ae5-997c-974d3648aa7a tempest-CreateVolumesFromImageTest-775244685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:07:58 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-551bdfbf-4a37-4ae5-997c-974d3648aa7a tempest-CreateVolumesFromImageTest-775244685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:07:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-551bdfbf-4a37-4ae5-997c-974d3648aa7a tempest-CreateVolumesFromImageTest-775244685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-551bdfbf-4a37-4ae5-997c-974d3648aa7a tempest-CreateVolumesFromImageTest-775244685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:58 devstack sudo[108867]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:58 devstack sudo[108880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:07:58 devstack sudo[108880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cface6a3-621c-4652-8f57-97160aab1e62 1073741824" returned: 0 in 0.574s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cface6a3-621c-4652-8f57-97160aab1e62 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:58 devstack sudo[108885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cface6a3-621c-4652-8f57-97160aab1e62 Aug 10 13:07:58 devstack sudo[108885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:58 devstack sudo[108872]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c97bb143-a1f3-431a-a080-5ec99fe79b56 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9a8fe1a1-6d55-4054-bb65-61f10aeb879d" returned: 0 in 0.530s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c97bb143-a1f3-431a-a080-5ec99fe79b56 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9a8fe1a1-6d55-4054-bb65-61f10aeb879d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:58 devstack sudo[108887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9a8fe1a1-6d55-4054-bb65-61f10aeb879d Aug 10 13:07:58 devstack sudo[108887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:58 devstack sudo[108880]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-551bdfbf-4a37-4ae5-997c-974d3648aa7a tempest-CreateVolumesFromImageTest-775244685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.342s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:58 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-551bdfbf-4a37-4ae5-997c-974d3648aa7a tempest-CreateVolumesFromImageTest-775244685 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:07:58 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-551bdfbf-4a37-4ae5-997c-974d3648aa7a tempest-CreateVolumesFromImageTest-775244685 None] Deleted volume successfully. Aug 10 13:07:58 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-551bdfbf-4a37-4ae5-997c-974d3648aa7a tempest-CreateVolumesFromImageTest-775244685 None] Lock "cinder-1bd29f65-4f5a-4dfd-9fb9-c54e904e1437-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:07:58 devstack sudo[108885]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cface6a3-621c-4652-8f57-97160aab1e62" returned: 0 in 0.383s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:58 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:07:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:58 devstack cinder-volume[89096]: DEBUG cinder.volume.volume_utils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Attempting download of 5cc72b8f-917b-4e61-9345-d0d1361d99d2 ((None, [{'url': 'file:///opt/stack/data/glance/images/5cc72b8f-917b-4e61-9345-d0d1361d99d2', 'metadata': {}}])) to volume cface6a3-621c-4652-8f57-97160aab1e62. {{(pid=89096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae2e282-582c-4a46-ab75-a5bb85fd4a64]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5cc72b8f-917b-4e61-9345-d0d1361d99d2_yziyp2sc {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-ada8b2db-07d0-4a8e-8017-a90b604bf013 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:07:59 devstack sudo[108887]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ada8b2db-07d0-4a8e-8017-a90b604bf013 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Flow 'volume_create_manager' (d36ae6d8-fce2-4053-912f-11b92545a7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ada8b2db-07d0-4a8e-8017-a90b604bf013 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e5be35-70ff-40eb-9fa7-14eceeeccf3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c97bb143-a1f3-431a-a080-5ec99fe79b56 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9a8fe1a1-6d55-4054-bb65-61f10aeb879d" returned: 0 in 0.582s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ada8b2db-07d0-4a8e-8017-a90b604bf013 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e5be35-70ff-40eb-9fa7-14eceeeccf3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1264059620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba4bae1f-63d2-48c8-98fb-93d0d664e15d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53f6576b7a0f40c692116c9034dd19cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:59Z,use_quota=True,user_id='9c7096c16fd844c792368b1733d669fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ada8b2db-07d0-4a8e-8017-a90b604bf013 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f71af308-515c-4d74-b7ba-4d723186b260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ada8b2db-07d0-4a8e-8017-a90b604bf013 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f71af308-515c-4d74-b7ba-4d723186b260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ada8b2db-07d0-4a8e-8017-a90b604bf013 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4284a44-9bdf-45f6-a017-d3ccd81dc957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:59 devstack sudo[108892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5cc72b8f-917b-4e61-9345-d0d1361d99d2_yziyp2sc Aug 10 13:07:59 devstack sudo[108892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ada8b2db-07d0-4a8e-8017-a90b604bf013 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4284a44-9bdf-45f6-a017-d3ccd81dc957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba4bae1f-63d2-48c8-98fb-93d0d664e15d', 'volume_name': 'volume-ba4bae1f-63d2-48c8-98fb-93d0d664e15d', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ada8b2db-07d0-4a8e-8017-a90b604bf013 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d3f3084-08f3-4f13-8e5c-50566a66df2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ada8b2db-07d0-4a8e-8017-a90b604bf013 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d3f3084-08f3-4f13-8e5c-50566a66df2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ada8b2db-07d0-4a8e-8017-a90b604bf013 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6c0f74b-d570-4af8-816a-af492e5548b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:59 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-ada8b2db-07d0-4a8e-8017-a90b604bf013 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Volume ba4bae1f-63d2-48c8-98fb-93d0d664e15d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba4bae1f-63d2-48c8-98fb-93d0d664e15d', 'volume_size': 1} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ada8b2db-07d0-4a8e-8017-a90b604bf013 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ada8b2db-07d0-4a8e-8017-a90b604bf013 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ada8b2db-07d0-4a8e-8017-a90b604bf013 tempest-CreateVolumesFromSnapshotTest-1515277745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1264059620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba4bae1f-63d2-48c8-98fb-93d0d664e15d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53f6576b7a0f40c692116c9034dd19cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:07:59Z,use_quota=True,user_id='9c7096c16fd844c792368b1733d669fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-ada8b2db-07d0-4a8e-8017-a90b604bf013 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Creating volume ba4bae1f-63d2-48c8-98fb-93d0d664e15d {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ada8b2db-07d0-4a8e-8017-a90b604bf013 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ada8b2db-07d0-4a8e-8017-a90b604bf013 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ada8b2db-07d0-4a8e-8017-a90b604bf013 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ada8b2db-07d0-4a8e-8017-a90b604bf013 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ada8b2db-07d0-4a8e-8017-a90b604bf013 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ada8b2db-07d0-4a8e-8017-a90b604bf013 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:07:59 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-ada8b2db-07d0-4a8e-8017-a90b604bf013 tempest-CreateVolumesFromSnapshotTest-1515277745 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ada8b2db-07d0-4a8e-8017-a90b604bf013 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ba4bae1f-63d2-48c8-98fb-93d0d664e15d 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c97bb143-a1f3-431a-a080-5ec99fe79b56 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "cinder-quobyte-9a8fe1a1-6d55-4054-bb65-61f10aeb879d" released by "delete_volume" :: held 1.257s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:07:59 devstack sudo[108895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ba4bae1f-63d2-48c8-98fb-93d0d664e15d 1073741824 Aug 10 13:07:59 devstack sudo[108895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-c97bb143-a1f3-431a-a080-5ec99fe79b56 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Created reservations ['2222a9eb-d2cd-42fe-bd96-0a2cdffbefea', 'f770ebff-08ec-4c69-956a-94b7e6be0623', '4a425823-57cf-4d00-8285-09f09f4bdf3d', 'b97113b7-530f-4f7e-b45f-7bba33284a04'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c97bb143-a1f3-431a-a080-5ec99fe79b56 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c97bb143-a1f3-431a-a080-5ec99fe79b56 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c97bb143-a1f3-431a-a080-5ec99fe79b56 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c97bb143-a1f3-431a-a080-5ec99fe79b56 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c97bb143-a1f3-431a-a080-5ec99fe79b56 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c97bb143-a1f3-431a-a080-5ec99fe79b56 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:59 devstack sudo[108892]: pam_unix(sudo:session): session closed for user root Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5cc72b8f-917b-4e61-9345-d0d1361d99d2_yziyp2sc" returned: 0 in 0.586s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5cc72b8f-917b-4e61-9345-d0d1361d99d2_yziyp2sc {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:07:59 devstack sudo[108899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:07:59 devstack sudo[108899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9950cbe-c630-4181-b94d-51165de03580 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f9950cbe-c630-4181-b94d-51165de03580 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Flow 'volume_create_manager' (827f01fa-7a11-49b2-a9c0-9e984188cc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f9950cbe-c630-4181-b94d-51165de03580 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbf9a800-714d-42bc-b8b6-9ae7d8ea1ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f9950cbe-c630-4181-b94d-51165de03580 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbf9a800-714d-42bc-b8b6-9ae7d8ea1ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1913869429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d25f6e-2391-4adb-9cd6-0ed9a3f1016d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53f6576b7a0f40c692116c9034dd19cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:08:00Z,use_quota=True,user_id='9c7096c16fd844c792368b1733d669fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f9950cbe-c630-4181-b94d-51165de03580 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c28db8e0-bac1-4183-acfd-ab59b4c388ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f9950cbe-c630-4181-b94d-51165de03580 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c28db8e0-bac1-4183-acfd-ab59b4c388ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f9950cbe-c630-4181-b94d-51165de03580 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d3ca758-e656-4536-9162-ba5ab84163df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f9950cbe-c630-4181-b94d-51165de03580 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d3ca758-e656-4536-9162-ba5ab84163df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75d25f6e-2391-4adb-9cd6-0ed9a3f1016d', 'volume_name': 'volume-75d25f6e-2391-4adb-9cd6-0ed9a3f1016d', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f9950cbe-c630-4181-b94d-51165de03580 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (488d92d9-8035-4f63-bd6c-00985553aed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:59 devstack sudo[108903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5cc72b8f-917b-4e61-9345-d0d1361d99d2_yziyp2sc Aug 10 13:07:59 devstack sudo[108903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f9950cbe-c630-4181-b94d-51165de03580 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (488d92d9-8035-4f63-bd6c-00985553aed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f9950cbe-c630-4181-b94d-51165de03580 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a29a312-0be8-4ee2-8733-2df6b4957661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:07:59 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-f9950cbe-c630-4181-b94d-51165de03580 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Volume 75d25f6e-2391-4adb-9cd6-0ed9a3f1016d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75d25f6e-2391-4adb-9cd6-0ed9a3f1016d', 'volume_size': 1} Aug 10 13:07:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f9950cbe-c630-4181-b94d-51165de03580 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:00 devstack sudo[108895]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ada8b2db-07d0-4a8e-8017-a90b604bf013 tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ba4bae1f-63d2-48c8-98fb-93d0d664e15d 1073741824" returned: 0 in 0.880s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:00 devstack sudo[108899]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c97bb143-a1f3-431a-a080-5ec99fe79b56 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.595s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-c97bb143-a1f3-431a-a080-5ec99fe79b56 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:08:00 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-c97bb143-a1f3-431a-a080-5ec99fe79b56 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Deleted volume successfully. Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c97bb143-a1f3-431a-a080-5ec99fe79b56 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "cinder-9a8fe1a1-6d55-4054-bb65-61f10aeb879d-delete_volume" released by "delete_volume" :: held 2.273s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ada8b2db-07d0-4a8e-8017-a90b604bf013 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ba4bae1f-63d2-48c8-98fb-93d0d664e15d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-6bad44ea-3725-4a1d-9b71-25cb4d68e67a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Acquiring lock "cinder-cfa86910-fb1f-4567-936b-6c24f0674415-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:00 devstack sudo[108910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ba4bae1f-63d2-48c8-98fb-93d0d664e15d Aug 10 13:08:00 devstack sudo[108910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:00 devstack sudo[108903]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5cc72b8f-917b-4e61-9345-d0d1361d99d2_yziyp2sc" returned: 1 in 0.692s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5cc72b8f-917b-4e61-9345-d0d1361d99d2_yziyp2sc' failed. Not Retrying. {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[37369bd1-3df8-4f71-8dbc-9d91df426a93]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5cc72b8f-917b-4e61-9345-d0d1361d99d2_fseqa521devstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-6bad44ea-3725-4a1d-9b71-25cb4d68e67a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "cinder-cfa86910-fb1f-4567-936b-6c24f0674415-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-6bad44ea-3725-4a1d-9b71-25cb4d68e67a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Acquiring lock "cinder-quobyte-cfa86910-fb1f-4567-936b-6c24f0674415" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-6bad44ea-3725-4a1d-9b71-25cb4d68e67a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "cinder-quobyte-cfa86910-fb1f-4567-936b-6c24f0674415" acquired by "delete_volume" :: waited 0.033s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[063d65b7-6a44-4b6e-badf-a91da2b395f8]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6bad44ea-3725-4a1d-9b71-25cb4d68e67a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cfa86910-fb1f-4567-936b-6c24f0674415 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5cd23bc-88bd-4532-8468-12c4fa5f1dac tempest-CreateVolumesFromSnapshotTest-1515277745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a5cd23bc-88bd-4532-8468-12c4fa5f1dac tempest-CreateVolumesFromSnapshotTest-1515277745 None] Flow 'volume_create_manager' (de6323b1-0841-4011-b1a2-b50ffe058ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a5cd23bc-88bd-4532-8468-12c4fa5f1dac tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6540477a-8d69-4f33-9672-f77eda4d47ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:00 devstack sudo[108912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5cc72b8f-917b-4e61-9345-d0d1361d99d2_fseqa521devstack@QuobyteHD Aug 10 13:08:00 devstack sudo[108912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a5cd23bc-88bd-4532-8468-12c4fa5f1dac tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6540477a-8d69-4f33-9672-f77eda4d47ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1260272105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=104a4ffd-5723-4f56-b887-4d99f6cfc32f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53f6576b7a0f40c692116c9034dd19cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:08:00Z,use_quota=True,user_id='9c7096c16fd844c792368b1733d669fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:00 devstack sudo[108913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cfa86910-fb1f-4567-936b-6c24f0674415 Aug 10 13:08:00 devstack sudo[108913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a5cd23bc-88bd-4532-8468-12c4fa5f1dac tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac0f86ac-ef1c-4c6f-b01b-e47417e9c2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a5cd23bc-88bd-4532-8468-12c4fa5f1dac tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac0f86ac-ef1c-4c6f-b01b-e47417e9c2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a5cd23bc-88bd-4532-8468-12c4fa5f1dac tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99f30cdf-866a-46f9-b4a1-021bcafe2869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a5cd23bc-88bd-4532-8468-12c4fa5f1dac tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99f30cdf-866a-46f9-b4a1-021bcafe2869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '104a4ffd-5723-4f56-b887-4d99f6cfc32f', 'volume_name': 'volume-104a4ffd-5723-4f56-b887-4d99f6cfc32f', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a5cd23bc-88bd-4532-8468-12c4fa5f1dac tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f93789ab-3b0b-4186-a4e6-0af5aae46f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a5cd23bc-88bd-4532-8468-12c4fa5f1dac tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f93789ab-3b0b-4186-a4e6-0af5aae46f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a5cd23bc-88bd-4532-8468-12c4fa5f1dac tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b34aff05-b172-4cd8-bb5b-5dd8b35853f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:00 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-a5cd23bc-88bd-4532-8468-12c4fa5f1dac tempest-CreateVolumesFromSnapshotTest-1515277745 None] Volume 104a4ffd-5723-4f56-b887-4d99f6cfc32f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-104a4ffd-5723-4f56-b887-4d99f6cfc32f', 'volume_size': 1} Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a5cd23bc-88bd-4532-8468-12c4fa5f1dac tempest-CreateVolumesFromSnapshotTest-1515277745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:00 devstack sudo[108910]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ada8b2db-07d0-4a8e-8017-a90b604bf013 tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ba4bae1f-63d2-48c8-98fb-93d0d664e15d" returned: 0 in 0.515s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ada8b2db-07d0-4a8e-8017-a90b604bf013 tempest-CreateVolumesFromSnapshotTest-1515277745 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ada8b2db-07d0-4a8e-8017-a90b604bf013 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f9950cbe-c630-4181-b94d-51165de03580 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.805s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f9950cbe-c630-4181-b94d-51165de03580 tempest-CreateVolumesFromSnapshotTest-1515277745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1913869429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d25f6e-2391-4adb-9cd6-0ed9a3f1016d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53f6576b7a0f40c692116c9034dd19cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:08:00Z,use_quota=True,user_id='9c7096c16fd844c792368b1733d669fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-f9950cbe-c630-4181-b94d-51165de03580 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Creating volume 75d25f6e-2391-4adb-9cd6-0ed9a3f1016d {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f9950cbe-c630-4181-b94d-51165de03580 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f9950cbe-c630-4181-b94d-51165de03580 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f9950cbe-c630-4181-b94d-51165de03580 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f9950cbe-c630-4181-b94d-51165de03580 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f9950cbe-c630-4181-b94d-51165de03580 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f9950cbe-c630-4181-b94d-51165de03580 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:08:00 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-f9950cbe-c630-4181-b94d-51165de03580 tempest-CreateVolumesFromSnapshotTest-1515277745 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f9950cbe-c630-4181-b94d-51165de03580 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-75d25f6e-2391-4adb-9cd6-0ed9a3f1016d 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:00 devstack sudo[108917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-75d25f6e-2391-4adb-9cd6-0ed9a3f1016d 1073741824 Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ada8b2db-07d0-4a8e-8017-a90b604bf013 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6c0f74b-d570-4af8-816a-af492e5548b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba4bae1f-63d2-48c8-98fb-93d0d664e15d', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:00 devstack sudo[108917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ada8b2db-07d0-4a8e-8017-a90b604bf013 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e27443d8-9561-46cd-9df2-fc85f40e091c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:00 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-ada8b2db-07d0-4a8e-8017-a90b604bf013 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Volume volume-ba4bae1f-63d2-48c8-98fb-93d0d664e15d (ba4bae1f-63d2-48c8-98fb-93d0d664e15d): created successfully Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ada8b2db-07d0-4a8e-8017-a90b604bf013 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e27443d8-9561-46cd-9df2-fc85f40e091c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:00 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ada8b2db-07d0-4a8e-8017-a90b604bf013 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Flow 'volume_create_manager' (d36ae6d8-fce2-4053-912f-11b92545a7b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:08:00 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-ada8b2db-07d0-4a8e-8017-a90b604bf013 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Created volume successfully. Aug 10 13:08:01 devstack sudo[108912]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5cc72b8f-917b-4e61-9345-d0d1361d99d2_fseqa521devstack@QuobyteHD" returned: 0 in 0.685s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5cc72b8f-917b-4e61-9345-d0d1361d99d2_fseqa521devstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c1fc0d0-d8f8-431e-a638-6575b7a8249c tempest-CreateVolumesFromSnapshotTest-1515277745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8c1fc0d0-d8f8-431e-a638-6575b7a8249c tempest-CreateVolumesFromSnapshotTest-1515277745 None] Flow 'volume_create_manager' (1a8582d9-3896-433c-9ff8-c26e52cb0a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8c1fc0d0-d8f8-431e-a638-6575b7a8249c tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a6ea59-e28d-4e5e-b9c3-41ed77775130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:01 devstack sudo[108913]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:01 devstack sudo[108923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5cc72b8f-917b-4e61-9345-d0d1361d99d2_fseqa521devstack@QuobyteHD Aug 10 13:08:01 devstack sudo[108923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6bad44ea-3725-4a1d-9b71-25cb4d68e67a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cfa86910-fb1f-4567-936b-6c24f0674415" returned: 0 in 0.714s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6bad44ea-3725-4a1d-9b71-25cb4d68e67a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cfa86910-fb1f-4567-936b-6c24f0674415 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:01 devstack sudo[108931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cfa86910-fb1f-4567-936b-6c24f0674415 Aug 10 13:08:01 devstack sudo[108931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8c1fc0d0-d8f8-431e-a638-6575b7a8249c tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a6ea59-e28d-4e5e-b9c3-41ed77775130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-480464983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=914608eb-2d89-47af-b383-cf0bdb5e510f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53f6576b7a0f40c692116c9034dd19cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:08:01Z,use_quota=True,user_id='9c7096c16fd844c792368b1733d669fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8c1fc0d0-d8f8-431e-a638-6575b7a8249c tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e0c44e-e760-4552-ae99-bfdb7bf202ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8c1fc0d0-d8f8-431e-a638-6575b7a8249c tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e0c44e-e760-4552-ae99-bfdb7bf202ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8c1fc0d0-d8f8-431e-a638-6575b7a8249c tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfffbdb7-7780-4287-b11e-9fe1fc59c762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8c1fc0d0-d8f8-431e-a638-6575b7a8249c tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfffbdb7-7780-4287-b11e-9fe1fc59c762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '914608eb-2d89-47af-b383-cf0bdb5e510f', 'volume_name': 'volume-914608eb-2d89-47af-b383-cf0bdb5e510f', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8c1fc0d0-d8f8-431e-a638-6575b7a8249c tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a3917b-41c4-467b-8100-c70f0888b7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8c1fc0d0-d8f8-431e-a638-6575b7a8249c tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a3917b-41c4-467b-8100-c70f0888b7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8c1fc0d0-d8f8-431e-a638-6575b7a8249c tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b54e49b-5ea6-45d7-a4ff-add22b434605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:01 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-8c1fc0d0-d8f8-431e-a638-6575b7a8249c tempest-CreateVolumesFromSnapshotTest-1515277745 None] Volume 914608eb-2d89-47af-b383-cf0bdb5e510f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-914608eb-2d89-47af-b383-cf0bdb5e510f', 'volume_size': 1} Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8c1fc0d0-d8f8-431e-a638-6575b7a8249c tempest-CreateVolumesFromSnapshotTest-1515277745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:01 devstack sudo[108917]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f9950cbe-c630-4181-b94d-51165de03580 tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-75d25f6e-2391-4adb-9cd6-0ed9a3f1016d 1073741824" returned: 0 in 0.866s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a3f57ab-8025-4872-8e1e-22e826795dc6 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a3f57ab-8025-4872-8e1e-22e826795dc6 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Flow 'volume_create_manager' (f2e55432-599c-49f7-9b18-f3d4d12b00ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a3f57ab-8025-4872-8e1e-22e826795dc6 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9604660-ef28-4595-997f-62ebcd419a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:01 devstack sudo[108931]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6bad44ea-3725-4a1d-9b71-25cb4d68e67a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cfa86910-fb1f-4567-936b-6c24f0674415" returned: 0 in 0.498s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:01 devstack sudo[108923]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f9950cbe-c630-4181-b94d-51165de03580 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-75d25f6e-2391-4adb-9cd6-0ed9a3f1016d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-6bad44ea-3725-4a1d-9b71-25cb4d68e67a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "cinder-quobyte-cfa86910-fb1f-4567-936b-6c24f0674415" released by "delete_volume" :: held 1.278s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a3f57ab-8025-4872-8e1e-22e826795dc6 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9604660-ef28-4595-997f-62ebcd419a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1793423013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9caa33c9-8281-48e8-b72d-e832aa2b685b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53f6576b7a0f40c692116c9034dd19cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:08:02Z,use_quota=True,user_id='9c7096c16fd844c792368b1733d669fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:01 devstack sudo[108937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-75d25f6e-2391-4adb-9cd6-0ed9a3f1016d Aug 10 13:08:01 devstack sudo[108937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a3f57ab-8025-4872-8e1e-22e826795dc6 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fb4b39a-3d68-48e6-8dd4-20975a107364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a3f57ab-8025-4872-8e1e-22e826795dc6 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fb4b39a-3d68-48e6-8dd4-20975a107364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a3f57ab-8025-4872-8e1e-22e826795dc6 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a16fa61-d0ab-44b1-8921-f8c5ca6f93eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a3f57ab-8025-4872-8e1e-22e826795dc6 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a16fa61-d0ab-44b1-8921-f8c5ca6f93eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9caa33c9-8281-48e8-b72d-e832aa2b685b', 'volume_name': 'volume-9caa33c9-8281-48e8-b72d-e832aa2b685b', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a3f57ab-8025-4872-8e1e-22e826795dc6 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a8b116-e929-4bc1-9b9b-f32727820537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a3f57ab-8025-4872-8e1e-22e826795dc6 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a8b116-e929-4bc1-9b9b-f32727820537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a3f57ab-8025-4872-8e1e-22e826795dc6 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (659ae481-04c2-4a20-9637-fbde4cd1b546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:01 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-1a3f57ab-8025-4872-8e1e-22e826795dc6 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Volume 9caa33c9-8281-48e8-b72d-e832aa2b685b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9caa33c9-8281-48e8-b72d-e832aa2b685b', 'volume_size': 1} Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1a3f57ab-8025-4872-8e1e-22e826795dc6 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5cc72b8f-917b-4e61-9345-d0d1361d99d2_fseqa521devstack@QuobyteHD" returned: 1 in 0.791s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5cc72b8f-917b-4e61-9345-d0d1361d99d2_fseqa521devstack@QuobyteHD' failed. Not Retrying. {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] 5cc72b8f-917b-4e61-9345-d0d1361d99d2 was raw, converting to qcow2 {{(pid=89096) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5cc72b8f-917b-4e61-9345-d0d1361d99d2_fseqa521devstack@QuobyteHD /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cface6a3-621c-4652-8f57-97160aab1e62 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:01 devstack sudo[108939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5cc72b8f-917b-4e61-9345-d0d1361d99d2_fseqa521devstack@QuobyteHD /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cface6a3-621c-4652-8f57-97160aab1e62 Aug 10 13:08:01 devstack sudo[108939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-6bad44ea-3725-4a1d-9b71-25cb4d68e67a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Created reservations ['64f0cb81-5fb6-4c42-accb-3e9e13977629', 'ec149a70-4edd-459d-9268-02e702ec7aba', '6fd51ed5-a211-44dd-9f0e-3066391b999c', '2d165914-c857-421b-83d8-ac822e9ada15'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6bad44ea-3725-4a1d-9b71-25cb4d68e67a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6bad44ea-3725-4a1d-9b71-25cb4d68e67a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6bad44ea-3725-4a1d-9b71-25cb4d68e67a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6bad44ea-3725-4a1d-9b71-25cb4d68e67a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6bad44ea-3725-4a1d-9b71-25cb4d68e67a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6bad44ea-3725-4a1d-9b71-25cb4d68e67a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:02 devstack sudo[108942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:08:02 devstack sudo[108942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:02 devstack sudo[108937]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f9950cbe-c630-4181-b94d-51165de03580 tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-75d25f6e-2391-4adb-9cd6-0ed9a3f1016d" returned: 0 in 0.294s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f9950cbe-c630-4181-b94d-51165de03580 tempest-CreateVolumesFromSnapshotTest-1515277745 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:08:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f9950cbe-c630-4181-b94d-51165de03580 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a5cd23bc-88bd-4532-8468-12c4fa5f1dac tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.293s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a5cd23bc-88bd-4532-8468-12c4fa5f1dac tempest-CreateVolumesFromSnapshotTest-1515277745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1260272105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=104a4ffd-5723-4f56-b887-4d99f6cfc32f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53f6576b7a0f40c692116c9034dd19cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:08:00Z,use_quota=True,user_id='9c7096c16fd844c792368b1733d669fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:08:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-a5cd23bc-88bd-4532-8468-12c4fa5f1dac tempest-CreateVolumesFromSnapshotTest-1515277745 None] Creating volume 104a4ffd-5723-4f56-b887-4d99f6cfc32f {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:08:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a5cd23bc-88bd-4532-8468-12c4fa5f1dac tempest-CreateVolumesFromSnapshotTest-1515277745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a5cd23bc-88bd-4532-8468-12c4fa5f1dac tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a5cd23bc-88bd-4532-8468-12c4fa5f1dac tempest-CreateVolumesFromSnapshotTest-1515277745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a5cd23bc-88bd-4532-8468-12c4fa5f1dac tempest-CreateVolumesFromSnapshotTest-1515277745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a5cd23bc-88bd-4532-8468-12c4fa5f1dac tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a5cd23bc-88bd-4532-8468-12c4fa5f1dac tempest-CreateVolumesFromSnapshotTest-1515277745 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:08:02 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-a5cd23bc-88bd-4532-8468-12c4fa5f1dac tempest-CreateVolumesFromSnapshotTest-1515277745 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:08:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a5cd23bc-88bd-4532-8468-12c4fa5f1dac tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-104a4ffd-5723-4f56-b887-4d99f6cfc32f 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f9950cbe-c630-4181-b94d-51165de03580 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a29a312-0be8-4ee2-8733-2df6b4957661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75d25f6e-2391-4adb-9cd6-0ed9a3f1016d', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f9950cbe-c630-4181-b94d-51165de03580 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daa6b45f-a849-4019-a3ae-7a6756565619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:02 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-f9950cbe-c630-4181-b94d-51165de03580 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Volume volume-75d25f6e-2391-4adb-9cd6-0ed9a3f1016d (75d25f6e-2391-4adb-9cd6-0ed9a3f1016d): created successfully Aug 10 13:08:02 devstack sudo[108944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-104a4ffd-5723-4f56-b887-4d99f6cfc32f 1073741824 Aug 10 13:08:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f9950cbe-c630-4181-b94d-51165de03580 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daa6b45f-a849-4019-a3ae-7a6756565619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:02 devstack sudo[108944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f9950cbe-c630-4181-b94d-51165de03580 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Flow 'volume_create_manager' (827f01fa-7a11-49b2-a9c0-9e984188cc1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:08:02 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-f9950cbe-c630-4181-b94d-51165de03580 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Created volume successfully. Aug 10 13:08:02 devstack sudo[108942]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6bad44ea-3725-4a1d-9b71-25cb4d68e67a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.346s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:02 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-6bad44ea-3725-4a1d-9b71-25cb4d68e67a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:08:02 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-6bad44ea-3725-4a1d-9b71-25cb4d68e67a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Deleted volume successfully. Aug 10 13:08:02 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-6bad44ea-3725-4a1d-9b71-25cb4d68e67a tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "cinder-cfa86910-fb1f-4567-936b-6c24f0674415-delete_volume" released by "delete_volume" :: held 1.991s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:02 devstack sudo[108939]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5cc72b8f-917b-4e61-9345-d0d1361d99d2_fseqa521devstack@QuobyteHD /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cface6a3-621c-4652-8f57-97160aab1e62" returned: 0 in 0.627s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:02 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5cc72b8f-917b-4e61-9345-d0d1361d99d2_fseqa521devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cface6a3-621c-4652-8f57-97160aab1e62 {{(pid=89096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 13:08:02 devstack cinder-volume[89096]: INFO cinder.image.image_utils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Converted 0.00 MB image at 0.00 MB/s Aug 10 13:08:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cface6a3-621c-4652-8f57-97160aab1e62 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:02 devstack sudo[108953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cface6a3-621c-4652-8f57-97160aab1e62 1G Aug 10 13:08:02 devstack sudo[108953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:02 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-eb3c37a9-637f-41f3-ba16-53955cb7c960 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Acquiring lock "cinder-a36f7d9b-f643-40c5-93ee-17a12cb01857-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:02 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-eb3c37a9-637f-41f3-ba16-53955cb7c960 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "cinder-a36f7d9b-f643-40c5-93ee-17a12cb01857-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:02 devstack sudo[108944]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a5cd23bc-88bd-4532-8468-12c4fa5f1dac tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-104a4ffd-5723-4f56-b887-4d99f6cfc32f 1073741824" returned: 0 in 0.711s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:02 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-eb3c37a9-637f-41f3-ba16-53955cb7c960 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Acquiring lock "cinder-quobyte-a36f7d9b-f643-40c5-93ee-17a12cb01857" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:02 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-eb3c37a9-637f-41f3-ba16-53955cb7c960 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "cinder-quobyte-a36f7d9b-f643-40c5-93ee-17a12cb01857" acquired by "delete_volume" :: waited 0.037s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a5cd23bc-88bd-4532-8468-12c4fa5f1dac tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-104a4ffd-5723-4f56-b887-4d99f6cfc32f {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:02 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7b86f5-2720-46a2-991b-c124502263f7]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-eb3c37a9-637f-41f3-ba16-53955cb7c960 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a36f7d9b-f643-40c5-93ee-17a12cb01857 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:02 devstack sudo[108959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-104a4ffd-5723-4f56-b887-4d99f6cfc32f Aug 10 13:08:02 devstack sudo[108959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:02 devstack sudo[108953]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cface6a3-621c-4652-8f57-97160aab1e62 1G" returned: 0 in 0.513s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:02 devstack cinder-volume[89096]: DEBUG cinder.volume.volume_utils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Downloaded image 5cc72b8f-917b-4e61-9345-d0d1361d99d2 ((None, [{'url': 'file:///opt/stack/data/glance/images/5cc72b8f-917b-4e61-9345-d0d1361d99d2', 'metadata': {}}])) to volume cface6a3-621c-4652-8f57-97160aab1e62 successfully. {{(pid=89096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 10 13:08:02 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Temporary image 5cc72b8f-917b-4e61-9345-d0d1361d99d2 for user 0cb899ca5895418cbb012fd5968ef3ad is deleted. {{(pid=89096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 10 13:08:02 devstack cinder-volume[89096]: DEBUG cinder.volume.volume_utils [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Marking volume cface6a3-621c-4652-8f57-97160aab1e62 as bootable. {{(pid=89096) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 10 13:08:02 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Copying metadata from image 5cc72b8f-917b-4e61-9345-d0d1361d99d2 to cface6a3-621c-4652-8f57-97160aab1e62. {{(pid=89096) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 10 13:08:02 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Creating volume glance metadata for volume cface6a3-621c-4652-8f57-97160aab1e62 backed by image 5cc72b8f-917b-4e61-9345-d0d1361d99d2 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '5cc72b8f-917b-4e61-9345-d0d1361d99d2', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '0d1337b60149655efb302abbf7e0463a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89096) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 10 13:08:03 devstack sudo[108960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a36f7d9b-f643-40c5-93ee-17a12cb01857 Aug 10 13:08:03 devstack sudo[108960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fd7fbdc-35af-4005-8bb4-0560bc93de1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cface6a3-621c-4652-8f57-97160aab1e62', 'volume_size': 1, 'image_id': '5cc72b8f-917b-4e61-9345-d0d1361d99d2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5cc72b8f-917b-4e61-9345-d0d1361d99d2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0d1337b60149655efb302abbf7e0463a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3985da827b3846c89088f34461297c5e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dd8e716adea9a2b8f31c1dec4595b632dcb53d1144a80d45901b71f80f396b9596f4ff0d0ba4dcac5f5e318c7a64723e49342b96658b428129d04a7a1bb16e34', 'id': '5cc72b8f-917b-4e61-9345-d0d1361d99d2', 'created_at': datetime.datetime(2026, 8, 10, 11, 7, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 11, 7, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5cc72b8f-917b-4e61-9345-d0d1361d99d2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a25c0a9-4883-4f31-b698-c21526a4c6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:03 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Volume volume-cface6a3-621c-4652-8f57-97160aab1e62 (cface6a3-621c-4652-8f57-97160aab1e62): created successfully Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a25c0a9-4883-4f31-b698-c21526a4c6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Flow 'volume_create_manager' (def75c87-c1b8-4840-b314-3fe11f7ebf9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:08:03 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-c66b11cc-e891-4226-b393-5bd843d80b8c tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Created volume successfully. Aug 10 13:08:03 devstack sudo[108959]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a5cd23bc-88bd-4532-8468-12c4fa5f1dac tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-104a4ffd-5723-4f56-b887-4d99f6cfc32f" returned: 0 in 0.325s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a5cd23bc-88bd-4532-8468-12c4fa5f1dac tempest-CreateVolumesFromSnapshotTest-1515277745 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a5cd23bc-88bd-4532-8468-12c4fa5f1dac tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8c1fc0d0-d8f8-431e-a638-6575b7a8249c tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.790s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8c1fc0d0-d8f8-431e-a638-6575b7a8249c tempest-CreateVolumesFromSnapshotTest-1515277745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-480464983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=914608eb-2d89-47af-b383-cf0bdb5e510f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53f6576b7a0f40c692116c9034dd19cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:08:01Z,use_quota=True,user_id='9c7096c16fd844c792368b1733d669fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-8c1fc0d0-d8f8-431e-a638-6575b7a8249c tempest-CreateVolumesFromSnapshotTest-1515277745 None] Creating volume 914608eb-2d89-47af-b383-cf0bdb5e510f {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8c1fc0d0-d8f8-431e-a638-6575b7a8249c tempest-CreateVolumesFromSnapshotTest-1515277745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8c1fc0d0-d8f8-431e-a638-6575b7a8249c tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8c1fc0d0-d8f8-431e-a638-6575b7a8249c tempest-CreateVolumesFromSnapshotTest-1515277745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8c1fc0d0-d8f8-431e-a638-6575b7a8249c tempest-CreateVolumesFromSnapshotTest-1515277745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8c1fc0d0-d8f8-431e-a638-6575b7a8249c tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8c1fc0d0-d8f8-431e-a638-6575b7a8249c tempest-CreateVolumesFromSnapshotTest-1515277745 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:08:03 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-8c1fc0d0-d8f8-431e-a638-6575b7a8249c tempest-CreateVolumesFromSnapshotTest-1515277745 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c1fc0d0-d8f8-431e-a638-6575b7a8249c tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-914608eb-2d89-47af-b383-cf0bdb5e510f 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a5cd23bc-88bd-4532-8468-12c4fa5f1dac tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b34aff05-b172-4cd8-bb5b-5dd8b35853f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-104a4ffd-5723-4f56-b887-4d99f6cfc32f', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a5cd23bc-88bd-4532-8468-12c4fa5f1dac tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c3ebe74-b633-4cc1-a6d6-8fe5fbd3ee6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:03 devstack sudo[108964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-914608eb-2d89-47af-b383-cf0bdb5e510f 1073741824 Aug 10 13:08:03 devstack sudo[108964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:03 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-a5cd23bc-88bd-4532-8468-12c4fa5f1dac tempest-CreateVolumesFromSnapshotTest-1515277745 None] Volume volume-104a4ffd-5723-4f56-b887-4d99f6cfc32f (104a4ffd-5723-4f56-b887-4d99f6cfc32f): created successfully Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a5cd23bc-88bd-4532-8468-12c4fa5f1dac tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c3ebe74-b633-4cc1-a6d6-8fe5fbd3ee6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a5cd23bc-88bd-4532-8468-12c4fa5f1dac tempest-CreateVolumesFromSnapshotTest-1515277745 None] Flow 'volume_create_manager' (de6323b1-0841-4011-b1a2-b50ffe058ce0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:08:03 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-a5cd23bc-88bd-4532-8468-12c4fa5f1dac tempest-CreateVolumesFromSnapshotTest-1515277745 None] Created volume successfully. Aug 10 13:08:03 devstack sudo[108960]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-eb3c37a9-637f-41f3-ba16-53955cb7c960 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a36f7d9b-f643-40c5-93ee-17a12cb01857" returned: 0 in 0.463s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-eb3c37a9-637f-41f3-ba16-53955cb7c960 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a36f7d9b-f643-40c5-93ee-17a12cb01857 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:03 devstack sudo[108969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a36f7d9b-f643-40c5-93ee-17a12cb01857 Aug 10 13:08:03 devstack sudo[108969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4a8ec8e5-84ed-4cf6-ada9-cc47b6cffccf tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Acquiring lock "cinder-cface6a3-621c-4652-8f57-97160aab1e62-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4a8ec8e5-84ed-4cf6-ada9-cc47b6cffccf tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Lock "cinder-cface6a3-621c-4652-8f57-97160aab1e62-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4a8ec8e5-84ed-4cf6-ada9-cc47b6cffccf tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Acquiring lock "cinder-quobyte-cface6a3-621c-4652-8f57-97160aab1e62" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4a8ec8e5-84ed-4cf6-ada9-cc47b6cffccf tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Lock "cinder-quobyte-cface6a3-621c-4652-8f57-97160aab1e62" acquired by "delete_volume" :: waited 0.023s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[a660be26-2e71-47ad-9984-76f558897dbd]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4a8ec8e5-84ed-4cf6-ada9-cc47b6cffccf tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cface6a3-621c-4652-8f57-97160aab1e62 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:03 devstack sudo[108969]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-eb3c37a9-637f-41f3-ba16-53955cb7c960 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-a36f7d9b-f643-40c5-93ee-17a12cb01857" returned: 0 in 0.350s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-eb3c37a9-637f-41f3-ba16-53955cb7c960 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "cinder-quobyte-a36f7d9b-f643-40c5-93ee-17a12cb01857" released by "delete_volume" :: held 0.881s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:03 devstack sudo[108975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cface6a3-621c-4652-8f57-97160aab1e62 Aug 10 13:08:03 devstack sudo[108975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-eb3c37a9-637f-41f3-ba16-53955cb7c960 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Created reservations ['300689a3-95a7-44dd-91b6-fa14f08c7d58', '2af92e60-2056-493f-9f06-96420cf65384', '38601544-acbd-44fd-a81d-5db6a4fbdc61', '2d35196c-f2f1-4dfa-ae27-2838de23e289'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:08:03 devstack sudo[108964]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c1fc0d0-d8f8-431e-a638-6575b7a8249c tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-914608eb-2d89-47af-b383-cf0bdb5e510f 1073741824" returned: 0 in 0.676s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-eb3c37a9-637f-41f3-ba16-53955cb7c960 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-eb3c37a9-637f-41f3-ba16-53955cb7c960 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-eb3c37a9-637f-41f3-ba16-53955cb7c960 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-eb3c37a9-637f-41f3-ba16-53955cb7c960 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-eb3c37a9-637f-41f3-ba16-53955cb7c960 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-eb3c37a9-637f-41f3-ba16-53955cb7c960 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:03 devstack sudo[108978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:08:03 devstack sudo[108978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a5331965-720d-48f6-9bc1-21eeaee71697 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Acquiring lock "cinder-390bf0aa-cfd1-4681-9698-b4a79d9db2c8-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:04 devstack sudo[108979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:08:04 devstack sudo[108979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c1fc0d0-d8f8-431e-a638-6575b7a8249c tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-914608eb-2d89-47af-b383-cf0bdb5e510f {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a5331965-720d-48f6-9bc1-21eeaee71697 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "cinder-390bf0aa-cfd1-4681-9698-b4a79d9db2c8-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:04 devstack sudo[108984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-914608eb-2d89-47af-b383-cf0bdb5e510f Aug 10 13:08:04 devstack sudo[108984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a5331965-720d-48f6-9bc1-21eeaee71697 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Acquiring lock "cinder-quobyte-390bf0aa-cfd1-4681-9698-b4a79d9db2c8" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a5331965-720d-48f6-9bc1-21eeaee71697 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "cinder-quobyte-390bf0aa-cfd1-4681-9698-b4a79d9db2c8" acquired by "delete_volume" :: waited 0.025s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:04 devstack sudo[108975]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4a8ec8e5-84ed-4cf6-ada9-cc47b6cffccf tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cface6a3-621c-4652-8f57-97160aab1e62" returned: 0 in 0.608s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4a8ec8e5-84ed-4cf6-ada9-cc47b6cffccf tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cface6a3-621c-4652-8f57-97160aab1e62 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3848a3-099b-4bbb-9c4d-55156535dee5]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a5331965-720d-48f6-9bc1-21eeaee71697 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-390bf0aa-cfd1-4681-9698-b4a79d9db2c8 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:04 devstack sudo[108987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cface6a3-621c-4652-8f57-97160aab1e62 Aug 10 13:08:04 devstack sudo[108987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:04 devstack sudo[108979]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.435s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:08:04 devstack sudo[108984]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager._thread_info {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread count: 28 {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread info: [<_MainThread(MainThread, started 130607683133568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c1fc0d0-d8f8-431e-a638-6575b7a8249c tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-914608eb-2d89-47af-b383-cf0bdb5e510f" returned: 0 in 0.378s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8c1fc0d0-d8f8-431e-a638-6575b7a8249c tempest-CreateVolumesFromSnapshotTest-1515277745 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8c1fc0d0-d8f8-431e-a638-6575b7a8249c tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1a3f57ab-8025-4872-8e1e-22e826795dc6 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.605s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1a3f57ab-8025-4872-8e1e-22e826795dc6 tempest-CreateVolumesFromSnapshotTest-1515277745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1793423013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9caa33c9-8281-48e8-b72d-e832aa2b685b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53f6576b7a0f40c692116c9034dd19cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:08:02Z,use_quota=True,user_id='9c7096c16fd844c792368b1733d669fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-1a3f57ab-8025-4872-8e1e-22e826795dc6 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Creating volume 9caa33c9-8281-48e8-b72d-e832aa2b685b {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1a3f57ab-8025-4872-8e1e-22e826795dc6 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1a3f57ab-8025-4872-8e1e-22e826795dc6 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1a3f57ab-8025-4872-8e1e-22e826795dc6 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1a3f57ab-8025-4872-8e1e-22e826795dc6 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1a3f57ab-8025-4872-8e1e-22e826795dc6 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1a3f57ab-8025-4872-8e1e-22e826795dc6 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:08:04 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-1a3f57ab-8025-4872-8e1e-22e826795dc6 tempest-CreateVolumesFromSnapshotTest-1515277745 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1a3f57ab-8025-4872-8e1e-22e826795dc6 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9caa33c9-8281-48e8-b72d-e832aa2b685b 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:04 devstack sudo[108988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-390bf0aa-cfd1-4681-9698-b4a79d9db2c8 Aug 10 13:08:04 devstack sudo[108978]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:04 devstack sudo[108988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-eb3c37a9-637f-41f3-ba16-53955cb7c960 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.563s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-eb3c37a9-637f-41f3-ba16-53955cb7c960 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8c1fc0d0-d8f8-431e-a638-6575b7a8249c tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b54e49b-5ea6-45d7-a4ff-add22b434605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-914608eb-2d89-47af-b383-cf0bdb5e510f', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:04 devstack sudo[108993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9caa33c9-8281-48e8-b72d-e832aa2b685b 1073741824 Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8c1fc0d0-d8f8-431e-a638-6575b7a8249c tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4581a6c8-d963-4cea-aabb-a603769a94f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:04 devstack sudo[108993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:04 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-eb3c37a9-637f-41f3-ba16-53955cb7c960 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Deleted volume successfully. Aug 10 13:08:04 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-8c1fc0d0-d8f8-431e-a638-6575b7a8249c tempest-CreateVolumesFromSnapshotTest-1515277745 None] Volume volume-914608eb-2d89-47af-b383-cf0bdb5e510f (914608eb-2d89-47af-b383-cf0bdb5e510f): created successfully Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8c1fc0d0-d8f8-431e-a638-6575b7a8249c tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4581a6c8-d963-4cea-aabb-a603769a94f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8c1fc0d0-d8f8-431e-a638-6575b7a8249c tempest-CreateVolumesFromSnapshotTest-1515277745 None] Flow 'volume_create_manager' (1a8582d9-3896-433c-9ff8-c26e52cb0a5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-eb3c37a9-637f-41f3-ba16-53955cb7c960 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "cinder-a36f7d9b-f643-40c5-93ee-17a12cb01857-delete_volume" released by "delete_volume" :: held 1.823s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:04 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-8c1fc0d0-d8f8-431e-a638-6575b7a8249c tempest-CreateVolumesFromSnapshotTest-1515277745 None] Created volume successfully. Aug 10 13:08:04 devstack sudo[108987]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4a8ec8e5-84ed-4cf6-ada9-cc47b6cffccf tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-cface6a3-621c-4652-8f57-97160aab1e62" returned: 0 in 0.383s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4a8ec8e5-84ed-4cf6-ada9-cc47b6cffccf tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Lock "cinder-quobyte-cface6a3-621c-4652-8f57-97160aab1e62" released by "delete_volume" :: held 1.073s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-4a8ec8e5-84ed-4cf6-ada9-cc47b6cffccf tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Created reservations ['324a826d-f1de-410a-b7f7-c8a9cb862757', '90d34caf-2820-4658-beab-606327130b67', 'd963adb7-18ff-46cf-908b-8ddf77c04fe8', '2e7e1cd7-91cd-4599-8630-ec0e683fa58d'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4a8ec8e5-84ed-4cf6-ada9-cc47b6cffccf tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4a8ec8e5-84ed-4cf6-ada9-cc47b6cffccf tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4a8ec8e5-84ed-4cf6-ada9-cc47b6cffccf tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4a8ec8e5-84ed-4cf6-ada9-cc47b6cffccf tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4a8ec8e5-84ed-4cf6-ada9-cc47b6cffccf tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4a8ec8e5-84ed-4cf6-ada9-cc47b6cffccf tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:04 devstack sudo[108988]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a5331965-720d-48f6-9bc1-21eeaee71697 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-390bf0aa-cfd1-4681-9698-b4a79d9db2c8" returned: 0 in 0.573s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a5331965-720d-48f6-9bc1-21eeaee71697 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-390bf0aa-cfd1-4681-9698-b4a79d9db2c8 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:04 devstack sudo[109003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:08:04 devstack sudo[109003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:04 devstack sudo[109005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-390bf0aa-cfd1-4681-9698-b4a79d9db2c8 Aug 10 13:08:04 devstack sudo[109005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:05 devstack sudo[108993]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1a3f57ab-8025-4872-8e1e-22e826795dc6 tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9caa33c9-8281-48e8-b72d-e832aa2b685b 1073741824" returned: 0 in 0.623s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:05 devstack sudo[109003]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4a8ec8e5-84ed-4cf6-ada9-cc47b6cffccf tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.290s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:05 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-4a8ec8e5-84ed-4cf6-ada9-cc47b6cffccf tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:08:05 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-4a8ec8e5-84ed-4cf6-ada9-cc47b6cffccf tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Deleted volume successfully. Aug 10 13:08:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1a3f57ab-8025-4872-8e1e-22e826795dc6 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9caa33c9-8281-48e8-b72d-e832aa2b685b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:05 devstack sudo[109011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9caa33c9-8281-48e8-b72d-e832aa2b685b Aug 10 13:08:05 devstack sudo[109011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:05 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4a8ec8e5-84ed-4cf6-ada9-cc47b6cffccf tempest-VolumeAndVolumeTypeFromImageTest-1544466748 None] Lock "cinder-cface6a3-621c-4652-8f57-97160aab1e62-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:05 devstack sudo[109005]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a5331965-720d-48f6-9bc1-21eeaee71697 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-390bf0aa-cfd1-4681-9698-b4a79d9db2c8" returned: 0 in 0.338s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:05 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a5331965-720d-48f6-9bc1-21eeaee71697 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "cinder-quobyte-390bf0aa-cfd1-4681-9698-b4a79d9db2c8" released by "delete_volume" :: held 1.015s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:05 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-a5331965-720d-48f6-9bc1-21eeaee71697 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Created reservations ['abbb9050-fb22-44b9-9fbe-9ce9e909e873', 'd5b5ef7e-73f4-4f2d-ab12-be4dca7e565c', '7ca559d8-171a-401c-a3c8-28f104bf7d3e', 'eef5eab8-849d-4ce0-bb96-7ae9662e5fab'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:08:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a5331965-720d-48f6-9bc1-21eeaee71697 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a5331965-720d-48f6-9bc1-21eeaee71697 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a5331965-720d-48f6-9bc1-21eeaee71697 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a5331965-720d-48f6-9bc1-21eeaee71697 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a5331965-720d-48f6-9bc1-21eeaee71697 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a5331965-720d-48f6-9bc1-21eeaee71697 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:05 devstack sudo[109013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:08:05 devstack sudo[109013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:05 devstack sudo[109011]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1a3f57ab-8025-4872-8e1e-22e826795dc6 tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9caa33c9-8281-48e8-b72d-e832aa2b685b" returned: 0 in 0.347s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1a3f57ab-8025-4872-8e1e-22e826795dc6 tempest-CreateVolumesFromSnapshotTest-1515277745 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:08:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1a3f57ab-8025-4872-8e1e-22e826795dc6 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a3f57ab-8025-4872-8e1e-22e826795dc6 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (659ae481-04c2-4a20-9637-fbde4cd1b546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9caa33c9-8281-48e8-b72d-e832aa2b685b', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a3f57ab-8025-4872-8e1e-22e826795dc6 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d801bf1-da22-49db-adb8-a04498adcd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:05 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-1a3f57ab-8025-4872-8e1e-22e826795dc6 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Volume volume-9caa33c9-8281-48e8-b72d-e832aa2b685b (9caa33c9-8281-48e8-b72d-e832aa2b685b): created successfully Aug 10 13:08:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a3f57ab-8025-4872-8e1e-22e826795dc6 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d801bf1-da22-49db-adb8-a04498adcd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a3f57ab-8025-4872-8e1e-22e826795dc6 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Flow 'volume_create_manager' (f2e55432-599c-49f7-9b18-f3d4d12b00ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:08:05 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-1a3f57ab-8025-4872-8e1e-22e826795dc6 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Created volume successfully. Aug 10 13:08:05 devstack sudo[109013]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a5331965-720d-48f6-9bc1-21eeaee71697 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.284s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:05 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-a5331965-720d-48f6-9bc1-21eeaee71697 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:08:05 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-a5331965-720d-48f6-9bc1-21eeaee71697 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Deleted volume successfully. Aug 10 13:08:05 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a5331965-720d-48f6-9bc1-21eeaee71697 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "cinder-390bf0aa-cfd1-4681-9698-b4a79d9db2c8-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:06 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d0f11617-3a9c-4021-800c-3e1bf89fa556 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Acquiring lock "cinder-2b9d6fd5-a7dc-4e96-ac06-3161123425a7-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:06 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d0f11617-3a9c-4021-800c-3e1bf89fa556 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "cinder-2b9d6fd5-a7dc-4e96-ac06-3161123425a7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:06 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d356b73f-8760-44c6-8b6e-a463d14dd196 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Acquiring lock "cinder-9caa33c9-8281-48e8-b72d-e832aa2b685b-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:06 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d0f11617-3a9c-4021-800c-3e1bf89fa556 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Acquiring lock "cinder-quobyte-2b9d6fd5-a7dc-4e96-ac06-3161123425a7" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:06 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d356b73f-8760-44c6-8b6e-a463d14dd196 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "cinder-9caa33c9-8281-48e8-b72d-e832aa2b685b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:06 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d0f11617-3a9c-4021-800c-3e1bf89fa556 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "cinder-quobyte-2b9d6fd5-a7dc-4e96-ac06-3161123425a7" acquired by "delete_volume" :: waited 0.033s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:06 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eaa7770-e0d7-46f3-b204-dec1ee89d44a]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d0f11617-3a9c-4021-800c-3e1bf89fa556 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2b9d6fd5-a7dc-4e96-ac06-3161123425a7 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:06 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d356b73f-8760-44c6-8b6e-a463d14dd196 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Acquiring lock "cinder-quobyte-9caa33c9-8281-48e8-b72d-e832aa2b685b" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:06 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d356b73f-8760-44c6-8b6e-a463d14dd196 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "cinder-quobyte-9caa33c9-8281-48e8-b72d-e832aa2b685b" acquired by "delete_volume" :: waited 0.029s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:06 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[f245ab28-8d63-4ebf-b853-74c78514df7a]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d356b73f-8760-44c6-8b6e-a463d14dd196 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9caa33c9-8281-48e8-b72d-e832aa2b685b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:06 devstack sudo[109017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2b9d6fd5-a7dc-4e96-ac06-3161123425a7 Aug 10 13:08:06 devstack sudo[109017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:06 devstack sudo[109018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9caa33c9-8281-48e8-b72d-e832aa2b685b Aug 10 13:08:06 devstack sudo[109018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:07 devstack sudo[109017]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d0f11617-3a9c-4021-800c-3e1bf89fa556 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2b9d6fd5-a7dc-4e96-ac06-3161123425a7" returned: 0 in 0.532s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d0f11617-3a9c-4021-800c-3e1bf89fa556 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2b9d6fd5-a7dc-4e96-ac06-3161123425a7 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:07 devstack sudo[109026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2b9d6fd5-a7dc-4e96-ac06-3161123425a7 Aug 10 13:08:07 devstack sudo[109026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:07 devstack sudo[109018]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d356b73f-8760-44c6-8b6e-a463d14dd196 tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9caa33c9-8281-48e8-b72d-e832aa2b685b" returned: 0 in 0.502s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d356b73f-8760-44c6-8b6e-a463d14dd196 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9caa33c9-8281-48e8-b72d-e832aa2b685b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:07 devstack sudo[109029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9caa33c9-8281-48e8-b72d-e832aa2b685b Aug 10 13:08:07 devstack sudo[109029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:07 devstack sudo[109026]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d0f11617-3a9c-4021-800c-3e1bf89fa556 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-2b9d6fd5-a7dc-4e96-ac06-3161123425a7" returned: 0 in 0.327s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:07 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d0f11617-3a9c-4021-800c-3e1bf89fa556 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "cinder-quobyte-2b9d6fd5-a7dc-4e96-ac06-3161123425a7" released by "delete_volume" :: held 0.925s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:07 devstack sudo[109029]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d356b73f-8760-44c6-8b6e-a463d14dd196 tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-9caa33c9-8281-48e8-b72d-e832aa2b685b" returned: 0 in 0.316s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:07 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d356b73f-8760-44c6-8b6e-a463d14dd196 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "cinder-quobyte-9caa33c9-8281-48e8-b72d-e832aa2b685b" released by "delete_volume" :: held 0.916s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:07 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-d0f11617-3a9c-4021-800c-3e1bf89fa556 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Created reservations ['b4249c19-4218-4213-ba00-961b756b93db', 'd9b0503b-aa6f-4981-8e98-4c459b0e8ea7', 'eb453cde-d100-4139-b0c3-486dfffc3b69', '0aba3cb1-9900-431d-b091-2f9f07742f33'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:08:07 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-d356b73f-8760-44c6-8b6e-a463d14dd196 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Created reservations ['5099db63-3883-4f09-8910-1b766e62b017', 'bcd4377c-1884-4966-be31-c3d9940a3bb7', '7bd4257b-7ee0-4270-8dad-c4fe0762dc8f', '9c382e40-5d16-4f3d-b6d9-529b47c7721c'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:08:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d0f11617-3a9c-4021-800c-3e1bf89fa556 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d0f11617-3a9c-4021-800c-3e1bf89fa556 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:07 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-d0f11617-3a9c-4021-800c-3e1bf89fa556 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:07 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-d0f11617-3a9c-4021-800c-3e1bf89fa556 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d0f11617-3a9c-4021-800c-3e1bf89fa556 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d0f11617-3a9c-4021-800c-3e1bf89fa556 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:07 devstack sudo[109033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:08:07 devstack sudo[109033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d356b73f-8760-44c6-8b6e-a463d14dd196 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d356b73f-8760-44c6-8b6e-a463d14dd196 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:07 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-d356b73f-8760-44c6-8b6e-a463d14dd196 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:07 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-d356b73f-8760-44c6-8b6e-a463d14dd196 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d356b73f-8760-44c6-8b6e-a463d14dd196 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d356b73f-8760-44c6-8b6e-a463d14dd196 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:07 devstack sudo[109035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:08:07 devstack sudo[109035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:08 devstack sudo[109033]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d0f11617-3a9c-4021-800c-3e1bf89fa556 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.333s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:08 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-d0f11617-3a9c-4021-800c-3e1bf89fa556 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:08:08 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-d0f11617-3a9c-4021-800c-3e1bf89fa556 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Deleted volume successfully. Aug 10 13:08:08 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d0f11617-3a9c-4021-800c-3e1bf89fa556 tempest-CreateVolumesFromSourceVolumeTest-1584734707 None] Lock "cinder-2b9d6fd5-a7dc-4e96-ac06-3161123425a7-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:08 devstack sudo[109035]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d356b73f-8760-44c6-8b6e-a463d14dd196 tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.407s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:08 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-d356b73f-8760-44c6-8b6e-a463d14dd196 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:08:08 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-d356b73f-8760-44c6-8b6e-a463d14dd196 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Deleted volume successfully. Aug 10 13:08:08 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d356b73f-8760-44c6-8b6e-a463d14dd196 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "cinder-9caa33c9-8281-48e8-b72d-e832aa2b685b-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:08 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0a785bd0-f2c4-472c-afa2-ba40585bdeb9 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Acquiring lock "cinder-914608eb-2d89-47af-b383-cf0bdb5e510f-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:08 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0a785bd0-f2c4-472c-afa2-ba40585bdeb9 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "cinder-914608eb-2d89-47af-b383-cf0bdb5e510f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:08 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0a785bd0-f2c4-472c-afa2-ba40585bdeb9 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Acquiring lock "cinder-quobyte-914608eb-2d89-47af-b383-cf0bdb5e510f" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:08 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0a785bd0-f2c4-472c-afa2-ba40585bdeb9 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "cinder-quobyte-914608eb-2d89-47af-b383-cf0bdb5e510f" acquired by "delete_volume" :: waited 0.024s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:09 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d950dd-25ed-4f6d-9022-2620a5e992ba]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0a785bd0-f2c4-472c-afa2-ba40585bdeb9 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-914608eb-2d89-47af-b383-cf0bdb5e510f {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:09 devstack sudo[109040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-914608eb-2d89-47af-b383-cf0bdb5e510f Aug 10 13:08:09 devstack sudo[109040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:09 devstack sudo[109040]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0a785bd0-f2c4-472c-afa2-ba40585bdeb9 tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-914608eb-2d89-47af-b383-cf0bdb5e510f" returned: 0 in 0.523s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0a785bd0-f2c4-472c-afa2-ba40585bdeb9 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-914608eb-2d89-47af-b383-cf0bdb5e510f {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:09 devstack sudo[109046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-914608eb-2d89-47af-b383-cf0bdb5e510f Aug 10 13:08:09 devstack sudo[109046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:09 devstack sudo[109046]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0a785bd0-f2c4-472c-afa2-ba40585bdeb9 tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-914608eb-2d89-47af-b383-cf0bdb5e510f" returned: 0 in 0.445s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0a785bd0-f2c4-472c-afa2-ba40585bdeb9 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "cinder-quobyte-914608eb-2d89-47af-b383-cf0bdb5e510f" released by "delete_volume" :: held 1.035s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:10 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-0a785bd0-f2c4-472c-afa2-ba40585bdeb9 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Created reservations ['44a4e7b7-bd25-4267-9f9e-3cf17d902dbe', 'f97118a0-ccea-4f87-99ec-f91cc45c084e', 'b427b15d-a717-4c3b-a90d-b2eb0f1893cd', '2904dc35-6789-4687-91f3-654c994bad52'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:08:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0a785bd0-f2c4-472c-afa2-ba40585bdeb9 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0a785bd0-f2c4-472c-afa2-ba40585bdeb9 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0a785bd0-f2c4-472c-afa2-ba40585bdeb9 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0a785bd0-f2c4-472c-afa2-ba40585bdeb9 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0a785bd0-f2c4-472c-afa2-ba40585bdeb9 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0a785bd0-f2c4-472c-afa2-ba40585bdeb9 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:10 devstack sudo[109049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:08:10 devstack sudo[109049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:10 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-961fbfcb-9f8c-4200-8bba-ea9ae2ecb828 tempest-ProjectReaderTests-1094401723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:08:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-961fbfcb-9f8c-4200-8bba-ea9ae2ecb828 tempest-ProjectReaderTests-1094401723 None] Flow 'volume_create_manager' (6f90bad5-78af-4b48-b269-a0b78d04b7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:08:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-961fbfcb-9f8c-4200-8bba-ea9ae2ecb828 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (297356bf-751b-479a-b764-7cec66f23cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-961fbfcb-9f8c-4200-8bba-ea9ae2ecb828 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (297356bf-751b-479a-b764-7cec66f23cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-674249368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f9991a-bd53-4eee-9404-597f612bf849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3fbef4ea4b40c2b96647d90e846ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:08:10Z,use_quota=True,user_id='4d8ab61bc38544b882b64c5a57855803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-961fbfcb-9f8c-4200-8bba-ea9ae2ecb828 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f71abae5-eacb-408b-bf3f-322d01426bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-961fbfcb-9f8c-4200-8bba-ea9ae2ecb828 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f71abae5-eacb-408b-bf3f-322d01426bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-961fbfcb-9f8c-4200-8bba-ea9ae2ecb828 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce541187-9b7a-4835-8ece-561ba9150583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-961fbfcb-9f8c-4200-8bba-ea9ae2ecb828 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce541187-9b7a-4835-8ece-561ba9150583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2f9991a-bd53-4eee-9404-597f612bf849', 'volume_name': 'volume-b2f9991a-bd53-4eee-9404-597f612bf849', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-961fbfcb-9f8c-4200-8bba-ea9ae2ecb828 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15315bb6-8b67-4fa0-b84f-3d42a8b81de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-961fbfcb-9f8c-4200-8bba-ea9ae2ecb828 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15315bb6-8b67-4fa0-b84f-3d42a8b81de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-961fbfcb-9f8c-4200-8bba-ea9ae2ecb828 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0323328a-7aff-4cfd-b212-c1190e8d6b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:10 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-961fbfcb-9f8c-4200-8bba-ea9ae2ecb828 tempest-ProjectReaderTests-1094401723 None] Volume b2f9991a-bd53-4eee-9404-597f612bf849: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2f9991a-bd53-4eee-9404-597f612bf849', 'volume_size': 1} Aug 10 13:08:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-961fbfcb-9f8c-4200-8bba-ea9ae2ecb828 tempest-ProjectReaderTests-1094401723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-961fbfcb-9f8c-4200-8bba-ea9ae2ecb828 tempest-ProjectReaderTests-1094401723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-961fbfcb-9f8c-4200-8bba-ea9ae2ecb828 tempest-ProjectReaderTests-1094401723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-674249368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f9991a-bd53-4eee-9404-597f612bf849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3fbef4ea4b40c2b96647d90e846ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:08:10Z,use_quota=True,user_id='4d8ab61bc38544b882b64c5a57855803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:08:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-961fbfcb-9f8c-4200-8bba-ea9ae2ecb828 tempest-ProjectReaderTests-1094401723 None] Creating volume b2f9991a-bd53-4eee-9404-597f612bf849 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:08:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-961fbfcb-9f8c-4200-8bba-ea9ae2ecb828 tempest-ProjectReaderTests-1094401723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-961fbfcb-9f8c-4200-8bba-ea9ae2ecb828 tempest-ProjectReaderTests-1094401723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-961fbfcb-9f8c-4200-8bba-ea9ae2ecb828 tempest-ProjectReaderTests-1094401723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-961fbfcb-9f8c-4200-8bba-ea9ae2ecb828 tempest-ProjectReaderTests-1094401723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-961fbfcb-9f8c-4200-8bba-ea9ae2ecb828 tempest-ProjectReaderTests-1094401723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-961fbfcb-9f8c-4200-8bba-ea9ae2ecb828 tempest-ProjectReaderTests-1094401723 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:08:10 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-961fbfcb-9f8c-4200-8bba-ea9ae2ecb828 tempest-ProjectReaderTests-1094401723 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:08:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-961fbfcb-9f8c-4200-8bba-ea9ae2ecb828 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:10 devstack sudo[109051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849 1073741824 Aug 10 13:08:10 devstack sudo[109051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:10 devstack sudo[109049]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0a785bd0-f2c4-472c-afa2-ba40585bdeb9 tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.380s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:10 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-0a785bd0-f2c4-472c-afa2-ba40585bdeb9 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:08:10 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-0a785bd0-f2c4-472c-afa2-ba40585bdeb9 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Deleted volume successfully. Aug 10 13:08:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0a785bd0-f2c4-472c-afa2-ba40585bdeb9 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "cinder-914608eb-2d89-47af-b383-cf0bdb5e510f-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:10 devstack sudo[109051]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-961fbfcb-9f8c-4200-8bba-ea9ae2ecb828 tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849 1073741824" returned: 0 in 0.541s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-961fbfcb-9f8c-4200-8bba-ea9ae2ecb828 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:10 devstack sudo[109058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849 Aug 10 13:08:10 devstack sudo[109058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:11 devstack sudo[109058]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-961fbfcb-9f8c-4200-8bba-ea9ae2ecb828 tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849" returned: 0 in 0.290s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:11 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-961fbfcb-9f8c-4200-8bba-ea9ae2ecb828 tempest-ProjectReaderTests-1094401723 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:08:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-961fbfcb-9f8c-4200-8bba-ea9ae2ecb828 tempest-ProjectReaderTests-1094401723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-961fbfcb-9f8c-4200-8bba-ea9ae2ecb828 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0323328a-7aff-4cfd-b212-c1190e8d6b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2f9991a-bd53-4eee-9404-597f612bf849', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-961fbfcb-9f8c-4200-8bba-ea9ae2ecb828 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1732bbbe-51a0-4a00-bf33-db7ac5b2cd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:11 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-6a22bfb5-5878-44d6-83fd-11a1bfb1328f tempest-CreateVolumesFromSnapshotTest-1515277745 None] Acquiring lock "cinder-104a4ffd-5723-4f56-b887-4d99f6cfc32f-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:11 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-961fbfcb-9f8c-4200-8bba-ea9ae2ecb828 tempest-ProjectReaderTests-1094401723 None] Volume volume-b2f9991a-bd53-4eee-9404-597f612bf849 (b2f9991a-bd53-4eee-9404-597f612bf849): created successfully Aug 10 13:08:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-961fbfcb-9f8c-4200-8bba-ea9ae2ecb828 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1732bbbe-51a0-4a00-bf33-db7ac5b2cd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-961fbfcb-9f8c-4200-8bba-ea9ae2ecb828 tempest-ProjectReaderTests-1094401723 None] Flow 'volume_create_manager' (6f90bad5-78af-4b48-b269-a0b78d04b7cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:08:11 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-6a22bfb5-5878-44d6-83fd-11a1bfb1328f tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "cinder-104a4ffd-5723-4f56-b887-4d99f6cfc32f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:11 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-961fbfcb-9f8c-4200-8bba-ea9ae2ecb828 tempest-ProjectReaderTests-1094401723 None] Created volume successfully. Aug 10 13:08:11 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-6a22bfb5-5878-44d6-83fd-11a1bfb1328f tempest-CreateVolumesFromSnapshotTest-1515277745 None] Acquiring lock "cinder-quobyte-104a4ffd-5723-4f56-b887-4d99f6cfc32f" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:11 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-6a22bfb5-5878-44d6-83fd-11a1bfb1328f tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "cinder-quobyte-104a4ffd-5723-4f56-b887-4d99f6cfc32f" acquired by "delete_volume" :: waited 0.017s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:11 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[766700ed-1e31-42ca-8821-350efd3cc13f]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6a22bfb5-5878-44d6-83fd-11a1bfb1328f tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-104a4ffd-5723-4f56-b887-4d99f6cfc32f {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:11 devstack sudo[109061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-104a4ffd-5723-4f56-b887-4d99f6cfc32f Aug 10 13:08:11 devstack sudo[109061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:11 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2d32b0a-d880-45e5-8104-19eec25344cf tempest-CinderUnicodeTest-19796481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:08:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b2d32b0a-d880-45e5-8104-19eec25344cf tempest-CinderUnicodeTest-19796481 None] Flow 'volume_create_manager' (c134237b-d359-40d4-b8b0-11d05fc73296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:08:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b2d32b0a-d880-45e5-8104-19eec25344cf tempest-CinderUnicodeTest-19796481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c76fcc-e48e-499f-aa8b-b3ee1fb259ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b2d32b0a-d880-45e5-8104-19eec25344cf tempest-CinderUnicodeTest-19796481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c76fcc-e48e-499f-aa8b-b3ee1fb259ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cf10b4d-c4b3-46cf-806c-c45057359311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bd0e35d10394ee688374afe5aca594b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:08:12Z,use_quota=True,user_id='fcf35d7b5d4241a283aeae4e2b21e47d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b2d32b0a-d880-45e5-8104-19eec25344cf tempest-CinderUnicodeTest-19796481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d876c445-cd5b-408f-adb0-12d759f60aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b2d32b0a-d880-45e5-8104-19eec25344cf tempest-CinderUnicodeTest-19796481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d876c445-cd5b-408f-adb0-12d759f60aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b2d32b0a-d880-45e5-8104-19eec25344cf tempest-CinderUnicodeTest-19796481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8759a51-dcac-43a8-8114-5ce1d0a78e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b2d32b0a-d880-45e5-8104-19eec25344cf tempest-CinderUnicodeTest-19796481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8759a51-dcac-43a8-8114-5ce1d0a78e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cf10b4d-c4b3-46cf-806c-c45057359311', 'volume_name': 'volume-3cf10b4d-c4b3-46cf-806c-c45057359311', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b2d32b0a-d880-45e5-8104-19eec25344cf tempest-CinderUnicodeTest-19796481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3646e888-51c3-4987-bbf1-5749e1bfa566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b2d32b0a-d880-45e5-8104-19eec25344cf tempest-CinderUnicodeTest-19796481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3646e888-51c3-4987-bbf1-5749e1bfa566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b2d32b0a-d880-45e5-8104-19eec25344cf tempest-CinderUnicodeTest-19796481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9144cf9a-cf7e-4e6e-910e-43f993ec9c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:11 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-b2d32b0a-d880-45e5-8104-19eec25344cf tempest-CinderUnicodeTest-19796481 None] Volume 3cf10b4d-c4b3-46cf-806c-c45057359311: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cf10b4d-c4b3-46cf-806c-c45057359311', 'volume_size': 1} Aug 10 13:08:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b2d32b0a-d880-45e5-8104-19eec25344cf tempest-CinderUnicodeTest-19796481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b2d32b0a-d880-45e5-8104-19eec25344cf tempest-CinderUnicodeTest-19796481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:11 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b2d32b0a-d880-45e5-8104-19eec25344cf tempest-CinderUnicodeTest-19796481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cf10b4d-c4b3-46cf-806c-c45057359311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bd0e35d10394ee688374afe5aca594b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:08:12Z,use_quota=True,user_id='fcf35d7b5d4241a283aeae4e2b21e47d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:08:11 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-b2d32b0a-d880-45e5-8104-19eec25344cf tempest-CinderUnicodeTest-19796481 None] Creating volume 3cf10b4d-c4b3-46cf-806c-c45057359311 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:08:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b2d32b0a-d880-45e5-8104-19eec25344cf tempest-CinderUnicodeTest-19796481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b2d32b0a-d880-45e5-8104-19eec25344cf tempest-CinderUnicodeTest-19796481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:11 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b2d32b0a-d880-45e5-8104-19eec25344cf tempest-CinderUnicodeTest-19796481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:11 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b2d32b0a-d880-45e5-8104-19eec25344cf tempest-CinderUnicodeTest-19796481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b2d32b0a-d880-45e5-8104-19eec25344cf tempest-CinderUnicodeTest-19796481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:11 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b2d32b0a-d880-45e5-8104-19eec25344cf tempest-CinderUnicodeTest-19796481 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:08:11 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-b2d32b0a-d880-45e5-8104-19eec25344cf tempest-CinderUnicodeTest-19796481 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:08:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b2d32b0a-d880-45e5-8104-19eec25344cf tempest-CinderUnicodeTest-19796481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3cf10b4d-c4b3-46cf-806c-c45057359311 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:11 devstack sudo[109061]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6a22bfb5-5878-44d6-83fd-11a1bfb1328f tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-104a4ffd-5723-4f56-b887-4d99f6cfc32f" returned: 0 in 0.409s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6a22bfb5-5878-44d6-83fd-11a1bfb1328f tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-104a4ffd-5723-4f56-b887-4d99f6cfc32f {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:11 devstack sudo[109066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3cf10b4d-c4b3-46cf-806c-c45057359311 1073741824 Aug 10 13:08:11 devstack sudo[109066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:11 devstack sudo[109068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-104a4ffd-5723-4f56-b887-4d99f6cfc32f Aug 10 13:08:11 devstack sudo[109068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:12 devstack sudo[109068]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6a22bfb5-5878-44d6-83fd-11a1bfb1328f tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-104a4ffd-5723-4f56-b887-4d99f6cfc32f" returned: 0 in 0.265s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:12 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-6a22bfb5-5878-44d6-83fd-11a1bfb1328f tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "cinder-quobyte-104a4ffd-5723-4f56-b887-4d99f6cfc32f" released by "delete_volume" :: held 0.729s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:12 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-6a22bfb5-5878-44d6-83fd-11a1bfb1328f tempest-CreateVolumesFromSnapshotTest-1515277745 None] Created reservations ['9392ca95-329f-4fdc-a161-7f2ff4bdb3c3', 'f4a8a89b-20de-4d88-9f41-464311ed6f18', '0229c1ae-e0e3-4701-a5f1-27ea7da8a98e', '6997f2f9-4207-4896-8cda-7df114e2c38d'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:08:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6a22bfb5-5878-44d6-83fd-11a1bfb1328f tempest-CreateVolumesFromSnapshotTest-1515277745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6a22bfb5-5878-44d6-83fd-11a1bfb1328f tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:12 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6a22bfb5-5878-44d6-83fd-11a1bfb1328f tempest-CreateVolumesFromSnapshotTest-1515277745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:12 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6a22bfb5-5878-44d6-83fd-11a1bfb1328f tempest-CreateVolumesFromSnapshotTest-1515277745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6a22bfb5-5878-44d6-83fd-11a1bfb1328f tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6a22bfb5-5878-44d6-83fd-11a1bfb1328f tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:12 devstack sudo[109075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:08:12 devstack sudo[109075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:12 devstack sudo[109066]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b2d32b0a-d880-45e5-8104-19eec25344cf tempest-CinderUnicodeTest-19796481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3cf10b4d-c4b3-46cf-806c-c45057359311 1073741824" returned: 0 in 0.522s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b2d32b0a-d880-45e5-8104-19eec25344cf tempest-CinderUnicodeTest-19796481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3cf10b4d-c4b3-46cf-806c-c45057359311 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:12 devstack sudo[109077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3cf10b4d-c4b3-46cf-806c-c45057359311 Aug 10 13:08:12 devstack sudo[109077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:12 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-6fb50a05-847b-420b-933b-d5eabd3b9dcc tempest-CreateVolumesFromSnapshotTest-1515277745 None] Acquiring lock "cinder-75d25f6e-2391-4adb-9cd6-0ed9a3f1016d-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:12 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-6fb50a05-847b-420b-933b-d5eabd3b9dcc tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "cinder-75d25f6e-2391-4adb-9cd6-0ed9a3f1016d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:12 devstack sudo[109075]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6a22bfb5-5878-44d6-83fd-11a1bfb1328f tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.415s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:12 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-6fb50a05-847b-420b-933b-d5eabd3b9dcc tempest-CreateVolumesFromSnapshotTest-1515277745 None] Acquiring lock "cinder-quobyte-75d25f6e-2391-4adb-9cd6-0ed9a3f1016d" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:12 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-6a22bfb5-5878-44d6-83fd-11a1bfb1328f tempest-CreateVolumesFromSnapshotTest-1515277745 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:08:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-348791af-fbba-4c71-b8f3-276c73a6954f tempest-ProjectReaderTests-1094401723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:12 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-6a22bfb5-5878-44d6-83fd-11a1bfb1328f tempest-CreateVolumesFromSnapshotTest-1515277745 None] Deleted volume successfully. Aug 10 13:08:12 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-6fb50a05-847b-420b-933b-d5eabd3b9dcc tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "cinder-quobyte-75d25f6e-2391-4adb-9cd6-0ed9a3f1016d" acquired by "delete_volume" :: waited 0.047s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:12 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-6a22bfb5-5878-44d6-83fd-11a1bfb1328f tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "cinder-104a4ffd-5723-4f56-b887-4d99f6cfc32f-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:12 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6ead8c-0eca-413c-b90f-52bde6dfc8f8]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6fb50a05-847b-420b-933b-d5eabd3b9dcc tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-75d25f6e-2391-4adb-9cd6-0ed9a3f1016d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:12 devstack sudo[109077]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b2d32b0a-d880-45e5-8104-19eec25344cf tempest-CinderUnicodeTest-19796481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3cf10b4d-c4b3-46cf-806c-c45057359311" returned: 0 in 0.399s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:12 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b2d32b0a-d880-45e5-8104-19eec25344cf tempest-CinderUnicodeTest-19796481 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:08:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b2d32b0a-d880-45e5-8104-19eec25344cf tempest-CinderUnicodeTest-19796481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-348791af-fbba-4c71-b8f3-276c73a6954f tempest-ProjectReaderTests-1094401723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.101s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:12 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-348791af-fbba-4c71-b8f3-276c73a6954f tempest-ProjectReaderTests-1094401723 None] Creating offline snapshot 038c22d8-8cf2-4a84-8752-13d144e2f828 of volume b2f9991a-bd53-4eee-9404-597f612bf849 {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 13:08:12 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b2d32b0a-d880-45e5-8104-19eec25344cf tempest-CinderUnicodeTest-19796481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9144cf9a-cf7e-4e6e-910e-43f993ec9c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cf10b4d-c4b3-46cf-806c-c45057359311', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:12 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b2d32b0a-d880-45e5-8104-19eec25344cf tempest-CinderUnicodeTest-19796481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba003595-9efe-4133-8862-8f737ab5a628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:12 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[587ec5fc-607f-4b16-acd0-014641ba4b0e]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-348791af-fbba-4c71-b8f3-276c73a6954f tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:12 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-b2d32b0a-d880-45e5-8104-19eec25344cf tempest-CinderUnicodeTest-19796481 None] Volume volume-3cf10b4d-c4b3-46cf-806c-c45057359311 (3cf10b4d-c4b3-46cf-806c-c45057359311): created successfully Aug 10 13:08:12 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b2d32b0a-d880-45e5-8104-19eec25344cf tempest-CinderUnicodeTest-19796481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba003595-9efe-4133-8862-8f737ab5a628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:12 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-b2d32b0a-d880-45e5-8104-19eec25344cf tempest-CinderUnicodeTest-19796481 None] Flow 'volume_create_manager' (c134237b-d359-40d4-b8b0-11d05fc73296) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:08:12 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-b2d32b0a-d880-45e5-8104-19eec25344cf tempest-CinderUnicodeTest-19796481 None] Created volume successfully. Aug 10 13:08:12 devstack sudo[109081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-75d25f6e-2391-4adb-9cd6-0ed9a3f1016d Aug 10 13:08:12 devstack sudo[109081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:12 devstack sudo[109082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849 Aug 10 13:08:12 devstack sudo[109082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:13 devstack sudo[109081]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6fb50a05-847b-420b-933b-d5eabd3b9dcc tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-75d25f6e-2391-4adb-9cd6-0ed9a3f1016d" returned: 0 in 0.429s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6fb50a05-847b-420b-933b-d5eabd3b9dcc tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-75d25f6e-2391-4adb-9cd6-0ed9a3f1016d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:13 devstack sudo[109091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-75d25f6e-2391-4adb-9cd6-0ed9a3f1016d Aug 10 13:08:13 devstack sudo[109091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:13 devstack sudo[109082]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-348791af-fbba-4c71-b8f3-276c73a6954f tempest-ProjectReaderTests-1094401723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849" returned: 0 in 0.398s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-348791af-fbba-4c71-b8f3-276c73a6954f tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849.038c22d8-8cf2-4a84-8752-13d144e2f828 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:13 devstack sudo[109093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849.038c22d8-8cf2-4a84-8752-13d144e2f828 1G Aug 10 13:08:13 devstack sudo[109093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:13 devstack sudo[109091]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6fb50a05-847b-420b-933b-d5eabd3b9dcc tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-75d25f6e-2391-4adb-9cd6-0ed9a3f1016d" returned: 0 in 0.300s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:13 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-6fb50a05-847b-420b-933b-d5eabd3b9dcc tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "cinder-quobyte-75d25f6e-2391-4adb-9cd6-0ed9a3f1016d" released by "delete_volume" :: held 0.789s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:13 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-6fb50a05-847b-420b-933b-d5eabd3b9dcc tempest-CreateVolumesFromSnapshotTest-1515277745 None] Created reservations ['bf8df195-16db-45bd-9da5-854b0a77e439', '761e5107-a8eb-43ee-9e03-89443f192f19', '09322c9b-b829-4571-994e-a604d885ea0b', 'a4675931-81d9-42fe-b79e-9fa7d6b616bd'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:08:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6fb50a05-847b-420b-933b-d5eabd3b9dcc tempest-CreateVolumesFromSnapshotTest-1515277745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6fb50a05-847b-420b-933b-d5eabd3b9dcc tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:13 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6fb50a05-847b-420b-933b-d5eabd3b9dcc tempest-CreateVolumesFromSnapshotTest-1515277745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:13 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6fb50a05-847b-420b-933b-d5eabd3b9dcc tempest-CreateVolumesFromSnapshotTest-1515277745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6fb50a05-847b-420b-933b-d5eabd3b9dcc tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6fb50a05-847b-420b-933b-d5eabd3b9dcc tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:13 devstack sudo[109099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:08:13 devstack sudo[109099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:13 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-34a8dcbc-3d6c-423c-9a57-ab6a4a7251f2 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Acquiring lock "cinder-ba4bae1f-63d2-48c8-98fb-93d0d664e15d-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:13 devstack sudo[109093]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:13 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-34a8dcbc-3d6c-423c-9a57-ab6a4a7251f2 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "cinder-ba4bae1f-63d2-48c8-98fb-93d0d664e15d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-348791af-fbba-4c71-b8f3-276c73a6954f tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849.038c22d8-8cf2-4a84-8752-13d144e2f828 1G" returned: 0 in 0.627s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-348791af-fbba-4c71-b8f3-276c73a6954f tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2f9991a-bd53-4eee-9404-597f612bf849 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849.038c22d8-8cf2-4a84-8752-13d144e2f828 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:13 devstack sudo[109101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2f9991a-bd53-4eee-9404-597f612bf849 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849.038c22d8-8cf2-4a84-8752-13d144e2f828 Aug 10 13:08:13 devstack sudo[109101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:13 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-34a8dcbc-3d6c-423c-9a57-ab6a4a7251f2 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Acquiring lock "cinder-quobyte-ba4bae1f-63d2-48c8-98fb-93d0d664e15d" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:13 devstack sudo[109099]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:13 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-34a8dcbc-3d6c-423c-9a57-ab6a4a7251f2 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "cinder-quobyte-ba4bae1f-63d2-48c8-98fb-93d0d664e15d" acquired by "delete_volume" :: waited 0.039s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6fb50a05-847b-420b-933b-d5eabd3b9dcc tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.316s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:13 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-6fb50a05-847b-420b-933b-d5eabd3b9dcc tempest-CreateVolumesFromSnapshotTest-1515277745 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:08:14 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-6fb50a05-847b-420b-933b-d5eabd3b9dcc tempest-CreateVolumesFromSnapshotTest-1515277745 None] Deleted volume successfully. Aug 10 13:08:14 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[be21fe0a-ca49-4924-ac15-0701f516af79]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-34a8dcbc-3d6c-423c-9a57-ab6a4a7251f2 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ba4bae1f-63d2-48c8-98fb-93d0d664e15d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:14 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-6fb50a05-847b-420b-933b-d5eabd3b9dcc tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "cinder-75d25f6e-2391-4adb-9cd6-0ed9a3f1016d-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:14 devstack sudo[109104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ba4bae1f-63d2-48c8-98fb-93d0d664e15d Aug 10 13:08:14 devstack sudo[109104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:14 devstack sudo[109101]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-348791af-fbba-4c71-b8f3-276c73a6954f tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2f9991a-bd53-4eee-9404-597f612bf849 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849.038c22d8-8cf2-4a84-8752-13d144e2f828" returned: 0 in 0.418s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:14 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-348791af-fbba-4c71-b8f3-276c73a6954f tempest-ProjectReaderTests-1094401723 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849.038c22d8-8cf2-4a84-8752-13d144e2f828 is being set with open permissions: ugo+rw Aug 10 13:08:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-348791af-fbba-4c71-b8f3-276c73a6954f tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849.038c22d8-8cf2-4a84-8752-13d144e2f828 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:14 devstack sudo[109110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849.038c22d8-8cf2-4a84-8752-13d144e2f828 Aug 10 13:08:14 devstack sudo[109110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:14 devstack sudo[109104]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-34a8dcbc-3d6c-423c-9a57-ab6a4a7251f2 tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ba4bae1f-63d2-48c8-98fb-93d0d664e15d" returned: 0 in 0.479s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-34a8dcbc-3d6c-423c-9a57-ab6a4a7251f2 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ba4bae1f-63d2-48c8-98fb-93d0d664e15d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:14 devstack sudo[109116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ba4bae1f-63d2-48c8-98fb-93d0d664e15d Aug 10 13:08:14 devstack sudo[109116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:14 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa6b44be-c965-4717-b414-3177fccba318 tempest-CinderUnicodeTest-19796481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:08:14 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-aa6b44be-c965-4717-b414-3177fccba318 tempest-CinderUnicodeTest-19796481 None] Flow 'volume_create_manager' (d7225344-871e-4639-9a7c-de643a4fab28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:08:14 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-aa6b44be-c965-4717-b414-3177fccba318 tempest-CinderUnicodeTest-19796481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b5392b5-c488-4015-ba46-031ece436150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:14 devstack sudo[109110]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:14 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-aa6b44be-c965-4717-b414-3177fccba318 tempest-CinderUnicodeTest-19796481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b5392b5-c488-4015-ba46-031ece436150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:08:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-299916304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec7134cd-ce3e-46a4-bd95-de89419ae6ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bd0e35d10394ee688374afe5aca594b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:08:15Z,use_quota=True,user_id='fcf35d7b5d4241a283aeae4e2b21e47d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:14 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-aa6b44be-c965-4717-b414-3177fccba318 tempest-CinderUnicodeTest-19796481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01722bc4-8483-4bf2-989b-2ee8981e1784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:14 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-aa6b44be-c965-4717-b414-3177fccba318 tempest-CinderUnicodeTest-19796481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01722bc4-8483-4bf2-989b-2ee8981e1784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:14 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-aa6b44be-c965-4717-b414-3177fccba318 tempest-CinderUnicodeTest-19796481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7f8b034-2540-47ba-b949-769261bdf524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:14 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-aa6b44be-c965-4717-b414-3177fccba318 tempest-CinderUnicodeTest-19796481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7f8b034-2540-47ba-b949-769261bdf524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec7134cd-ce3e-46a4-bd95-de89419ae6ef', 'volume_name': 'volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:14 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-aa6b44be-c965-4717-b414-3177fccba318 tempest-CinderUnicodeTest-19796481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (870fa39d-b91d-4295-99ec-54cef3bc8f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:14 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-aa6b44be-c965-4717-b414-3177fccba318 tempest-CinderUnicodeTest-19796481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (870fa39d-b91d-4295-99ec-54cef3bc8f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:14 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-aa6b44be-c965-4717-b414-3177fccba318 tempest-CinderUnicodeTest-19796481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b970ac7-23ee-481a-a6c5-c67304088c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:14 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-aa6b44be-c965-4717-b414-3177fccba318 tempest-CinderUnicodeTest-19796481 None] Volume ec7134cd-ce3e-46a4-bd95-de89419ae6ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef', 'volume_size': 1} Aug 10 13:08:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-aa6b44be-c965-4717-b414-3177fccba318 tempest-CinderUnicodeTest-19796481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-348791af-fbba-4c71-b8f3-276c73a6954f tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849.038c22d8-8cf2-4a84-8752-13d144e2f828" returned: 0 in 0.439s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-348791af-fbba-4c71-b8f3-276c73a6954f tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:14 devstack sudo[109119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849.info Aug 10 13:08:14 devstack sudo[109119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:14 devstack sudo[109116]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-34a8dcbc-3d6c-423c-9a57-ab6a4a7251f2 tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ba4bae1f-63d2-48c8-98fb-93d0d664e15d" returned: 0 in 0.341s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:14 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-34a8dcbc-3d6c-423c-9a57-ab6a4a7251f2 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "cinder-quobyte-ba4bae1f-63d2-48c8-98fb-93d0d664e15d" released by "delete_volume" :: held 0.879s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:14 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-34a8dcbc-3d6c-423c-9a57-ab6a4a7251f2 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Created reservations ['8bd5d4d8-dd62-4fc5-bf58-41993982e4bc', 'ded8d244-f2c3-439e-a000-3c902f396d89', 'ad0f6dde-58f9-483a-b515-4d009db6f345', '58e0a370-d8bb-4570-8a1e-d4f9fb6528f4'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:08:14 devstack sudo[109119]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-348791af-fbba-4c71-b8f3-276c73a6954f tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849.info" returned: 0 in 0.275s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:14 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-348791af-fbba-4c71-b8f3-276c73a6954f tempest-ProjectReaderTests-1094401723 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849.info is being set with open permissions: ugo+rw Aug 10 13:08:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-348791af-fbba-4c71-b8f3-276c73a6954f tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-34a8dcbc-3d6c-423c-9a57-ab6a4a7251f2 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-34a8dcbc-3d6c-423c-9a57-ab6a4a7251f2 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-34a8dcbc-3d6c-423c-9a57-ab6a4a7251f2 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-34a8dcbc-3d6c-423c-9a57-ab6a4a7251f2 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-34a8dcbc-3d6c-423c-9a57-ab6a4a7251f2 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-34a8dcbc-3d6c-423c-9a57-ab6a4a7251f2 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:15 devstack sudo[109123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849.info Aug 10 13:08:15 devstack sudo[109123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2d73c26b-aeef-48a1-a71b-46a9d309f3d7 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Acquiring lock "cinder-d31dba92-467a-4396-96d2-0c896017fdc3-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:15 devstack sudo[109124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:08:15 devstack sudo[109124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2d73c26b-aeef-48a1-a71b-46a9d309f3d7 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "cinder-d31dba92-467a-4396-96d2-0c896017fdc3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2d73c26b-aeef-48a1-a71b-46a9d309f3d7 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Acquiring lock "cinder-quobyte-0caaa217-71bf-4549-9e72-4554f4fbaa1e" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2d73c26b-aeef-48a1-a71b-46a9d309f3d7 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "cinder-quobyte-0caaa217-71bf-4549-9e72-4554f4fbaa1e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2d73c26b-aeef-48a1-a71b-46a9d309f3d7 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Acquiring lock "cinder-quobyte-d31dba92-467a-4396-96d2-0c896017fdc3" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2d73c26b-aeef-48a1-a71b-46a9d309f3d7 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "cinder-quobyte-d31dba92-467a-4396-96d2-0c896017fdc3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-2d73c26b-aeef-48a1-a71b-46a9d309f3d7 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Deleting offline snapshot d31dba92-467a-4396-96d2-0c896017fdc3 of volume 0caaa217-71bf-4549-9e72-4554f4fbaa1e {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-2d73c26b-aeef-48a1-a71b-46a9d309f3d7 tempest-CreateVolumesFromSnapshotTest-1515277745 None] snapshot_file for this snap is: volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e.d31dba92-467a-4396-96d2-0c896017fdc3 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8922fbc-28f8-4b9e-86ec-beca1af71792]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2d73c26b-aeef-48a1-a71b-46a9d309f3d7 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e.d31dba92-467a-4396-96d2-0c896017fdc3 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:15 devstack sudo[109127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e.d31dba92-467a-4396-96d2-0c896017fdc3 Aug 10 13:08:15 devstack sudo[109127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:15 devstack sudo[109123]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-348791af-fbba-4c71-b8f3-276c73a6954f tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849.info" returned: 0 in 0.332s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:15 devstack sudo[109124]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-348791af-fbba-4c71-b8f3-276c73a6954f tempest-ProjectReaderTests-1094401723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.611s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-aa6b44be-c965-4717-b414-3177fccba318 tempest-CinderUnicodeTest-19796481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.676s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-aa6b44be-c965-4717-b414-3177fccba318 tempest-CinderUnicodeTest-19796481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:08:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-299916304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec7134cd-ce3e-46a4-bd95-de89419ae6ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bd0e35d10394ee688374afe5aca594b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:08:15Z,use_quota=True,user_id='fcf35d7b5d4241a283aeae4e2b21e47d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-aa6b44be-c965-4717-b414-3177fccba318 tempest-CinderUnicodeTest-19796481 None] Creating volume ec7134cd-ce3e-46a4-bd95-de89419ae6ef {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-aa6b44be-c965-4717-b414-3177fccba318 tempest-CinderUnicodeTest-19796481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-aa6b44be-c965-4717-b414-3177fccba318 tempest-CinderUnicodeTest-19796481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-aa6b44be-c965-4717-b414-3177fccba318 tempest-CinderUnicodeTest-19796481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-aa6b44be-c965-4717-b414-3177fccba318 tempest-CinderUnicodeTest-19796481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-aa6b44be-c965-4717-b414-3177fccba318 tempest-CinderUnicodeTest-19796481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-aa6b44be-c965-4717-b414-3177fccba318 tempest-CinderUnicodeTest-19796481 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:08:15 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-aa6b44be-c965-4717-b414-3177fccba318 tempest-CinderUnicodeTest-19796481 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-aa6b44be-c965-4717-b414-3177fccba318 tempest-CinderUnicodeTest-19796481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:15 devstack sudo[109131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef 1073741824 Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-34a8dcbc-3d6c-423c-9a57-ab6a4a7251f2 tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.408s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:15 devstack sudo[109131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-34a8dcbc-3d6c-423c-9a57-ab6a4a7251f2 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:08:15 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-34a8dcbc-3d6c-423c-9a57-ab6a4a7251f2 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Deleted volume successfully. Aug 10 13:08:15 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-348791af-fbba-4c71-b8f3-276c73a6954f tempest-ProjectReaderTests-1094401723 None] Create snapshot completed successfully Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-34a8dcbc-3d6c-423c-9a57-ab6a4a7251f2 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "cinder-ba4bae1f-63d2-48c8-98fb-93d0d664e15d-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Flow 'volume_create_manager' (b104a93e-a14e-4280-9ba5-355ebc9c3239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b35e8ea8-8e87-4fa6-9455-bc7d8dae6b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:15 devstack sudo[109127]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b35e8ea8-8e87-4fa6-9455-bc7d8dae6b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7cb27b7-31ac-49c6-affb-710feeb2e06e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8daf33dfe1be4a349e031cb0f0b1b069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:08:16Z,use_quota=True,user_id='5cfccab215e54cdd884b70162930b385',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41dbec05-8200-48a2-9b82-ee3a289c8930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41dbec05-8200-48a2-9b82-ee3a289c8930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73baf425-ea48-4cb9-96b0-cf32ada838d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG cinder.image.glance [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Creating Keystone auth plugin from conf {{(pid=89096) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2d73c26b-aeef-48a1-a71b-46a9d309f3d7 tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e.d31dba92-467a-4396-96d2-0c896017fdc3" returned: 0 in 0.516s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-2d73c26b-aeef-48a1-a71b-46a9d309f3d7 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c35a71-d0f1-4490-b4f8-6aac1c645e8e]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2d73c26b-aeef-48a1-a71b-46a9d309f3d7 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:15 devstack sudo[109140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e Aug 10 13:08:15 devstack sudo[109140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73baf425-ea48-4cb9-96b0-cf32ada838d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f7cb27b7-31ac-49c6-affb-710feeb2e06e', 'volume_name': 'volume-f7cb27b7-31ac-49c6-affb-710feeb2e06e', 'volume_size': 1, 'image_id': '2962238b-7abb-46d4-8004-28a7b91014af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2962238b-7abb-46d4-8004-28a7b91014af', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'be62ee0928c14129f5a83ce8f08006a3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8daf33dfe1be4a349e031cb0f0b1b069', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '52232c80a67b2f2b1c46cc808bce153b94e6a5e285b900fda2ea021bb72b7010ed69fb9e64bf6820895bdfcb67d9bdd52a9d70bed0a504e40154ad48d2c10a13', 'id': '2962238b-7abb-46d4-8004-28a7b91014af', 'created_at': datetime.datetime(2026, 8, 10, 11, 8, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 11, 8, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2962238b-7abb-46d4-8004-28a7b91014af/file', 'properties': {}}, 'image_service': }' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b847a876-492c-4814-bbc7-e7893062d17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b847a876-492c-4814-bbc7-e7893062d17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ee87a5-ff07-469c-9f62-c7803e047103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:15 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Volume f7cb27b7-31ac-49c6-affb-710feeb2e06e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f7cb27b7-31ac-49c6-affb-710feeb2e06e', 'volume_size': 1, 'image_id': '2962238b-7abb-46d4-8004-28a7b91014af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2962238b-7abb-46d4-8004-28a7b91014af', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'be62ee0928c14129f5a83ce8f08006a3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8daf33dfe1be4a349e031cb0f0b1b069', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '52232c80a67b2f2b1c46cc808bce153b94e6a5e285b900fda2ea021bb72b7010ed69fb9e64bf6820895bdfcb67d9bdd52a9d70bed0a504e40154ad48d2c10a13', 'id': '2962238b-7abb-46d4-8004-28a7b91014af', 'created_at': datetime.datetime(2026, 8, 10, 11, 8, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 11, 8, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2962238b-7abb-46d4-8004-28a7b91014af/file', 'properties': {}}, 'image_service': } Aug 10 13:08:15 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Trying to clone f7cb27b7-31ac-49c6-affb-710feeb2e06e from image 2962238b-7abb-46d4-8004-28a7b91014af at location (None, [{'url': 'file:///opt/stack/data/glance/images/2962238b-7abb-46d4-8004-28a7b91014af', 'metadata': {}}]). {{(pid=89096) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 10 13:08:16 devstack sudo[109131]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-aa6b44be-c965-4717-b414-3177fccba318 tempest-CinderUnicodeTest-19796481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef 1073741824" returned: 0 in 0.625s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:16 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-fab221da-fbf9-4c16-bef1-a7469483cbf0 tempest-ProjectReaderTests-1094401723 None] Acquiring lock "cinder-038c22d8-8cf2-4a84-8752-13d144e2f828-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-aa6b44be-c965-4717-b414-3177fccba318 tempest-CinderUnicodeTest-19796481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:16 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-fab221da-fbf9-4c16-bef1-a7469483cbf0 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-038c22d8-8cf2-4a84-8752-13d144e2f828-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:16 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-fab221da-fbf9-4c16-bef1-a7469483cbf0 tempest-ProjectReaderTests-1094401723 None] Acquiring lock "cinder-quobyte-b2f9991a-bd53-4eee-9404-597f612bf849" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:16 devstack sudo[109143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef Aug 10 13:08:16 devstack sudo[109143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:16 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-fab221da-fbf9-4c16-bef1-a7469483cbf0 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-quobyte-b2f9991a-bd53-4eee-9404-597f612bf849" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:16 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-fab221da-fbf9-4c16-bef1-a7469483cbf0 tempest-ProjectReaderTests-1094401723 None] Acquiring lock "cinder-quobyte-038c22d8-8cf2-4a84-8752-13d144e2f828" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:16 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-fab221da-fbf9-4c16-bef1-a7469483cbf0 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-quobyte-038c22d8-8cf2-4a84-8752-13d144e2f828" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:16 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-fab221da-fbf9-4c16-bef1-a7469483cbf0 tempest-ProjectReaderTests-1094401723 None] Deleting offline snapshot 038c22d8-8cf2-4a84-8752-13d144e2f828 of volume b2f9991a-bd53-4eee-9404-597f612bf849 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 13:08:16 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-fab221da-fbf9-4c16-bef1-a7469483cbf0 tempest-ProjectReaderTests-1094401723 None] snapshot_file for this snap is: volume-b2f9991a-bd53-4eee-9404-597f612bf849.038c22d8-8cf2-4a84-8752-13d144e2f828 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 13:08:16 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2962238b-7abb-46d4-8004-28a7b91014af_emcw35eqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89096) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 10 13:08:16 devstack cinder-volume[89096]: INFO cinder.image.image_utils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Image download 0.00 MB at 0.00 MB/s Aug 10 13:08:16 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[e887f54d-6e5d-404b-bd5e-d4a011b2d24a]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fab221da-fbf9-4c16-bef1-a7469483cbf0 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849.038c22d8-8cf2-4a84-8752-13d144e2f828 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:16 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b14a17-a3e4-4862-a5f7-0502fd13f823]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2962238b-7abb-46d4-8004-28a7b91014af_emcw35eqdevstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:16 devstack sudo[109140]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2d73c26b-aeef-48a1-a71b-46a9d309f3d7 tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e" returned: 0 in 0.538s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2d73c26b-aeef-48a1-a71b-46a9d309f3d7 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e.d31dba92-467a-4396-96d2-0c896017fdc3 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:16 devstack sudo[109150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e.d31dba92-467a-4396-96d2-0c896017fdc3 Aug 10 13:08:16 devstack sudo[109150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:16 devstack sudo[109147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849.038c22d8-8cf2-4a84-8752-13d144e2f828 Aug 10 13:08:16 devstack sudo[109147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:16 devstack sudo[109149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2962238b-7abb-46d4-8004-28a7b91014af_emcw35eqdevstack@QuobyteHD Aug 10 13:08:16 devstack sudo[109149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:16 devstack sudo[109143]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-aa6b44be-c965-4717-b414-3177fccba318 tempest-CinderUnicodeTest-19796481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef" returned: 0 in 0.291s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:16 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-aa6b44be-c965-4717-b414-3177fccba318 tempest-CinderUnicodeTest-19796481 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:08:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-aa6b44be-c965-4717-b414-3177fccba318 tempest-CinderUnicodeTest-19796481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:16 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-aa6b44be-c965-4717-b414-3177fccba318 tempest-CinderUnicodeTest-19796481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b970ac7-23ee-481a-a6c5-c67304088c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:16 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-aa6b44be-c965-4717-b414-3177fccba318 tempest-CinderUnicodeTest-19796481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e49f75d1-a56f-4e40-b546-40858d58756f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:16 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-aa6b44be-c965-4717-b414-3177fccba318 tempest-CinderUnicodeTest-19796481 None] Volume volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef (ec7134cd-ce3e-46a4-bd95-de89419ae6ef): created successfully Aug 10 13:08:16 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-aa6b44be-c965-4717-b414-3177fccba318 tempest-CinderUnicodeTest-19796481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e49f75d1-a56f-4e40-b546-40858d58756f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:16 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-aa6b44be-c965-4717-b414-3177fccba318 tempest-CinderUnicodeTest-19796481 None] Flow 'volume_create_manager' (d7225344-871e-4639-9a7c-de643a4fab28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:08:16 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-aa6b44be-c965-4717-b414-3177fccba318 tempest-CinderUnicodeTest-19796481 None] Created volume successfully. Aug 10 13:08:16 devstack sudo[109149]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2962238b-7abb-46d4-8004-28a7b91014af_emcw35eqdevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2962238b-7abb-46d4-8004-28a7b91014af_emcw35eqdevstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:16 devstack sudo[109147]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fab221da-fbf9-4c16-bef1-a7469483cbf0 tempest-ProjectReaderTests-1094401723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849.038c22d8-8cf2-4a84-8752-13d144e2f828" returned: 0 in 0.446s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:16 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-fab221da-fbf9-4c16-bef1-a7469483cbf0 tempest-ProjectReaderTests-1094401723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2f9991a-bd53-4eee-9404-597f612bf849(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 13:08:16 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[3666d45d-1767-4929-aa5e-c0bace0e6fd4]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fab221da-fbf9-4c16-bef1-a7469483cbf0 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:16 devstack sudo[109150]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2d73c26b-aeef-48a1-a71b-46a9d309f3d7 tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e.d31dba92-467a-4396-96d2-0c896017fdc3" returned: 0 in 0.425s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2d73c26b-aeef-48a1-a71b-46a9d309f3d7 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e.d31dba92-467a-4396-96d2-0c896017fdc3 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:16 devstack sudo[109167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e.d31dba92-467a-4396-96d2-0c896017fdc3 Aug 10 13:08:16 devstack sudo[109167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:16 devstack sudo[109165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2962238b-7abb-46d4-8004-28a7b91014af_emcw35eqdevstack@QuobyteHD Aug 10 13:08:16 devstack sudo[109165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:16 devstack sudo[109166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849 Aug 10 13:08:16 devstack sudo[109166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:17 devstack sudo[109165]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2962238b-7abb-46d4-8004-28a7b91014af_emcw35eqdevstack@QuobyteHD" returned: 1 in 0.418s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2962238b-7abb-46d4-8004-28a7b91014af_emcw35eqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 13:08:17 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Temporary image 2962238b-7abb-46d4-8004-28a7b91014af is fetched for user 5cfccab215e54cdd884b70162930b385. {{(pid=89096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 10 13:08:17 devstack sudo[109167]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2d73c26b-aeef-48a1-a71b-46a9d309f3d7 tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e.d31dba92-467a-4396-96d2-0c896017fdc3" returned: 0 in 0.334s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8cf7b3a2-de0c-4e7a-975d-f21325a46501 tempest-CinderUnicodeTest-19796481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8cf7b3a2-de0c-4e7a-975d-f21325a46501 tempest-CinderUnicodeTest-19796481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:17 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2d73c26b-aeef-48a1-a71b-46a9d309f3d7 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "cinder-quobyte-d31dba92-467a-4396-96d2-0c896017fdc3" released by "_delete_snapshot" :: held 1.951s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:17 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2d73c26b-aeef-48a1-a71b-46a9d309f3d7 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "cinder-quobyte-0caaa217-71bf-4549-9e72-4554f4fbaa1e" released by "delete_snapshot" :: held 1.988s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:17 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-8cf7b3a2-de0c-4e7a-975d-f21325a46501 tempest-CinderUnicodeTest-19796481 None] Creating offline snapshot 10c13ee0-1e1f-4cfd-b042-fedbcf680b79 of volume ec7134cd-ce3e-46a4-bd95-de89419ae6ef {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 13:08:17 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87acd80-0a52-4c2b-a5bb-46053760daae]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8cf7b3a2-de0c-4e7a-975d-f21325a46501 tempest-CinderUnicodeTest-19796481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:17 devstack sudo[109166]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:17 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddad992-fb15-4b75-92a1-94094de980cf]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2962238b-7abb-46d4-8004-28a7b91014af_emcw35eqdevstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fab221da-fbf9-4c16-bef1-a7469483cbf0 tempest-ProjectReaderTests-1094401723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849" returned: 0 in 0.495s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fab221da-fbf9-4c16-bef1-a7469483cbf0 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849.038c22d8-8cf2-4a84-8752-13d144e2f828 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:17 devstack sudo[109180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849.038c22d8-8cf2-4a84-8752-13d144e2f828 Aug 10 13:08:17 devstack sudo[109180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:17 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-2d73c26b-aeef-48a1-a71b-46a9d309f3d7 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Created reservations ['17306914-abc6-4174-af70-48339665bd55', '407faf27-c880-4d96-be0c-27a076eca48d', 'c19d1fc6-afb2-47df-8fd0-479abcb8232d', 'ac4bff11-ffcc-4912-a5a4-dbffa75723fe'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:08:17 devstack sudo[109178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef Aug 10 13:08:17 devstack sudo[109178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:17 devstack sudo[109179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2962238b-7abb-46d4-8004-28a7b91014af_emcw35eqdevstack@QuobyteHD Aug 10 13:08:17 devstack sudo[109179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:17 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-2d73c26b-aeef-48a1-a71b-46a9d309f3d7 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Delete snapshot completed successfully. Aug 10 13:08:17 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2d73c26b-aeef-48a1-a71b-46a9d309f3d7 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "cinder-d31dba92-467a-4396-96d2-0c896017fdc3-delete_snapshot" released by "delete_snapshot" :: held 2.243s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:17 devstack sudo[109179]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2962238b-7abb-46d4-8004-28a7b91014af_emcw35eqdevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2962238b-7abb-46d4-8004-28a7b91014af_emcw35eqdevstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:17 devstack sudo[109178]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8cf7b3a2-de0c-4e7a-975d-f21325a46501 tempest-CinderUnicodeTest-19796481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef" returned: 0 in 0.408s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8cf7b3a2-de0c-4e7a-975d-f21325a46501 tempest-CinderUnicodeTest-19796481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef.10c13ee0-1e1f-4cfd-b042-fedbcf680b79 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:17 devstack sudo[109180]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fab221da-fbf9-4c16-bef1-a7469483cbf0 tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849.038c22d8-8cf2-4a84-8752-13d144e2f828" returned: 0 in 0.380s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fab221da-fbf9-4c16-bef1-a7469483cbf0 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849.038c22d8-8cf2-4a84-8752-13d144e2f828 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:17 devstack sudo[109195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef.10c13ee0-1e1f-4cfd-b042-fedbcf680b79 1G Aug 10 13:08:17 devstack sudo[109195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:17 devstack sudo[109196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849.038c22d8-8cf2-4a84-8752-13d144e2f828 Aug 10 13:08:17 devstack sudo[109196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:17 devstack sudo[109194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2962238b-7abb-46d4-8004-28a7b91014af_emcw35eqdevstack@QuobyteHD Aug 10 13:08:17 devstack sudo[109194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:17 devstack sudo[109196]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fab221da-fbf9-4c16-bef1-a7469483cbf0 tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849.038c22d8-8cf2-4a84-8752-13d144e2f828" returned: 0 in 0.296s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:17 devstack sudo[109194]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2962238b-7abb-46d4-8004-28a7b91014af_emcw35eqdevstack@QuobyteHD" returned: 1 in 0.355s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2962238b-7abb-46d4-8004-28a7b91014af_emcw35eqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 13:08:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:17 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-fab221da-fbf9-4c16-bef1-a7469483cbf0 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-quobyte-038c22d8-8cf2-4a84-8752-13d144e2f828" released by "_delete_snapshot" :: held 1.754s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:17 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-fab221da-fbf9-4c16-bef1-a7469483cbf0 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-quobyte-b2f9991a-bd53-4eee-9404-597f612bf849" released by "delete_snapshot" :: held 1.778s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:17 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-fab221da-fbf9-4c16-bef1-a7469483cbf0 tempest-ProjectReaderTests-1094401723 None] Created reservations ['a6bee7c7-262a-4f5f-bd9e-e120a04b45a8', 'db0c69b8-d8c2-4628-afdf-07890f2b256c', '7f8772ce-4224-4a67-a39a-bb15ac5a9867', '74d39e34-94bc-44e6-a4b6-d10f13b46f71'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:08:17 devstack sudo[109195]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8cf7b3a2-de0c-4e7a-975d-f21325a46501 tempest-CinderUnicodeTest-19796481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef.10c13ee0-1e1f-4cfd-b042-fedbcf680b79 1G" returned: 0 in 0.419s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8cf7b3a2-de0c-4e7a-975d-f21325a46501 tempest-CinderUnicodeTest-19796481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef.10c13ee0-1e1f-4cfd-b042-fedbcf680b79 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:17 devstack sudo[109208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef.10c13ee0-1e1f-4cfd-b042-fedbcf680b79 Aug 10 13:08:17 devstack sudo[109208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:18 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-fab221da-fbf9-4c16-bef1-a7469483cbf0 tempest-ProjectReaderTests-1094401723 None] Delete snapshot completed successfully. Aug 10 13:08:18 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-fab221da-fbf9-4c16-bef1-a7469483cbf0 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-038c22d8-8cf2-4a84-8752-13d144e2f828-delete_snapshot" released by "delete_snapshot" :: held 1.942s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:18 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b58f5177-10aa-4735-bca9-af38c9285ae2 tempest-ProjectReaderTests-1094401723 None] Acquiring lock "cinder-b2f9991a-bd53-4eee-9404-597f612bf849-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:18 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b58f5177-10aa-4735-bca9-af38c9285ae2 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-b2f9991a-bd53-4eee-9404-597f612bf849-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:18 devstack sudo[109208]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:18 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ac2645f0-9135-4dbd-aa9a-cd3f49074315 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Acquiring lock "cinder-0caaa217-71bf-4549-9e72-4554f4fbaa1e-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8cf7b3a2-de0c-4e7a-975d-f21325a46501 tempest-CinderUnicodeTest-19796481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef.10c13ee0-1e1f-4cfd-b042-fedbcf680b79" returned: 0 in 0.369s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:18 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-8cf7b3a2-de0c-4e7a-975d-f21325a46501 tempest-CinderUnicodeTest-19796481 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef.10c13ee0-1e1f-4cfd-b042-fedbcf680b79 is being set with open permissions: ugo+rw Aug 10 13:08:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8cf7b3a2-de0c-4e7a-975d-f21325a46501 tempest-CinderUnicodeTest-19796481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef.10c13ee0-1e1f-4cfd-b042-fedbcf680b79 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:18 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b58f5177-10aa-4735-bca9-af38c9285ae2 tempest-ProjectReaderTests-1094401723 None] Acquiring lock "cinder-quobyte-b2f9991a-bd53-4eee-9404-597f612bf849" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:18 devstack sudo[109213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef.10c13ee0-1e1f-4cfd-b042-fedbcf680b79 Aug 10 13:08:18 devstack sudo[109213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:18 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ac2645f0-9135-4dbd-aa9a-cd3f49074315 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "cinder-0caaa217-71bf-4549-9e72-4554f4fbaa1e-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:18 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b58f5177-10aa-4735-bca9-af38c9285ae2 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-quobyte-b2f9991a-bd53-4eee-9404-597f612bf849" acquired by "delete_volume" :: waited 0.042s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:18 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cb9482-d3c6-4423-a08a-c61cdb344aad]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b58f5177-10aa-4735-bca9-af38c9285ae2 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:18 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ac2645f0-9135-4dbd-aa9a-cd3f49074315 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Acquiring lock "cinder-quobyte-0caaa217-71bf-4549-9e72-4554f4fbaa1e" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:18 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ac2645f0-9135-4dbd-aa9a-cd3f49074315 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "cinder-quobyte-0caaa217-71bf-4549-9e72-4554f4fbaa1e" acquired by "delete_volume" :: waited 0.017s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:18 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a953cac-c7cf-48a0-9d89-ae81a76563f2]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ac2645f0-9135-4dbd-aa9a-cd3f49074315 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:18 devstack sudo[109215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849 Aug 10 13:08:18 devstack sudo[109215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:18 devstack sudo[109213]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8cf7b3a2-de0c-4e7a-975d-f21325a46501 tempest-CinderUnicodeTest-19796481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef.10c13ee0-1e1f-4cfd-b042-fedbcf680b79" returned: 0 in 0.276s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:18 devstack sudo[109216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e Aug 10 13:08:18 devstack sudo[109216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8cf7b3a2-de0c-4e7a-975d-f21325a46501 tempest-CinderUnicodeTest-19796481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:18 devstack sudo[109220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef.info Aug 10 13:08:18 devstack sudo[109220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:18 devstack sudo[109215]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b58f5177-10aa-4735-bca9-af38c9285ae2 tempest-ProjectReaderTests-1094401723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849" returned: 0 in 0.458s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b58f5177-10aa-4735-bca9-af38c9285ae2 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:18 devstack sudo[109229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849 Aug 10 13:08:18 devstack sudo[109229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:18 devstack sudo[109220]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8cf7b3a2-de0c-4e7a-975d-f21325a46501 tempest-CinderUnicodeTest-19796481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef.info" returned: 0 in 0.333s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:18 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-8cf7b3a2-de0c-4e7a-975d-f21325a46501 tempest-CinderUnicodeTest-19796481 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef.info is being set with open permissions: ugo+rw Aug 10 13:08:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8cf7b3a2-de0c-4e7a-975d-f21325a46501 tempest-CinderUnicodeTest-19796481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:19 devstack sudo[109216]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ac2645f0-9135-4dbd-aa9a-cd3f49074315 tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e" returned: 0 in 0.495s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ac2645f0-9135-4dbd-aa9a-cd3f49074315 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:19 devstack sudo[109233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef.info Aug 10 13:08:19 devstack sudo[109233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:19 devstack sudo[109234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e Aug 10 13:08:19 devstack sudo[109234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:19 devstack sudo[109229]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b58f5177-10aa-4735-bca9-af38c9285ae2 tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-b2f9991a-bd53-4eee-9404-597f612bf849" returned: 0 in 0.287s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b58f5177-10aa-4735-bca9-af38c9285ae2 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-quobyte-b2f9991a-bd53-4eee-9404-597f612bf849" released by "delete_volume" :: held 0.813s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-b58f5177-10aa-4735-bca9-af38c9285ae2 tempest-ProjectReaderTests-1094401723 None] Created reservations ['7db0b4fc-b131-4616-b9b1-498b70012beb', '8c19cb2c-7b0a-4d74-a681-275956f22030', 'edffd9a5-e81c-4a1a-9aab-6c7628e1b35c', 'bd7d4bcc-c450-4d87-a9a7-3cf54c7f4d3c'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:08:19 devstack sudo[109233]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8cf7b3a2-de0c-4e7a-975d-f21325a46501 tempest-CinderUnicodeTest-19796481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef.info" returned: 0 in 0.292s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8cf7b3a2-de0c-4e7a-975d-f21325a46501 tempest-CinderUnicodeTest-19796481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.237s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.424s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7cb27b7-31ac-49c6-affb-710feeb2e06e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8daf33dfe1be4a349e031cb0f0b1b069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:08:16Z,use_quota=True,user_id='5cfccab215e54cdd884b70162930b385',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Creating volume f7cb27b7-31ac-49c6-affb-710feeb2e06e {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:19 devstack sudo[109234]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:08:19 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f7cb27b7-31ac-49c6-affb-710feeb2e06e 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ac2645f0-9135-4dbd-aa9a-cd3f49074315 tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0caaa217-71bf-4549-9e72-4554f4fbaa1e" returned: 0 in 0.326s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:19 devstack sudo[109240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f7cb27b7-31ac-49c6-affb-710feeb2e06e 1073741824 Aug 10 13:08:19 devstack sudo[109240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ac2645f0-9135-4dbd-aa9a-cd3f49074315 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "cinder-quobyte-0caaa217-71bf-4549-9e72-4554f4fbaa1e" released by "delete_volume" :: held 0.894s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:19 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-8cf7b3a2-de0c-4e7a-975d-f21325a46501 tempest-CinderUnicodeTest-19796481 None] Create snapshot completed successfully Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b58f5177-10aa-4735-bca9-af38c9285ae2 tempest-ProjectReaderTests-1094401723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b58f5177-10aa-4735-bca9-af38c9285ae2 tempest-ProjectReaderTests-1094401723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b58f5177-10aa-4735-bca9-af38c9285ae2 tempest-ProjectReaderTests-1094401723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-b58f5177-10aa-4735-bca9-af38c9285ae2 tempest-ProjectReaderTests-1094401723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-b58f5177-10aa-4735-bca9-af38c9285ae2 tempest-ProjectReaderTests-1094401723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b58f5177-10aa-4735-bca9-af38c9285ae2 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:19 devstack sudo[109242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-ac2645f0-9135-4dbd-aa9a-cd3f49074315 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Created reservations ['9d24ddf6-8710-46ab-8d29-0ce0cb2fd694', '50ea11cf-1c64-4fe3-a6f0-4dbb0c31f835', 'dd74b964-11b7-49e0-a627-1a5677f64aeb', 'b0d83177-bb26-4f40-8186-870c9411ca2d'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:08:19 devstack sudo[109242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ac2645f0-9135-4dbd-aa9a-cd3f49074315 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ac2645f0-9135-4dbd-aa9a-cd3f49074315 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ac2645f0-9135-4dbd-aa9a-cd3f49074315 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ac2645f0-9135-4dbd-aa9a-cd3f49074315 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ac2645f0-9135-4dbd-aa9a-cd3f49074315 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ac2645f0-9135-4dbd-aa9a-cd3f49074315 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:19 devstack sudo[109244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:08:19 devstack sudo[109244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:19 devstack sudo[109242]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b58f5177-10aa-4735-bca9-af38c9285ae2 tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.355s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-b58f5177-10aa-4735-bca9-af38c9285ae2 tempest-ProjectReaderTests-1094401723 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:08:19 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-b58f5177-10aa-4735-bca9-af38c9285ae2 tempest-ProjectReaderTests-1094401723 None] Deleted volume successfully. Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b58f5177-10aa-4735-bca9-af38c9285ae2 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-b2f9991a-bd53-4eee-9404-597f612bf849-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:19 devstack sudo[109244]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ac2645f0-9135-4dbd-aa9a-cd3f49074315 tempest-CreateVolumesFromSnapshotTest-1515277745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.314s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-ac2645f0-9135-4dbd-aa9a-cd3f49074315 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:08:19 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-ac2645f0-9135-4dbd-aa9a-cd3f49074315 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Deleted volume successfully. Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ac2645f0-9135-4dbd-aa9a-cd3f49074315 tempest-CreateVolumesFromSnapshotTest-1515277745 None] Lock "cinder-0caaa217-71bf-4549-9e72-4554f4fbaa1e-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:19 devstack sudo[109240]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f7cb27b7-31ac-49c6-affb-710feeb2e06e 1073741824" returned: 0 in 0.651s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:19 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d84d4b5-a062-4991-a7ec-01f687faaa19 tempest-ProjectReaderTests-1094401723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6d84d4b5-a062-4991-a7ec-01f687faaa19 tempest-ProjectReaderTests-1094401723 None] Flow 'volume_create_manager' (e0e93f86-fffe-44e0-81b5-e3509cd6bdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6d84d4b5-a062-4991-a7ec-01f687faaa19 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9053abc-95ba-4ef8-8fa8-149a70bd8939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6d84d4b5-a062-4991-a7ec-01f687faaa19 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9053abc-95ba-4ef8-8fa8-149a70bd8939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2069796130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3c97bb2-5263-4e61-8113-0c9907e2e6eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3fbef4ea4b40c2b96647d90e846ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:08:20Z,use_quota=True,user_id='4d8ab61bc38544b882b64c5a57855803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6d84d4b5-a062-4991-a7ec-01f687faaa19 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (374954ed-0e46-4f40-a63c-af96d419ef6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6d84d4b5-a062-4991-a7ec-01f687faaa19 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (374954ed-0e46-4f40-a63c-af96d419ef6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6d84d4b5-a062-4991-a7ec-01f687faaa19 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e2f58d4-33cd-4b9f-9870-bbecb8c92a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6d84d4b5-a062-4991-a7ec-01f687faaa19 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e2f58d4-33cd-4b9f-9870-bbecb8c92a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3c97bb2-5263-4e61-8113-0c9907e2e6eb', 'volume_name': 'volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6d84d4b5-a062-4991-a7ec-01f687faaa19 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a52a44e5-a421-4f32-8110-4e53c1b6f816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6d84d4b5-a062-4991-a7ec-01f687faaa19 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a52a44e5-a421-4f32-8110-4e53c1b6f816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6d84d4b5-a062-4991-a7ec-01f687faaa19 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a234f6f-15b1-446e-ba55-fa5aa493cfac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:20 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-6d84d4b5-a062-4991-a7ec-01f687faaa19 tempest-ProjectReaderTests-1094401723 None] Volume d3c97bb2-5263-4e61-8113-0c9907e2e6eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb', 'volume_size': 1} Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6d84d4b5-a062-4991-a7ec-01f687faaa19 tempest-ProjectReaderTests-1094401723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f7cb27b7-31ac-49c6-affb-710feeb2e06e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:20 devstack sudo[109252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f7cb27b7-31ac-49c6-affb-710feeb2e06e Aug 10 13:08:20 devstack sudo[109252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d54d989d-29aa-479b-8516-4bed4114a267 tempest-CinderUnicodeTest-19796481 None] Acquiring lock "cinder-10c13ee0-1e1f-4cfd-b042-fedbcf680b79-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d54d989d-29aa-479b-8516-4bed4114a267 tempest-CinderUnicodeTest-19796481 None] Lock "cinder-10c13ee0-1e1f-4cfd-b042-fedbcf680b79-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d54d989d-29aa-479b-8516-4bed4114a267 tempest-CinderUnicodeTest-19796481 None] Acquiring lock "cinder-quobyte-ec7134cd-ce3e-46a4-bd95-de89419ae6ef" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d54d989d-29aa-479b-8516-4bed4114a267 tempest-CinderUnicodeTest-19796481 None] Lock "cinder-quobyte-ec7134cd-ce3e-46a4-bd95-de89419ae6ef" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d54d989d-29aa-479b-8516-4bed4114a267 tempest-CinderUnicodeTest-19796481 None] Acquiring lock "cinder-quobyte-10c13ee0-1e1f-4cfd-b042-fedbcf680b79" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d54d989d-29aa-479b-8516-4bed4114a267 tempest-CinderUnicodeTest-19796481 None] Lock "cinder-quobyte-10c13ee0-1e1f-4cfd-b042-fedbcf680b79" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-d54d989d-29aa-479b-8516-4bed4114a267 tempest-CinderUnicodeTest-19796481 None] Deleting offline snapshot 10c13ee0-1e1f-4cfd-b042-fedbcf680b79 of volume ec7134cd-ce3e-46a4-bd95-de89419ae6ef {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-d54d989d-29aa-479b-8516-4bed4114a267 tempest-CinderUnicodeTest-19796481 None] snapshot_file for this snap is: volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef.10c13ee0-1e1f-4cfd-b042-fedbcf680b79 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[490aecc2-803e-4cf9-9e4f-209b4f622dc3]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d54d989d-29aa-479b-8516-4bed4114a267 tempest-CinderUnicodeTest-19796481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef.10c13ee0-1e1f-4cfd-b042-fedbcf680b79 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:20 devstack sudo[109252]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f7cb27b7-31ac-49c6-affb-710feeb2e06e" returned: 0 in 0.279s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6d84d4b5-a062-4991-a7ec-01f687faaa19 tempest-ProjectReaderTests-1094401723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.291s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6d84d4b5-a062-4991-a7ec-01f687faaa19 tempest-ProjectReaderTests-1094401723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2069796130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3c97bb2-5263-4e61-8113-0c9907e2e6eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3fbef4ea4b40c2b96647d90e846ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:08:20Z,use_quota=True,user_id='4d8ab61bc38544b882b64c5a57855803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-6d84d4b5-a062-4991-a7ec-01f687faaa19 tempest-ProjectReaderTests-1094401723 None] Creating volume d3c97bb2-5263-4e61-8113-0c9907e2e6eb {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6d84d4b5-a062-4991-a7ec-01f687faaa19 tempest-ProjectReaderTests-1094401723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6d84d4b5-a062-4991-a7ec-01f687faaa19 tempest-ProjectReaderTests-1094401723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6d84d4b5-a062-4991-a7ec-01f687faaa19 tempest-ProjectReaderTests-1094401723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6d84d4b5-a062-4991-a7ec-01f687faaa19 tempest-ProjectReaderTests-1094401723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6d84d4b5-a062-4991-a7ec-01f687faaa19 tempest-ProjectReaderTests-1094401723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6d84d4b5-a062-4991-a7ec-01f687faaa19 tempest-ProjectReaderTests-1094401723 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:08:20 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-6d84d4b5-a062-4991-a7ec-01f687faaa19 tempest-ProjectReaderTests-1094401723 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6d84d4b5-a062-4991-a7ec-01f687faaa19 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:20 devstack sudo[109254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef.10c13ee0-1e1f-4cfd-b042-fedbcf680b79 Aug 10 13:08:20 devstack sudo[109254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:20 devstack sudo[109257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb 1073741824 Aug 10 13:08:20 devstack sudo[109257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG cinder.volume.volume_utils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Attempting download of 2962238b-7abb-46d4-8004-28a7b91014af ((None, [{'url': 'file:///opt/stack/data/glance/images/2962238b-7abb-46d4-8004-28a7b91014af', 'metadata': {}}])) to volume f7cb27b7-31ac-49c6-affb-710feeb2e06e. {{(pid=89096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff553fb4-7df6-4528-ac8d-2f1a5141ab4f]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2962238b-7abb-46d4-8004-28a7b91014af_97tafuxa {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:20 devstack sudo[109259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2962238b-7abb-46d4-8004-28a7b91014af_97tafuxa Aug 10 13:08:20 devstack sudo[109259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:20 devstack sudo[109254]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d54d989d-29aa-479b-8516-4bed4114a267 tempest-CinderUnicodeTest-19796481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef.10c13ee0-1e1f-4cfd-b042-fedbcf680b79" returned: 0 in 0.409s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-d54d989d-29aa-479b-8516-4bed4114a267 tempest-CinderUnicodeTest-19796481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e1446d-3434-40ba-b00c-f4b72f9a2801]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d54d989d-29aa-479b-8516-4bed4114a267 tempest-CinderUnicodeTest-19796481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:20 devstack sudo[109257]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:20 devstack sudo[109268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef Aug 10 13:08:20 devstack sudo[109268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6d84d4b5-a062-4991-a7ec-01f687faaa19 tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb 1073741824" returned: 0 in 0.481s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:20 devstack sudo[109259]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2962238b-7abb-46d4-8004-28a7b91014af_97tafuxa" returned: 0 in 0.391s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2962238b-7abb-46d4-8004-28a7b91014af_97tafuxa {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6d84d4b5-a062-4991-a7ec-01f687faaa19 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:20 devstack sudo[109273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb Aug 10 13:08:20 devstack sudo[109273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:21 devstack sudo[109272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2962238b-7abb-46d4-8004-28a7b91014af_97tafuxa Aug 10 13:08:21 devstack sudo[109272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:21 devstack sudo[109268]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d54d989d-29aa-479b-8516-4bed4114a267 tempest-CinderUnicodeTest-19796481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef" returned: 0 in 0.458s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d54d989d-29aa-479b-8516-4bed4114a267 tempest-CinderUnicodeTest-19796481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef.10c13ee0-1e1f-4cfd-b042-fedbcf680b79 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:21 devstack sudo[109280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef.10c13ee0-1e1f-4cfd-b042-fedbcf680b79 Aug 10 13:08:21 devstack sudo[109280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:21 devstack sudo[109272]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2962238b-7abb-46d4-8004-28a7b91014af_97tafuxa" returned: 1 in 0.398s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2962238b-7abb-46d4-8004-28a7b91014af_97tafuxa' failed. Not Retrying. {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 13:08:21 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b2a4f8-02d3-4a27-99e5-8084d8a528b8]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2962238b-7abb-46d4-8004-28a7b91014af_emcw35eqdevstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:21 devstack sudo[109273]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6d84d4b5-a062-4991-a7ec-01f687faaa19 tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb" returned: 0 in 0.343s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:21 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6d84d4b5-a062-4991-a7ec-01f687faaa19 tempest-ProjectReaderTests-1094401723 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:08:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6d84d4b5-a062-4991-a7ec-01f687faaa19 tempest-ProjectReaderTests-1094401723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:21 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6d84d4b5-a062-4991-a7ec-01f687faaa19 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a234f6f-15b1-446e-ba55-fa5aa493cfac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:21 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6d84d4b5-a062-4991-a7ec-01f687faaa19 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (addf7954-cd4c-4186-bc3d-52864d7caabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:21 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-6d84d4b5-a062-4991-a7ec-01f687faaa19 tempest-ProjectReaderTests-1094401723 None] Volume volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb (d3c97bb2-5263-4e61-8113-0c9907e2e6eb): created successfully Aug 10 13:08:21 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6d84d4b5-a062-4991-a7ec-01f687faaa19 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (addf7954-cd4c-4186-bc3d-52864d7caabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:21 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6d84d4b5-a062-4991-a7ec-01f687faaa19 tempest-ProjectReaderTests-1094401723 None] Flow 'volume_create_manager' (e0e93f86-fffe-44e0-81b5-e3509cd6bdcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:08:21 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-6d84d4b5-a062-4991-a7ec-01f687faaa19 tempest-ProjectReaderTests-1094401723 None] Created volume successfully. Aug 10 13:08:21 devstack sudo[109285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2962238b-7abb-46d4-8004-28a7b91014af_emcw35eqdevstack@QuobyteHD Aug 10 13:08:21 devstack sudo[109285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:21 devstack sudo[109280]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d54d989d-29aa-479b-8516-4bed4114a267 tempest-CinderUnicodeTest-19796481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef.10c13ee0-1e1f-4cfd-b042-fedbcf680b79" returned: 0 in 0.432s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d54d989d-29aa-479b-8516-4bed4114a267 tempest-CinderUnicodeTest-19796481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef.10c13ee0-1e1f-4cfd-b042-fedbcf680b79 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:21 devstack sudo[109291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef.10c13ee0-1e1f-4cfd-b042-fedbcf680b79 Aug 10 13:08:21 devstack sudo[109291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:21 devstack sudo[109285]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2962238b-7abb-46d4-8004-28a7b91014af_emcw35eqdevstack@QuobyteHD" returned: 0 in 0.402s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2962238b-7abb-46d4-8004-28a7b91014af_emcw35eqdevstack@QuobyteHD {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:21 devstack sudo[109294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2962238b-7abb-46d4-8004-28a7b91014af_emcw35eqdevstack@QuobyteHD Aug 10 13:08:21 devstack sudo[109294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:21 devstack sudo[109291]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d54d989d-29aa-479b-8516-4bed4114a267 tempest-CinderUnicodeTest-19796481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef.10c13ee0-1e1f-4cfd-b042-fedbcf680b79" returned: 0 in 0.275s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:21 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d54d989d-29aa-479b-8516-4bed4114a267 tempest-CinderUnicodeTest-19796481 None] Lock "cinder-quobyte-10c13ee0-1e1f-4cfd-b042-fedbcf680b79" released by "_delete_snapshot" :: held 1.727s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:21 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d54d989d-29aa-479b-8516-4bed4114a267 tempest-CinderUnicodeTest-19796481 None] Lock "cinder-quobyte-ec7134cd-ce3e-46a4-bd95-de89419ae6ef" released by "delete_snapshot" :: held 1.755s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:22 devstack sudo[109294]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2962238b-7abb-46d4-8004-28a7b91014af_emcw35eqdevstack@QuobyteHD" returned: 1 in 0.389s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2962238b-7abb-46d4-8004-28a7b91014af_emcw35eqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 13:08:22 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] 2962238b-7abb-46d4-8004-28a7b91014af was raw, converting to qcow2 {{(pid=89096) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 10 13:08:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2962238b-7abb-46d4-8004-28a7b91014af_emcw35eqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f7cb27b7-31ac-49c6-affb-710feeb2e06e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:22 devstack sudo[109300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2962238b-7abb-46d4-8004-28a7b91014af_emcw35eqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f7cb27b7-31ac-49c6-affb-710feeb2e06e Aug 10 13:08:22 devstack sudo[109300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:22 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-d54d989d-29aa-479b-8516-4bed4114a267 tempest-CinderUnicodeTest-19796481 None] Created reservations ['e04b9e76-8e56-4cd7-a097-48493a928381', '5076b121-77fa-4e9a-9598-3725ed6951c7', '99c97bfc-0fd0-475b-b8c0-6cee1f931f29', '673b10e0-bd2e-4fe6-9001-4d217e4ac9c8'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:08:22 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-d54d989d-29aa-479b-8516-4bed4114a267 tempest-CinderUnicodeTest-19796481 None] Delete snapshot completed successfully. Aug 10 13:08:22 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-d54d989d-29aa-479b-8516-4bed4114a267 tempest-CinderUnicodeTest-19796481 None] Lock "cinder-10c13ee0-1e1f-4cfd-b042-fedbcf680b79-delete_snapshot" released by "delete_snapshot" :: held 2.014s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-dfb441f9-eab5-48c5-bcba-01e4635dbacb tempest-ProjectReaderTests-1094401723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-dfb441f9-eab5-48c5-bcba-01e4635dbacb tempest-ProjectReaderTests-1094401723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:22 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-dfb441f9-eab5-48c5-bcba-01e4635dbacb tempest-ProjectReaderTests-1094401723 None] Creating offline snapshot 48bdbdf3-8ee0-43c8-a279-b924cb1b8c53 of volume d3c97bb2-5263-4e61-8113-0c9907e2e6eb {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 13:08:22 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d355de-00ca-4be3-81b1-cc27aa287d11]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dfb441f9-eab5-48c5-bcba-01e4635dbacb tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:22 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-fbccf048-d11e-4ee6-ac30-7499517008cc tempest-CinderUnicodeTest-19796481 None] Acquiring lock "cinder-ec7134cd-ce3e-46a4-bd95-de89419ae6ef-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:22 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-fbccf048-d11e-4ee6-ac30-7499517008cc tempest-CinderUnicodeTest-19796481 None] Lock "cinder-ec7134cd-ce3e-46a4-bd95-de89419ae6ef-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:22 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-fbccf048-d11e-4ee6-ac30-7499517008cc tempest-CinderUnicodeTest-19796481 None] Acquiring lock "cinder-quobyte-ec7134cd-ce3e-46a4-bd95-de89419ae6ef" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:22 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-fbccf048-d11e-4ee6-ac30-7499517008cc tempest-CinderUnicodeTest-19796481 None] Lock "cinder-quobyte-ec7134cd-ce3e-46a4-bd95-de89419ae6ef" acquired by "delete_volume" :: waited 0.017s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:22 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3f4ade-12dc-4c56-b1ad-d68c61056b25]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fbccf048-d11e-4ee6-ac30-7499517008cc tempest-CinderUnicodeTest-19796481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:22 devstack sudo[109304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb Aug 10 13:08:22 devstack sudo[109304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:22 devstack sudo[109307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef Aug 10 13:08:22 devstack sudo[109307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:22 devstack sudo[109300]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2962238b-7abb-46d4-8004-28a7b91014af_emcw35eqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f7cb27b7-31ac-49c6-affb-710feeb2e06e" returned: 0 in 0.648s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:22 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2962238b-7abb-46d4-8004-28a7b91014af_emcw35eqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f7cb27b7-31ac-49c6-affb-710feeb2e06e {{(pid=89096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 13:08:22 devstack cinder-volume[89096]: INFO cinder.image.image_utils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Converted 0.00 MB image at 0.00 MB/s Aug 10 13:08:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f7cb27b7-31ac-49c6-affb-710feeb2e06e 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:22 devstack sudo[109309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f7cb27b7-31ac-49c6-affb-710feeb2e06e 1G Aug 10 13:08:22 devstack sudo[109309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:22 devstack sudo[109304]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dfb441f9-eab5-48c5-bcba-01e4635dbacb tempest-ProjectReaderTests-1094401723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb" returned: 0 in 0.463s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dfb441f9-eab5-48c5-bcba-01e4635dbacb tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb.48bdbdf3-8ee0-43c8-a279-b924cb1b8c53 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:22 devstack sudo[109314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb.48bdbdf3-8ee0-43c8-a279-b924cb1b8c53 1G Aug 10 13:08:22 devstack sudo[109314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:22 devstack sudo[109307]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fbccf048-d11e-4ee6-ac30-7499517008cc tempest-CinderUnicodeTest-19796481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef" returned: 0 in 0.461s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fbccf048-d11e-4ee6-ac30-7499517008cc tempest-CinderUnicodeTest-19796481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:23 devstack sudo[109323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef Aug 10 13:08:23 devstack sudo[109323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:23 devstack sudo[109309]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f7cb27b7-31ac-49c6-affb-710feeb2e06e 1G" returned: 0 in 0.383s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:23 devstack cinder-volume[89096]: DEBUG cinder.volume.volume_utils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Downloaded image 2962238b-7abb-46d4-8004-28a7b91014af ((None, [{'url': 'file:///opt/stack/data/glance/images/2962238b-7abb-46d4-8004-28a7b91014af', 'metadata': {}}])) to volume f7cb27b7-31ac-49c6-affb-710feeb2e06e successfully. {{(pid=89096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 10 13:08:23 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Temporary image 2962238b-7abb-46d4-8004-28a7b91014af for user 5cfccab215e54cdd884b70162930b385 is deleted. {{(pid=89096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 10 13:08:23 devstack cinder-volume[89096]: DEBUG cinder.volume.volume_utils [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Marking volume f7cb27b7-31ac-49c6-affb-710feeb2e06e as bootable. {{(pid=89096) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 10 13:08:23 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Copying metadata from image 2962238b-7abb-46d4-8004-28a7b91014af to f7cb27b7-31ac-49c6-affb-710feeb2e06e. {{(pid=89096) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 10 13:08:23 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Creating volume glance metadata for volume f7cb27b7-31ac-49c6-affb-710feeb2e06e backed by image 2962238b-7abb-46d4-8004-28a7b91014af with: {'image_id': '2962238b-7abb-46d4-8004-28a7b91014af', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'be62ee0928c14129f5a83ce8f08006a3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89096) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 10 13:08:23 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ee87a5-ff07-469c-9f62-c7803e047103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7cb27b7-31ac-49c6-affb-710feeb2e06e', 'volume_size': 1, 'image_id': '2962238b-7abb-46d4-8004-28a7b91014af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2962238b-7abb-46d4-8004-28a7b91014af', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'be62ee0928c14129f5a83ce8f08006a3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8daf33dfe1be4a349e031cb0f0b1b069', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '52232c80a67b2f2b1c46cc808bce153b94e6a5e285b900fda2ea021bb72b7010ed69fb9e64bf6820895bdfcb67d9bdd52a9d70bed0a504e40154ad48d2c10a13', 'id': '2962238b-7abb-46d4-8004-28a7b91014af', 'created_at': datetime.datetime(2026, 8, 10, 11, 8, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 11, 8, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2962238b-7abb-46d4-8004-28a7b91014af/file', 'properties': {}}, 'image_service': }' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:23 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4627354d-bff7-4878-b100-c0419474d5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:23 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Volume volume-f7cb27b7-31ac-49c6-affb-710feeb2e06e (f7cb27b7-31ac-49c6-affb-710feeb2e06e): created successfully Aug 10 13:08:23 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4627354d-bff7-4878-b100-c0419474d5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:23 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Flow 'volume_create_manager' (b104a93e-a14e-4280-9ba5-355ebc9c3239) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:08:23 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-a721efe4-4aa2-40f8-85bc-504e13b26eed tempest-VolumeImageDependencyTests-1502264583 None] Created volume successfully. Aug 10 13:08:23 devstack sudo[109323]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fbccf048-d11e-4ee6-ac30-7499517008cc tempest-CinderUnicodeTest-19796481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec7134cd-ce3e-46a4-bd95-de89419ae6ef" returned: 0 in 0.316s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:23 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-fbccf048-d11e-4ee6-ac30-7499517008cc tempest-CinderUnicodeTest-19796481 None] Lock "cinder-quobyte-ec7134cd-ce3e-46a4-bd95-de89419ae6ef" released by "delete_volume" :: held 0.858s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:23 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-fbccf048-d11e-4ee6-ac30-7499517008cc tempest-CinderUnicodeTest-19796481 None] Created reservations ['8515ea87-fa58-49bb-9f17-e2de3956f0e6', '46eb6207-a2a3-43fc-acef-20680033eb88', 'ea40be7c-9478-474c-a38d-c290fa3c407a', 'c7e2292e-2d46-47bb-8541-1d807cc522b2'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:08:23 devstack sudo[109314]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dfb441f9-eab5-48c5-bcba-01e4635dbacb tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb.48bdbdf3-8ee0-43c8-a279-b924cb1b8c53 1G" returned: 0 in 0.581s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dfb441f9-eab5-48c5-bcba-01e4635dbacb tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb.48bdbdf3-8ee0-43c8-a279-b924cb1b8c53 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:23 devstack sudo[109331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb.48bdbdf3-8ee0-43c8-a279-b924cb1b8c53 Aug 10 13:08:23 devstack sudo[109331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-fbccf048-d11e-4ee6-ac30-7499517008cc tempest-CinderUnicodeTest-19796481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-fbccf048-d11e-4ee6-ac30-7499517008cc tempest-CinderUnicodeTest-19796481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:23 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-fbccf048-d11e-4ee6-ac30-7499517008cc tempest-CinderUnicodeTest-19796481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:23 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-fbccf048-d11e-4ee6-ac30-7499517008cc tempest-CinderUnicodeTest-19796481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-fbccf048-d11e-4ee6-ac30-7499517008cc tempest-CinderUnicodeTest-19796481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fbccf048-d11e-4ee6-ac30-7499517008cc tempest-CinderUnicodeTest-19796481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:23 devstack sudo[109333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:08:23 devstack sudo[109333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:23 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8c0144ad-2c93-4880-b234-d46bc791d6cf tempest-CinderUnicodeTest-19796481 None] Acquiring lock "cinder-3cf10b4d-c4b3-46cf-806c-c45057359311-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:23 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8c0144ad-2c93-4880-b234-d46bc791d6cf tempest-CinderUnicodeTest-19796481 None] Lock "cinder-3cf10b4d-c4b3-46cf-806c-c45057359311-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:23 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8c0144ad-2c93-4880-b234-d46bc791d6cf tempest-CinderUnicodeTest-19796481 None] Acquiring lock "cinder-quobyte-3cf10b4d-c4b3-46cf-806c-c45057359311" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:23 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8c0144ad-2c93-4880-b234-d46bc791d6cf tempest-CinderUnicodeTest-19796481 None] Lock "cinder-quobyte-3cf10b4d-c4b3-46cf-806c-c45057359311" acquired by "delete_volume" :: waited 0.022s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:23 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b01ce1a-9402-44b0-af83-30bc0000f708]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c0144ad-2c93-4880-b234-d46bc791d6cf tempest-CinderUnicodeTest-19796481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3cf10b4d-c4b3-46cf-806c-c45057359311 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:23 devstack sudo[109331]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dfb441f9-eab5-48c5-bcba-01e4635dbacb tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb.48bdbdf3-8ee0-43c8-a279-b924cb1b8c53" returned: 0 in 0.439s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:23 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-dfb441f9-eab5-48c5-bcba-01e4635dbacb tempest-ProjectReaderTests-1094401723 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb.48bdbdf3-8ee0-43c8-a279-b924cb1b8c53 is being set with open permissions: ugo+rw Aug 10 13:08:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dfb441f9-eab5-48c5-bcba-01e4635dbacb tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb.48bdbdf3-8ee0-43c8-a279-b924cb1b8c53 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:23 devstack sudo[109340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb.48bdbdf3-8ee0-43c8-a279-b924cb1b8c53 Aug 10 13:08:23 devstack sudo[109340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:23 devstack sudo[109333]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fbccf048-d11e-4ee6-ac30-7499517008cc tempest-CinderUnicodeTest-19796481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.436s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:23 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-fbccf048-d11e-4ee6-ac30-7499517008cc tempest-CinderUnicodeTest-19796481 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:08:23 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-fbccf048-d11e-4ee6-ac30-7499517008cc tempest-CinderUnicodeTest-19796481 None] Deleted volume successfully. Aug 10 13:08:23 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-fbccf048-d11e-4ee6-ac30-7499517008cc tempest-CinderUnicodeTest-19796481 None] Lock "cinder-ec7134cd-ce3e-46a4-bd95-de89419ae6ef-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:23 devstack sudo[109338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3cf10b4d-c4b3-46cf-806c-c45057359311 Aug 10 13:08:23 devstack sudo[109338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-0583b851-2110-4d7c-84cb-072f826bd57e tempest-VolumeDependencyTests-1552622682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0583b851-2110-4d7c-84cb-072f826bd57e tempest-VolumeDependencyTests-1552622682 None] Flow 'volume_create_manager' (2e1cd63d-f80f-4fac-8f2b-1156055d8c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0583b851-2110-4d7c-84cb-072f826bd57e tempest-VolumeDependencyTests-1552622682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da001f48-e443-4241-ae02-172ed237030d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0583b851-2110-4d7c-84cb-072f826bd57e tempest-VolumeDependencyTests-1552622682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da001f48-e443-4241-ae02-172ed237030d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-138991297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d1e3e5-2385-41d7-9ded-af84c82c7a50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dfaeb844121408684f9ed297508b889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:08:24Z,use_quota=True,user_id='0f53e8a41b3b498298eeac5f74a62b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0583b851-2110-4d7c-84cb-072f826bd57e tempest-VolumeDependencyTests-1552622682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b68b32b-20ff-44e9-baab-56053c1cd453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0583b851-2110-4d7c-84cb-072f826bd57e tempest-VolumeDependencyTests-1552622682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b68b32b-20ff-44e9-baab-56053c1cd453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0583b851-2110-4d7c-84cb-072f826bd57e tempest-VolumeDependencyTests-1552622682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79456c24-c3cf-40aa-a3c0-38d5b42d1204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0583b851-2110-4d7c-84cb-072f826bd57e tempest-VolumeDependencyTests-1552622682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79456c24-c3cf-40aa-a3c0-38d5b42d1204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5d1e3e5-2385-41d7-9ded-af84c82c7a50', 'volume_name': 'volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0583b851-2110-4d7c-84cb-072f826bd57e tempest-VolumeDependencyTests-1552622682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b38b83f9-790b-4222-9129-10632c499a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0583b851-2110-4d7c-84cb-072f826bd57e tempest-VolumeDependencyTests-1552622682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b38b83f9-790b-4222-9129-10632c499a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0583b851-2110-4d7c-84cb-072f826bd57e tempest-VolumeDependencyTests-1552622682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0a56c04-5a13-4c96-b78d-357b3d24568f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:24 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-0583b851-2110-4d7c-84cb-072f826bd57e tempest-VolumeDependencyTests-1552622682 None] Volume f5d1e3e5-2385-41d7-9ded-af84c82c7a50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50', 'volume_size': 1} Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0583b851-2110-4d7c-84cb-072f826bd57e tempest-VolumeDependencyTests-1552622682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:24 devstack sudo[109340]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dfb441f9-eab5-48c5-bcba-01e4635dbacb tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb.48bdbdf3-8ee0-43c8-a279-b924cb1b8c53" returned: 0 in 0.292s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dfb441f9-eab5-48c5-bcba-01e4635dbacb tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:24 devstack sudo[109346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb.info Aug 10 13:08:24 devstack sudo[109346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:24 devstack sudo[109338]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c0144ad-2c93-4880-b234-d46bc791d6cf tempest-CinderUnicodeTest-19796481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3cf10b4d-c4b3-46cf-806c-c45057359311" returned: 0 in 0.430s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c0144ad-2c93-4880-b234-d46bc791d6cf tempest-CinderUnicodeTest-19796481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3cf10b4d-c4b3-46cf-806c-c45057359311 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:24 devstack sudo[109349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3cf10b4d-c4b3-46cf-806c-c45057359311 Aug 10 13:08:24 devstack sudo[109349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-90d228e5-b17c-479b-9b51-ad999d179844 tempest-VolumeImageDependencyTests-1502264583 None] Acquiring lock "cinder-f7cb27b7-31ac-49c6-affb-710feeb2e06e-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-90d228e5-b17c-479b-9b51-ad999d179844 tempest-VolumeImageDependencyTests-1502264583 None] Lock "cinder-f7cb27b7-31ac-49c6-affb-710feeb2e06e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:24 devstack sudo[109346]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-90d228e5-b17c-479b-9b51-ad999d179844 tempest-VolumeImageDependencyTests-1502264583 None] Acquiring lock "cinder-quobyte-f7cb27b7-31ac-49c6-affb-710feeb2e06e" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dfb441f9-eab5-48c5-bcba-01e4635dbacb tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb.info" returned: 0 in 0.300s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:24 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-dfb441f9-eab5-48c5-bcba-01e4635dbacb tempest-ProjectReaderTests-1094401723 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb.info is being set with open permissions: ugo+rw Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dfb441f9-eab5-48c5-bcba-01e4635dbacb tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-90d228e5-b17c-479b-9b51-ad999d179844 tempest-VolumeImageDependencyTests-1502264583 None] Lock "cinder-quobyte-f7cb27b7-31ac-49c6-affb-710feeb2e06e" acquired by "delete_volume" :: waited 0.029s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:24 devstack sudo[109352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb.info Aug 10 13:08:24 devstack sudo[109352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[09837d42-ae22-4de6-a6ca-3a960dbc952c]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-90d228e5-b17c-479b-9b51-ad999d179844 tempest-VolumeImageDependencyTests-1502264583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f7cb27b7-31ac-49c6-affb-710feeb2e06e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:24 devstack sudo[109349]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c0144ad-2c93-4880-b234-d46bc791d6cf tempest-CinderUnicodeTest-19796481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-3cf10b4d-c4b3-46cf-806c-c45057359311" returned: 0 in 0.309s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8c0144ad-2c93-4880-b234-d46bc791d6cf tempest-CinderUnicodeTest-19796481 None] Lock "cinder-quobyte-3cf10b4d-c4b3-46cf-806c-c45057359311" released by "delete_volume" :: held 0.816s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-8c0144ad-2c93-4880-b234-d46bc791d6cf tempest-CinderUnicodeTest-19796481 None] Created reservations ['a2a7a2e8-0177-4271-862c-69b199943da4', '4178e3c4-1380-4232-a096-c2a6168f7264', '62e39ac0-177c-4d26-a0c6-022c45369a1a', '8d9b0340-8463-4180-ae59-aa762a068b5b'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:08:24 devstack sudo[109355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f7cb27b7-31ac-49c6-affb-710feeb2e06e Aug 10 13:08:24 devstack sudo[109355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8c0144ad-2c93-4880-b234-d46bc791d6cf tempest-CinderUnicodeTest-19796481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8c0144ad-2c93-4880-b234-d46bc791d6cf tempest-CinderUnicodeTest-19796481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8c0144ad-2c93-4880-b234-d46bc791d6cf tempest-CinderUnicodeTest-19796481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8c0144ad-2c93-4880-b234-d46bc791d6cf tempest-CinderUnicodeTest-19796481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8c0144ad-2c93-4880-b234-d46bc791d6cf tempest-CinderUnicodeTest-19796481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c0144ad-2c93-4880-b234-d46bc791d6cf tempest-CinderUnicodeTest-19796481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:24 devstack sudo[109352]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dfb441f9-eab5-48c5-bcba-01e4635dbacb tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb.info" returned: 0 in 0.264s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:24 devstack sudo[109358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:08:24 devstack sudo[109358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-dfb441f9-eab5-48c5-bcba-01e4635dbacb tempest-ProjectReaderTests-1094401723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.434s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0583b851-2110-4d7c-84cb-072f826bd57e tempest-VolumeDependencyTests-1552622682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.631s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0583b851-2110-4d7c-84cb-072f826bd57e tempest-VolumeDependencyTests-1552622682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-138991297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d1e3e5-2385-41d7-9ded-af84c82c7a50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dfaeb844121408684f9ed297508b889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:08:24Z,use_quota=True,user_id='0f53e8a41b3b498298eeac5f74a62b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-0583b851-2110-4d7c-84cb-072f826bd57e tempest-VolumeDependencyTests-1552622682 None] Creating volume f5d1e3e5-2385-41d7-9ded-af84c82c7a50 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0583b851-2110-4d7c-84cb-072f826bd57e tempest-VolumeDependencyTests-1552622682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0583b851-2110-4d7c-84cb-072f826bd57e tempest-VolumeDependencyTests-1552622682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0583b851-2110-4d7c-84cb-072f826bd57e tempest-VolumeDependencyTests-1552622682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0583b851-2110-4d7c-84cb-072f826bd57e tempest-VolumeDependencyTests-1552622682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0583b851-2110-4d7c-84cb-072f826bd57e tempest-VolumeDependencyTests-1552622682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0583b851-2110-4d7c-84cb-072f826bd57e tempest-VolumeDependencyTests-1552622682 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:08:24 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-0583b851-2110-4d7c-84cb-072f826bd57e tempest-VolumeDependencyTests-1552622682 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0583b851-2110-4d7c-84cb-072f826bd57e tempest-VolumeDependencyTests-1552622682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:24 devstack sudo[109360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50 1073741824 Aug 10 13:08:24 devstack sudo[109360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:24 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-dfb441f9-eab5-48c5-bcba-01e4635dbacb tempest-ProjectReaderTests-1094401723 None] Create snapshot completed successfully Aug 10 13:08:24 devstack sudo[109355]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-90d228e5-b17c-479b-9b51-ad999d179844 tempest-VolumeImageDependencyTests-1502264583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f7cb27b7-31ac-49c6-affb-710feeb2e06e" returned: 0 in 0.436s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-90d228e5-b17c-479b-9b51-ad999d179844 tempest-VolumeImageDependencyTests-1502264583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f7cb27b7-31ac-49c6-affb-710feeb2e06e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:25 devstack sudo[109367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f7cb27b7-31ac-49c6-affb-710feeb2e06e Aug 10 13:08:25 devstack sudo[109367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:25 devstack sudo[109358]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c0144ad-2c93-4880-b234-d46bc791d6cf tempest-CinderUnicodeTest-19796481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.326s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:25 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-8c0144ad-2c93-4880-b234-d46bc791d6cf tempest-CinderUnicodeTest-19796481 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:08:25 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-8c0144ad-2c93-4880-b234-d46bc791d6cf tempest-CinderUnicodeTest-19796481 None] Deleted volume successfully. Aug 10 13:08:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8c0144ad-2c93-4880-b234-d46bc791d6cf tempest-CinderUnicodeTest-19796481 None] Lock "cinder-3cf10b4d-c4b3-46cf-806c-c45057359311-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:25 devstack sudo[109367]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-90d228e5-b17c-479b-9b51-ad999d179844 tempest-VolumeImageDependencyTests-1502264583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f7cb27b7-31ac-49c6-affb-710feeb2e06e" returned: 0 in 0.295s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-90d228e5-b17c-479b-9b51-ad999d179844 tempest-VolumeImageDependencyTests-1502264583 None] Lock "cinder-quobyte-f7cb27b7-31ac-49c6-affb-710feeb2e06e" released by "delete_volume" :: held 0.785s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:25 devstack sudo[109360]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0583b851-2110-4d7c-84cb-072f826bd57e tempest-VolumeDependencyTests-1552622682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50 1073741824" returned: 0 in 0.538s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:25 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-90d228e5-b17c-479b-9b51-ad999d179844 tempest-VolumeImageDependencyTests-1502264583 None] Created reservations ['4a56007f-5ee3-4bc4-897a-16c0d4e9b946', 'ac11c4c3-aa8d-4ef7-8aa5-79fdd61469b8', '05c07371-4cf1-453d-91c2-e7a157d33bc9', '8321aec0-d08d-4732-b5e1-c3c56b776b74'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:08:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0583b851-2110-4d7c-84cb-072f826bd57e tempest-VolumeDependencyTests-1552622682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:25 devstack sudo[109373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50 Aug 10 13:08:25 devstack sudo[109373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-90d228e5-b17c-479b-9b51-ad999d179844 tempest-VolumeImageDependencyTests-1502264583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-90d228e5-b17c-479b-9b51-ad999d179844 tempest-VolumeImageDependencyTests-1502264583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:25 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-90d228e5-b17c-479b-9b51-ad999d179844 tempest-VolumeImageDependencyTests-1502264583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:25 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-90d228e5-b17c-479b-9b51-ad999d179844 tempest-VolumeImageDependencyTests-1502264583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-90d228e5-b17c-479b-9b51-ad999d179844 tempest-VolumeImageDependencyTests-1502264583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-90d228e5-b17c-479b-9b51-ad999d179844 tempest-VolumeImageDependencyTests-1502264583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:25 devstack sudo[109375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:08:25 devstack sudo[109375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f65f890a-3d24-4641-99c2-2477db44eaa0 tempest-ProjectReaderTests-1094401723 None] Acquiring lock "cinder-48bdbdf3-8ee0-43c8-a279-b924cb1b8c53-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f65f890a-3d24-4641-99c2-2477db44eaa0 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-48bdbdf3-8ee0-43c8-a279-b924cb1b8c53-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f65f890a-3d24-4641-99c2-2477db44eaa0 tempest-ProjectReaderTests-1094401723 None] Acquiring lock "cinder-quobyte-d3c97bb2-5263-4e61-8113-0c9907e2e6eb" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f65f890a-3d24-4641-99c2-2477db44eaa0 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-quobyte-d3c97bb2-5263-4e61-8113-0c9907e2e6eb" acquired by "delete_snapshot" :: waited 0.031s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f65f890a-3d24-4641-99c2-2477db44eaa0 tempest-ProjectReaderTests-1094401723 None] Acquiring lock "cinder-quobyte-48bdbdf3-8ee0-43c8-a279-b924cb1b8c53" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f65f890a-3d24-4641-99c2-2477db44eaa0 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-quobyte-48bdbdf3-8ee0-43c8-a279-b924cb1b8c53" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:25 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-f65f890a-3d24-4641-99c2-2477db44eaa0 tempest-ProjectReaderTests-1094401723 None] Deleting offline snapshot 48bdbdf3-8ee0-43c8-a279-b924cb1b8c53 of volume d3c97bb2-5263-4e61-8113-0c9907e2e6eb {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 13:08:25 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-f65f890a-3d24-4641-99c2-2477db44eaa0 tempest-ProjectReaderTests-1094401723 None] snapshot_file for this snap is: volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb.48bdbdf3-8ee0-43c8-a279-b924cb1b8c53 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 13:08:25 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52662bc-4bb0-4ec5-8823-f9f4aa355f7d]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f65f890a-3d24-4641-99c2-2477db44eaa0 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb.48bdbdf3-8ee0-43c8-a279-b924cb1b8c53 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:25 devstack sudo[109373]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0583b851-2110-4d7c-84cb-072f826bd57e tempest-VolumeDependencyTests-1552622682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50" returned: 0 in 0.397s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:25 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0583b851-2110-4d7c-84cb-072f826bd57e tempest-VolumeDependencyTests-1552622682 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:08:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0583b851-2110-4d7c-84cb-072f826bd57e tempest-VolumeDependencyTests-1552622682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:25 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0583b851-2110-4d7c-84cb-072f826bd57e tempest-VolumeDependencyTests-1552622682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0a56c04-5a13-4c96-b78d-357b3d24568f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:25 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0583b851-2110-4d7c-84cb-072f826bd57e tempest-VolumeDependencyTests-1552622682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dc62b08-ea20-467c-a6b8-fa42bde297c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:25 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-0583b851-2110-4d7c-84cb-072f826bd57e tempest-VolumeDependencyTests-1552622682 None] Volume volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50 (f5d1e3e5-2385-41d7-9ded-af84c82c7a50): created successfully Aug 10 13:08:25 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0583b851-2110-4d7c-84cb-072f826bd57e tempest-VolumeDependencyTests-1552622682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dc62b08-ea20-467c-a6b8-fa42bde297c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:25 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0583b851-2110-4d7c-84cb-072f826bd57e tempest-VolumeDependencyTests-1552622682 None] Flow 'volume_create_manager' (2e1cd63d-f80f-4fac-8f2b-1156055d8c37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:08:25 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-0583b851-2110-4d7c-84cb-072f826bd57e tempest-VolumeDependencyTests-1552622682 None] Created volume successfully. Aug 10 13:08:25 devstack sudo[109378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb.48bdbdf3-8ee0-43c8-a279-b924cb1b8c53 Aug 10 13:08:25 devstack sudo[109378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:25 devstack sudo[109375]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-90d228e5-b17c-479b-9b51-ad999d179844 tempest-VolumeImageDependencyTests-1502264583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.505s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:25 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-90d228e5-b17c-479b-9b51-ad999d179844 tempest-VolumeImageDependencyTests-1502264583 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:08:25 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-90d228e5-b17c-479b-9b51-ad999d179844 tempest-VolumeImageDependencyTests-1502264583 None] Deleted volume successfully. Aug 10 13:08:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-90d228e5-b17c-479b-9b51-ad999d179844 tempest-VolumeImageDependencyTests-1502264583 None] Lock "cinder-f7cb27b7-31ac-49c6-affb-710feeb2e06e-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:26 devstack sudo[109378]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f65f890a-3d24-4641-99c2-2477db44eaa0 tempest-ProjectReaderTests-1094401723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb.48bdbdf3-8ee0-43c8-a279-b924cb1b8c53" returned: 0 in 0.510s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:26 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-f65f890a-3d24-4641-99c2-2477db44eaa0 tempest-ProjectReaderTests-1094401723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 13:08:26 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2aa0ed-485c-4ec6-9ee9-6a2b323e65b1]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f65f890a-3d24-4641-99c2-2477db44eaa0 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4f3923c2-b254-4e21-835c-68acc7cf8f77 tempest-VolumeDependencyTests-1552622682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4f3923c2-b254-4e21-835c-68acc7cf8f77 tempest-VolumeDependencyTests-1552622682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:26 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-4f3923c2-b254-4e21-835c-68acc7cf8f77 tempest-VolumeDependencyTests-1552622682 None] Creating offline snapshot 1309201d-db97-4cd2-a843-35f6d169308b of volume f5d1e3e5-2385-41d7-9ded-af84c82c7a50 {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 13:08:26 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92bf971-308a-484a-a235-b4debdc01e09]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4f3923c2-b254-4e21-835c-68acc7cf8f77 tempest-VolumeDependencyTests-1552622682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:26 devstack sudo[109384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb Aug 10 13:08:26 devstack sudo[109384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:26 devstack sudo[109386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50 Aug 10 13:08:26 devstack sudo[109386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:26 devstack sudo[109384]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f65f890a-3d24-4641-99c2-2477db44eaa0 tempest-ProjectReaderTests-1094401723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb" returned: 0 in 0.550s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f65f890a-3d24-4641-99c2-2477db44eaa0 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb.48bdbdf3-8ee0-43c8-a279-b924cb1b8c53 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:26 devstack sudo[109392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb.48bdbdf3-8ee0-43c8-a279-b924cb1b8c53 Aug 10 13:08:26 devstack sudo[109392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:26 devstack sudo[109386]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4f3923c2-b254-4e21-835c-68acc7cf8f77 tempest-VolumeDependencyTests-1552622682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50" returned: 0 in 0.500s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4f3923c2-b254-4e21-835c-68acc7cf8f77 tempest-VolumeDependencyTests-1552622682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50.1309201d-db97-4cd2-a843-35f6d169308b 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:27 devstack sudo[109397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50.1309201d-db97-4cd2-a843-35f6d169308b 1G Aug 10 13:08:27 devstack sudo[109397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:27 devstack sudo[109392]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f65f890a-3d24-4641-99c2-2477db44eaa0 tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb.48bdbdf3-8ee0-43c8-a279-b924cb1b8c53" returned: 0 in 0.458s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f65f890a-3d24-4641-99c2-2477db44eaa0 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb.48bdbdf3-8ee0-43c8-a279-b924cb1b8c53 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:27 devstack sudo[109405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb.48bdbdf3-8ee0-43c8-a279-b924cb1b8c53 Aug 10 13:08:27 devstack sudo[109405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:27 devstack sudo[109397]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4f3923c2-b254-4e21-835c-68acc7cf8f77 tempest-VolumeDependencyTests-1552622682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50.1309201d-db97-4cd2-a843-35f6d169308b 1G" returned: 0 in 0.546s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4f3923c2-b254-4e21-835c-68acc7cf8f77 tempest-VolumeDependencyTests-1552622682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50.1309201d-db97-4cd2-a843-35f6d169308b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:27 devstack sudo[109410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50.1309201d-db97-4cd2-a843-35f6d169308b Aug 10 13:08:27 devstack sudo[109410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:27 devstack sudo[109405]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f65f890a-3d24-4641-99c2-2477db44eaa0 tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb.48bdbdf3-8ee0-43c8-a279-b924cb1b8c53" returned: 0 in 0.345s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:27 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f65f890a-3d24-4641-99c2-2477db44eaa0 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-quobyte-48bdbdf3-8ee0-43c8-a279-b924cb1b8c53" released by "_delete_snapshot" :: held 2.037s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:27 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f65f890a-3d24-4641-99c2-2477db44eaa0 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-quobyte-d3c97bb2-5263-4e61-8113-0c9907e2e6eb" released by "delete_snapshot" :: held 2.084s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:27 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-f65f890a-3d24-4641-99c2-2477db44eaa0 tempest-ProjectReaderTests-1094401723 None] Created reservations ['1845cb45-edff-441d-bfa6-7e30f7513095', '963134df-a99e-492b-b6fd-6f9a6265c15d', '9fa6a43c-eacc-49a6-81fb-c3a027bbbbb0', 'b742fc70-5f53-45ad-aff3-4f6ef0fd71ac'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:08:27 devstack sudo[109410]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4f3923c2-b254-4e21-835c-68acc7cf8f77 tempest-VolumeDependencyTests-1552622682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50.1309201d-db97-4cd2-a843-35f6d169308b" returned: 0 in 0.388s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:27 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-4f3923c2-b254-4e21-835c-68acc7cf8f77 tempest-VolumeDependencyTests-1552622682 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50.1309201d-db97-4cd2-a843-35f6d169308b is being set with open permissions: ugo+rw Aug 10 13:08:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4f3923c2-b254-4e21-835c-68acc7cf8f77 tempest-VolumeDependencyTests-1552622682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50.1309201d-db97-4cd2-a843-35f6d169308b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:27 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-f65f890a-3d24-4641-99c2-2477db44eaa0 tempest-ProjectReaderTests-1094401723 None] Delete snapshot completed successfully. Aug 10 13:08:27 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f65f890a-3d24-4641-99c2-2477db44eaa0 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-48bdbdf3-8ee0-43c8-a279-b924cb1b8c53-delete_snapshot" released by "delete_snapshot" :: held 2.336s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:27 devstack sudo[109417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50.1309201d-db97-4cd2-a843-35f6d169308b Aug 10 13:08:27 devstack sudo[109417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:28 devstack sudo[109417]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4f3923c2-b254-4e21-835c-68acc7cf8f77 tempest-VolumeDependencyTests-1552622682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50.1309201d-db97-4cd2-a843-35f6d169308b" returned: 0 in 0.260s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4f3923c2-b254-4e21-835c-68acc7cf8f77 tempest-VolumeDependencyTests-1552622682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:28 devstack sudo[109420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50.info Aug 10 13:08:28 devstack sudo[109420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:28 devstack sudo[109420]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4f3923c2-b254-4e21-835c-68acc7cf8f77 tempest-VolumeDependencyTests-1552622682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50.info" returned: 0 in 0.317s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:28 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-4f3923c2-b254-4e21-835c-68acc7cf8f77 tempest-VolumeDependencyTests-1552622682 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50.info is being set with open permissions: ugo+rw Aug 10 13:08:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4f3923c2-b254-4e21-835c-68acc7cf8f77 tempest-VolumeDependencyTests-1552622682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:28 devstack sudo[109423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50.info Aug 10 13:08:28 devstack sudo[109423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:28 devstack sudo[109423]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4f3923c2-b254-4e21-835c-68acc7cf8f77 tempest-VolumeDependencyTests-1552622682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50.info" returned: 0 in 0.294s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4f3923c2-b254-4e21-835c-68acc7cf8f77 tempest-VolumeDependencyTests-1552622682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.426s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:28 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-351a957e-5eba-4c5a-9bd6-a867d9447143 tempest-ProjectReaderTests-1094401723 None] Acquiring lock "cinder-d3c97bb2-5263-4e61-8113-0c9907e2e6eb-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:28 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-351a957e-5eba-4c5a-9bd6-a867d9447143 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-d3c97bb2-5263-4e61-8113-0c9907e2e6eb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:28 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-4f3923c2-b254-4e21-835c-68acc7cf8f77 tempest-VolumeDependencyTests-1552622682 None] Create snapshot completed successfully Aug 10 13:08:28 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-351a957e-5eba-4c5a-9bd6-a867d9447143 tempest-ProjectReaderTests-1094401723 None] Acquiring lock "cinder-quobyte-d3c97bb2-5263-4e61-8113-0c9907e2e6eb" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:28 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-351a957e-5eba-4c5a-9bd6-a867d9447143 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-quobyte-d3c97bb2-5263-4e61-8113-0c9907e2e6eb" acquired by "delete_volume" :: waited 0.019s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:29 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[37101f39-6b94-40c6-be12-fdcd1a7b7822]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-351a957e-5eba-4c5a-9bd6-a867d9447143 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:29 devstack sudo[109427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb Aug 10 13:08:29 devstack sudo[109427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:29 devstack sudo[109427]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-351a957e-5eba-4c5a-9bd6-a867d9447143 tempest-ProjectReaderTests-1094401723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb" returned: 0 in 0.391s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-351a957e-5eba-4c5a-9bd6-a867d9447143 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:29 devstack sudo[109432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb Aug 10 13:08:29 devstack sudo[109432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:29 devstack sudo[109432]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-351a957e-5eba-4c5a-9bd6-a867d9447143 tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-d3c97bb2-5263-4e61-8113-0c9907e2e6eb" returned: 0 in 0.297s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:29 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-351a957e-5eba-4c5a-9bd6-a867d9447143 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-quobyte-d3c97bb2-5263-4e61-8113-0c9907e2e6eb" released by "delete_volume" :: held 0.769s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:29 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-351a957e-5eba-4c5a-9bd6-a867d9447143 tempest-ProjectReaderTests-1094401723 None] Created reservations ['e840912c-e0ff-4878-a137-9568484d0344', '6f2937a9-937d-475b-bf2a-599d2f8ac571', '886fc09c-4df1-434b-9ca7-c536e8a935e6', '72138c10-8ae8-42f8-a535-5dfe8d55651b'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:08:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-351a957e-5eba-4c5a-9bd6-a867d9447143 tempest-ProjectReaderTests-1094401723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-351a957e-5eba-4c5a-9bd6-a867d9447143 tempest-ProjectReaderTests-1094401723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:29 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-351a957e-5eba-4c5a-9bd6-a867d9447143 tempest-ProjectReaderTests-1094401723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:29 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-351a957e-5eba-4c5a-9bd6-a867d9447143 tempest-ProjectReaderTests-1094401723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-351a957e-5eba-4c5a-9bd6-a867d9447143 tempest-ProjectReaderTests-1094401723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-351a957e-5eba-4c5a-9bd6-a867d9447143 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:29 devstack sudo[109435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:08:29 devstack sudo[109435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:30 devstack sudo[109435]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-351a957e-5eba-4c5a-9bd6-a867d9447143 tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.333s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-351a957e-5eba-4c5a-9bd6-a867d9447143 tempest-ProjectReaderTests-1094401723 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:08:30 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-351a957e-5eba-4c5a-9bd6-a867d9447143 tempest-ProjectReaderTests-1094401723 None] Deleted volume successfully. Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-351a957e-5eba-4c5a-9bd6-a867d9447143 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-d3c97bb2-5263-4e61-8113-0c9907e2e6eb-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Flow 'volume_create_manager' (a282793b-afa8-4218-bf0b-c0b4481d3bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22ee4132-f9f4-4f36-a30a-c26e254f7988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22ee4132-f9f4-4f36-a30a-c26e254f7988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1578402425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60972781-e80c-41c2-8267-1d30c6d550c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dfaeb844121408684f9ed297508b889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1309201d-db97-4cd2-a843-35f6d169308b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:08:30Z,use_quota=True,user_id='0f53e8a41b3b498298eeac5f74a62b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa4eed3f-63cf-4d93-9f73-1bd1526b695d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa4eed3f-63cf-4d93-9f73-1bd1526b695d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77737033-ad18-4d32-80c0-a14f38c35138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77737033-ad18-4d32-80c0-a14f38c35138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '60972781-e80c-41c2-8267-1d30c6d550c8', 'volume_name': 'volume-60972781-e80c-41c2-8267-1d30c6d550c8', 'volume_size': 1, 'snapshot_id': '1309201d-db97-4cd2-a843-35f6d169308b'}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed6480c3-9e98-463e-82bc-5c8ab313a64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed6480c3-9e98-463e-82bc-5c8ab313a64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b70a41b-83b8-44c0-a408-f1741670aefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:30 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Volume 60972781-e80c-41c2-8267-1d30c6d550c8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-60972781-e80c-41c2-8267-1d30c6d550c8', 'volume_size': 1, 'snapshot_id': '1309201d-db97-4cd2-a843-35f6d169308b'} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Acquiring lock "cinder-quobyte-1309201d-db97-4cd2-a843-35f6d169308b-60972781-e80c-41c2-8267-1d30c6d550c8" by "_create_volume_from_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-532e01d7-574f-4d6d-8354-76919a55e04e tempest-ProjectReaderTests-1094401723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-532e01d7-574f-4d6d-8354-76919a55e04e tempest-ProjectReaderTests-1094401723 None] Flow 'volume_create_manager' (e5749be6-9e1d-47fb-9ae5-7166232bc143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-532e01d7-574f-4d6d-8354-76919a55e04e tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5190ac65-5d7d-48ca-b9e7-832992b979b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Lock "cinder-quobyte-1309201d-db97-4cd2-a843-35f6d169308b-60972781-e80c-41c2-8267-1d30c6d550c8" acquired by "_create_volume_from_snapshot" :: waited 0.058s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Creating volume 60972781-e80c-41c2-8267-1d30c6d550c8 from snapshot 1309201d-db97-4cd2-a843-35f6d169308b {{(pid=89096) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Acquiring lock "cinder-quobyte-60972781-e80c-41c2-8267-1d30c6d550c8" by "_copy_volume_from_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-532e01d7-574f-4d6d-8354-76919a55e04e tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5190ac65-5d7d-48ca-b9e7-832992b979b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-432905029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d08f94e-fbe6-4e64-95f5-771c2b8682a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3fbef4ea4b40c2b96647d90e846ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:08:31Z,use_quota=True,user_id='4d8ab61bc38544b882b64c5a57855803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-532e01d7-574f-4d6d-8354-76919a55e04e tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6521864f-228c-4f5b-a05c-af7ffef0ad8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-532e01d7-574f-4d6d-8354-76919a55e04e tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6521864f-228c-4f5b-a05c-af7ffef0ad8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-532e01d7-574f-4d6d-8354-76919a55e04e tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (331c4569-cd00-4ecc-acce-da7a085d136e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-532e01d7-574f-4d6d-8354-76919a55e04e tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (331c4569-cd00-4ecc-acce-da7a085d136e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d08f94e-fbe6-4e64-95f5-771c2b8682a0', 'volume_name': 'volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-532e01d7-574f-4d6d-8354-76919a55e04e tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (456f7e81-7238-434c-a40e-a1e915fd6e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-532e01d7-574f-4d6d-8354-76919a55e04e tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (456f7e81-7238-434c-a40e-a1e915fd6e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-532e01d7-574f-4d6d-8354-76919a55e04e tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed2085fc-a924-43e8-8f07-e3a06878a39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:30 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-532e01d7-574f-4d6d-8354-76919a55e04e tempest-ProjectReaderTests-1094401723 None] Volume 5d08f94e-fbe6-4e64-95f5-771c2b8682a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0', 'volume_size': 1} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-532e01d7-574f-4d6d-8354-76919a55e04e tempest-ProjectReaderTests-1094401723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Lock "cinder-quobyte-60972781-e80c-41c2-8267-1d30c6d550c8" acquired by "_copy_volume_from_snapshot" :: waited 0.059s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] snapshot: 1309201d-db97-4cd2-a843-35f6d169308b, volume: 60972781-e80c-41c2-8267-1d30c6d550c8, {{(pid=89096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f9df2d-06c4-45e2-a73f-4194b3506afe]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50.1309201d-db97-4cd2-a843-35f6d169308b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:31 devstack sudo[109438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50.1309201d-db97-4cd2-a843-35f6d169308b Aug 10 13:08:31 devstack sudo[109438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:31 devstack sudo[109438]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50.1309201d-db97-4cd2-a843-35f6d169308b" returned: 0 in 0.401s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:31 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 13:08:31 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc22ac1-7f8e-4874-a106-f95646470a80]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:31 devstack sudo[109443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50 Aug 10 13:08:31 devstack sudo[109443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:31 devstack sudo[109443]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50" returned: 0 in 0.416s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:31 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50 {{(pid=89096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 10 13:08:31 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Creating direct copy from snapshot {{(pid=89096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 10 13:08:31 devstack cinder-volume[89096]: DEBUG cinder.utils [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Path /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-60972781-e80c-41c2-8267-1d30c6d550c8 not found in is_blk_device check {{(pid=89096) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 10 13:08:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-60972781-e80c-41c2-8267-1d30c6d550c8 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:31 devstack sudo[109449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-60972781-e80c-41c2-8267-1d30c6d550c8 Aug 10 13:08:31 devstack sudo[109449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:37 devstack sudo[109449]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-60972781-e80c-41c2-8267-1d30c6d550c8" returned: 0 in 5.580s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:37 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Image conversion details: src /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50, size 1024.00 MB, duration 5.58 sec, destination /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-60972781-e80c-41c2-8267-1d30c6d550c8 {{(pid=89096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 13:08:37 devstack cinder-volume[89096]: INFO cinder.image.image_utils [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Converted 1024.00 MB image at 183.48 MB/s Aug 10 13:08:37 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-60972781-e80c-41c2-8267-1d30c6d550c8 is being set with open permissions: ugo+rw Aug 10 13:08:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-60972781-e80c-41c2-8267-1d30c6d550c8 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:37 devstack sudo[109498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-60972781-e80c-41c2-8267-1d30c6d550c8 Aug 10 13:08:37 devstack sudo[109498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:37 devstack sudo[109498]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-60972781-e80c-41c2-8267-1d30c6d550c8" returned: 0 in 0.293s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:37 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Lock "cinder-quobyte-60972781-e80c-41c2-8267-1d30c6d550c8" released by "_copy_volume_from_snapshot" :: held 6.796s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:37 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Lock "cinder-quobyte-1309201d-db97-4cd2-a843-35f6d169308b-60972781-e80c-41c2-8267-1d30c6d550c8" released by "_create_volume_from_snapshot" :: held 6.919s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.978s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-532e01d7-574f-4d6d-8354-76919a55e04e tempest-ProjectReaderTests-1094401723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.865s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:37 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-532e01d7-574f-4d6d-8354-76919a55e04e tempest-ProjectReaderTests-1094401723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-432905029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d08f94e-fbe6-4e64-95f5-771c2b8682a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3fbef4ea4b40c2b96647d90e846ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:08:31Z,use_quota=True,user_id='4d8ab61bc38544b882b64c5a57855803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:08:37 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-532e01d7-574f-4d6d-8354-76919a55e04e tempest-ProjectReaderTests-1094401723 None] Creating volume 5d08f94e-fbe6-4e64-95f5-771c2b8682a0 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:08:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-532e01d7-574f-4d6d-8354-76919a55e04e tempest-ProjectReaderTests-1094401723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-532e01d7-574f-4d6d-8354-76919a55e04e tempest-ProjectReaderTests-1094401723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:37 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-532e01d7-574f-4d6d-8354-76919a55e04e tempest-ProjectReaderTests-1094401723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:37 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-532e01d7-574f-4d6d-8354-76919a55e04e tempest-ProjectReaderTests-1094401723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-532e01d7-574f-4d6d-8354-76919a55e04e tempest-ProjectReaderTests-1094401723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:37 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-532e01d7-574f-4d6d-8354-76919a55e04e tempest-ProjectReaderTests-1094401723 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:08:37 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-532e01d7-574f-4d6d-8354-76919a55e04e tempest-ProjectReaderTests-1094401723 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:08:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-532e01d7-574f-4d6d-8354-76919a55e04e tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:37 devstack sudo[109501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0 1073741824 Aug 10 13:08:37 devstack sudo[109501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b70a41b-83b8-44c0-a408-f1741670aefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60972781-e80c-41c2-8267-1d30c6d550c8', 'volume_size': 1, 'snapshot_id': '1309201d-db97-4cd2-a843-35f6d169308b'}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7855913a-c474-4920-8f91-4203df473d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:37 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Volume volume-60972781-e80c-41c2-8267-1d30c6d550c8 (60972781-e80c-41c2-8267-1d30c6d550c8): created successfully Aug 10 13:08:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7855913a-c474-4920-8f91-4203df473d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Flow 'volume_create_manager' (a282793b-afa8-4218-bf0b-c0b4481d3bc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:08:37 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-3919cc5d-299a-4b34-a8aa-d7d969ca6d51 tempest-VolumeDependencyTests-1552622682 None] Created volume successfully. Aug 10 13:08:37 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-683f5e0e-76df-4cba-9269-17e9cc9d6dd4 tempest-ProjectReaderTests-2057875875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:08:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-683f5e0e-76df-4cba-9269-17e9cc9d6dd4 tempest-ProjectReaderTests-2057875875 None] Flow 'volume_create_manager' (9e0a86bd-ebf5-4ffe-be4f-106f79e9068e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:08:37 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-683f5e0e-76df-4cba-9269-17e9cc9d6dd4 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd3f166-ec62-466e-9c45-aa2bf7cef5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-683f5e0e-76df-4cba-9269-17e9cc9d6dd4 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd3f166-ec62-466e-9c45-aa2bf7cef5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-671104935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec58f40c-1167-4c62-8097-a3683f466346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3939179bd0a6491894253cc6e502e7cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:08:38Z,use_quota=True,user_id='89c303066c944631b6118176ddeecbe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-683f5e0e-76df-4cba-9269-17e9cc9d6dd4 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (923df1d6-c1b6-496a-9e33-2ca430dbe860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-683f5e0e-76df-4cba-9269-17e9cc9d6dd4 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (923df1d6-c1b6-496a-9e33-2ca430dbe860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-683f5e0e-76df-4cba-9269-17e9cc9d6dd4 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (274de578-2334-4b4a-b1b0-e8ee188823ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-683f5e0e-76df-4cba-9269-17e9cc9d6dd4 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (274de578-2334-4b4a-b1b0-e8ee188823ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec58f40c-1167-4c62-8097-a3683f466346', 'volume_name': 'volume-ec58f40c-1167-4c62-8097-a3683f466346', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-683f5e0e-76df-4cba-9269-17e9cc9d6dd4 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29c64ebf-b3c0-475a-9f1e-5f40d971d6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-683f5e0e-76df-4cba-9269-17e9cc9d6dd4 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29c64ebf-b3c0-475a-9f1e-5f40d971d6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-683f5e0e-76df-4cba-9269-17e9cc9d6dd4 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98e36509-344b-40dc-b9eb-4e81ac027c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:38 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-683f5e0e-76df-4cba-9269-17e9cc9d6dd4 tempest-ProjectReaderTests-2057875875 None] Volume ec58f40c-1167-4c62-8097-a3683f466346: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec58f40c-1167-4c62-8097-a3683f466346', 'volume_size': 1} Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-683f5e0e-76df-4cba-9269-17e9cc9d6dd4 tempest-ProjectReaderTests-2057875875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:38 devstack sudo[109501]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-532e01d7-574f-4d6d-8354-76919a55e04e tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0 1073741824" returned: 0 in 0.503s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-532e01d7-574f-4d6d-8354-76919a55e04e tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:38 devstack sudo[109507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0 Aug 10 13:08:38 devstack sudo[109507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7a26d800-b3f1-4558-8d57-262e64eb0cc6 tempest-VolumeDependencyTests-1552622682 None] Acquiring lock "cinder-1309201d-db97-4cd2-a843-35f6d169308b-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7a26d800-b3f1-4558-8d57-262e64eb0cc6 tempest-VolumeDependencyTests-1552622682 None] Lock "cinder-1309201d-db97-4cd2-a843-35f6d169308b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7a26d800-b3f1-4558-8d57-262e64eb0cc6 tempest-VolumeDependencyTests-1552622682 None] Acquiring lock "cinder-quobyte-f5d1e3e5-2385-41d7-9ded-af84c82c7a50" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7a26d800-b3f1-4558-8d57-262e64eb0cc6 tempest-VolumeDependencyTests-1552622682 None] Lock "cinder-quobyte-f5d1e3e5-2385-41d7-9ded-af84c82c7a50" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7a26d800-b3f1-4558-8d57-262e64eb0cc6 tempest-VolumeDependencyTests-1552622682 None] Acquiring lock "cinder-quobyte-1309201d-db97-4cd2-a843-35f6d169308b" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7a26d800-b3f1-4558-8d57-262e64eb0cc6 tempest-VolumeDependencyTests-1552622682 None] Lock "cinder-quobyte-1309201d-db97-4cd2-a843-35f6d169308b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-7a26d800-b3f1-4558-8d57-262e64eb0cc6 tempest-VolumeDependencyTests-1552622682 None] Deleting offline snapshot 1309201d-db97-4cd2-a843-35f6d169308b of volume f5d1e3e5-2385-41d7-9ded-af84c82c7a50 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-7a26d800-b3f1-4558-8d57-262e64eb0cc6 tempest-VolumeDependencyTests-1552622682 None] snapshot_file for this snap is: volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50.1309201d-db97-4cd2-a843-35f6d169308b {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[d322a006-bd21-44a2-868e-af8971597438]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7a26d800-b3f1-4558-8d57-262e64eb0cc6 tempest-VolumeDependencyTests-1552622682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50.1309201d-db97-4cd2-a843-35f6d169308b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:38 devstack sudo[109507]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-532e01d7-574f-4d6d-8354-76919a55e04e tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0" returned: 0 in 0.275s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-532e01d7-574f-4d6d-8354-76919a55e04e tempest-ProjectReaderTests-1094401723 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-532e01d7-574f-4d6d-8354-76919a55e04e tempest-ProjectReaderTests-1094401723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-683f5e0e-76df-4cba-9269-17e9cc9d6dd4 tempest-ProjectReaderTests-2057875875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.488s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-683f5e0e-76df-4cba-9269-17e9cc9d6dd4 tempest-ProjectReaderTests-2057875875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-671104935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec58f40c-1167-4c62-8097-a3683f466346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3939179bd0a6491894253cc6e502e7cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:08:38Z,use_quota=True,user_id='89c303066c944631b6118176ddeecbe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-683f5e0e-76df-4cba-9269-17e9cc9d6dd4 tempest-ProjectReaderTests-2057875875 None] Creating volume ec58f40c-1167-4c62-8097-a3683f466346 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-683f5e0e-76df-4cba-9269-17e9cc9d6dd4 tempest-ProjectReaderTests-2057875875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-683f5e0e-76df-4cba-9269-17e9cc9d6dd4 tempest-ProjectReaderTests-2057875875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-683f5e0e-76df-4cba-9269-17e9cc9d6dd4 tempest-ProjectReaderTests-2057875875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-683f5e0e-76df-4cba-9269-17e9cc9d6dd4 tempest-ProjectReaderTests-2057875875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-683f5e0e-76df-4cba-9269-17e9cc9d6dd4 tempest-ProjectReaderTests-2057875875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-683f5e0e-76df-4cba-9269-17e9cc9d6dd4 tempest-ProjectReaderTests-2057875875 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:08:38 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-683f5e0e-76df-4cba-9269-17e9cc9d6dd4 tempest-ProjectReaderTests-2057875875 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-683f5e0e-76df-4cba-9269-17e9cc9d6dd4 tempest-ProjectReaderTests-2057875875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec58f40c-1167-4c62-8097-a3683f466346 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:38 devstack sudo[109509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50.1309201d-db97-4cd2-a843-35f6d169308b Aug 10 13:08:38 devstack sudo[109509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-532e01d7-574f-4d6d-8354-76919a55e04e tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed2085fc-a924-43e8-8f07-e3a06878a39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:38 devstack sudo[109511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec58f40c-1167-4c62-8097-a3683f466346 1073741824 Aug 10 13:08:38 devstack sudo[109511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-532e01d7-574f-4d6d-8354-76919a55e04e tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d3fbb23-553d-431f-80d7-30a389b4cb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:38 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-532e01d7-574f-4d6d-8354-76919a55e04e tempest-ProjectReaderTests-1094401723 None] Volume volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0 (5d08f94e-fbe6-4e64-95f5-771c2b8682a0): created successfully Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-532e01d7-574f-4d6d-8354-76919a55e04e tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d3fbb23-553d-431f-80d7-30a389b4cb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-532e01d7-574f-4d6d-8354-76919a55e04e tempest-ProjectReaderTests-1094401723 None] Flow 'volume_create_manager' (e5749be6-9e1d-47fb-9ae5-7166232bc143) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:08:38 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-532e01d7-574f-4d6d-8354-76919a55e04e tempest-ProjectReaderTests-1094401723 None] Created volume successfully. Aug 10 13:08:38 devstack sudo[109509]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7a26d800-b3f1-4558-8d57-262e64eb0cc6 tempest-VolumeDependencyTests-1552622682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50.1309201d-db97-4cd2-a843-35f6d169308b" returned: 0 in 0.447s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-7a26d800-b3f1-4558-8d57-262e64eb0cc6 tempest-VolumeDependencyTests-1552622682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db97923-e573-470a-87e2-5c0a6b9ceba3]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7a26d800-b3f1-4558-8d57-262e64eb0cc6 tempest-VolumeDependencyTests-1552622682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:39 devstack sudo[109521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50 Aug 10 13:08:39 devstack sudo[109521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:39 devstack sudo[109511]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-683f5e0e-76df-4cba-9269-17e9cc9d6dd4 tempest-ProjectReaderTests-2057875875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec58f40c-1167-4c62-8097-a3683f466346 1073741824" returned: 0 in 0.530s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-683f5e0e-76df-4cba-9269-17e9cc9d6dd4 tempest-ProjectReaderTests-2057875875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec58f40c-1167-4c62-8097-a3683f466346 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:39 devstack sudo[109524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec58f40c-1167-4c62-8097-a3683f466346 Aug 10 13:08:39 devstack sudo[109524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:39 devstack sudo[109524]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-683f5e0e-76df-4cba-9269-17e9cc9d6dd4 tempest-ProjectReaderTests-2057875875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec58f40c-1167-4c62-8097-a3683f466346" returned: 0 in 0.279s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:39 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-683f5e0e-76df-4cba-9269-17e9cc9d6dd4 tempest-ProjectReaderTests-2057875875 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:08:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-683f5e0e-76df-4cba-9269-17e9cc9d6dd4 tempest-ProjectReaderTests-2057875875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:39 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-683f5e0e-76df-4cba-9269-17e9cc9d6dd4 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98e36509-344b-40dc-b9eb-4e81ac027c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec58f40c-1167-4c62-8097-a3683f466346', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:39 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-683f5e0e-76df-4cba-9269-17e9cc9d6dd4 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (269f4559-7774-4ca4-bd8b-e7afd3189375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:39 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-683f5e0e-76df-4cba-9269-17e9cc9d6dd4 tempest-ProjectReaderTests-2057875875 None] Volume volume-ec58f40c-1167-4c62-8097-a3683f466346 (ec58f40c-1167-4c62-8097-a3683f466346): created successfully Aug 10 13:08:39 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-683f5e0e-76df-4cba-9269-17e9cc9d6dd4 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (269f4559-7774-4ca4-bd8b-e7afd3189375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:39 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-683f5e0e-76df-4cba-9269-17e9cc9d6dd4 tempest-ProjectReaderTests-2057875875 None] Flow 'volume_create_manager' (9e0a86bd-ebf5-4ffe-be4f-106f79e9068e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:08:39 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-683f5e0e-76df-4cba-9269-17e9cc9d6dd4 tempest-ProjectReaderTests-2057875875 None] Created volume successfully. Aug 10 13:08:39 devstack sudo[109521]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7a26d800-b3f1-4558-8d57-262e64eb0cc6 tempest-VolumeDependencyTests-1552622682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50" returned: 0 in 0.634s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7a26d800-b3f1-4558-8d57-262e64eb0cc6 tempest-VolumeDependencyTests-1552622682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50.1309201d-db97-4cd2-a843-35f6d169308b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:39 devstack sudo[109530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50.1309201d-db97-4cd2-a843-35f6d169308b Aug 10 13:08:39 devstack sudo[109530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-46006253-7367-4bd1-ab6e-d440aee4d670 tempest-ProjectReaderTests-1094401723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-46006253-7367-4bd1-ab6e-d440aee4d670 tempest-ProjectReaderTests-1094401723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:39 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-46006253-7367-4bd1-ab6e-d440aee4d670 tempest-ProjectReaderTests-1094401723 None] Creating offline snapshot ef9e30cb-48e2-48a4-b262-c18f5e00d2fe of volume 5d08f94e-fbe6-4e64-95f5-771c2b8682a0 {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 13:08:39 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[385cf78c-1cbe-4e9b-b52f-b9f4447dc0d5]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-46006253-7367-4bd1-ab6e-d440aee4d670 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:39 devstack sudo[109530]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7a26d800-b3f1-4558-8d57-262e64eb0cc6 tempest-VolumeDependencyTests-1552622682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50.1309201d-db97-4cd2-a843-35f6d169308b" returned: 0 in 0.442s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7a26d800-b3f1-4558-8d57-262e64eb0cc6 tempest-VolumeDependencyTests-1552622682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50.1309201d-db97-4cd2-a843-35f6d169308b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:40 devstack sudo[109536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50.1309201d-db97-4cd2-a843-35f6d169308b Aug 10 13:08:40 devstack sudo[109536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:40 devstack sudo[109535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0 Aug 10 13:08:40 devstack sudo[109535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:40 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-591ea214-0d6c-4dd3-ac12-56c5e98997f0 tempest-ProjectReaderTests-2057875875 None] Acquiring lock "cinder-ec58f40c-1167-4c62-8097-a3683f466346-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:40 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-591ea214-0d6c-4dd3-ac12-56c5e98997f0 tempest-ProjectReaderTests-2057875875 None] Lock "cinder-ec58f40c-1167-4c62-8097-a3683f466346-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:40 devstack sudo[109536]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:40 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-591ea214-0d6c-4dd3-ac12-56c5e98997f0 tempest-ProjectReaderTests-2057875875 None] Acquiring lock "cinder-quobyte-ec58f40c-1167-4c62-8097-a3683f466346" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7a26d800-b3f1-4558-8d57-262e64eb0cc6 tempest-VolumeDependencyTests-1552622682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50.1309201d-db97-4cd2-a843-35f6d169308b" returned: 0 in 0.334s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:40 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-591ea214-0d6c-4dd3-ac12-56c5e98997f0 tempest-ProjectReaderTests-2057875875 None] Lock "cinder-quobyte-ec58f40c-1167-4c62-8097-a3683f466346" acquired by "delete_volume" :: waited 0.022s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:40 devstack sudo[109535]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:40 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed8bb40-192b-4079-9986-1838abd080c9]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-591ea214-0d6c-4dd3-ac12-56c5e98997f0 tempest-ProjectReaderTests-2057875875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec58f40c-1167-4c62-8097-a3683f466346 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-46006253-7367-4bd1-ab6e-d440aee4d670 tempest-ProjectReaderTests-1094401723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0" returned: 0 in 0.490s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-46006253-7367-4bd1-ab6e-d440aee4d670 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0.ef9e30cb-48e2-48a4-b262-c18f5e00d2fe 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:40 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7a26d800-b3f1-4558-8d57-262e64eb0cc6 tempest-VolumeDependencyTests-1552622682 None] Lock "cinder-quobyte-1309201d-db97-4cd2-a843-35f6d169308b" released by "_delete_snapshot" :: held 2.022s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:40 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7a26d800-b3f1-4558-8d57-262e64eb0cc6 tempest-VolumeDependencyTests-1552622682 None] Lock "cinder-quobyte-f5d1e3e5-2385-41d7-9ded-af84c82c7a50" released by "delete_snapshot" :: held 2.064s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:40 devstack sudo[109544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0.ef9e30cb-48e2-48a4-b262-c18f5e00d2fe 1G Aug 10 13:08:40 devstack sudo[109544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:40 devstack sudo[109543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec58f40c-1167-4c62-8097-a3683f466346 Aug 10 13:08:40 devstack sudo[109543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:40 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-7a26d800-b3f1-4558-8d57-262e64eb0cc6 tempest-VolumeDependencyTests-1552622682 None] Created reservations ['4041bb54-a9fe-4c0c-babd-e930b2a9c397', 'b487cce9-ff61-4fd0-bfdd-1aee3e77709e', '30880e1a-b957-4bdd-8f2b-3f5eafcae03b', '2276b618-24f9-45da-ac60-842682755621'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:08:40 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-7a26d800-b3f1-4558-8d57-262e64eb0cc6 tempest-VolumeDependencyTests-1552622682 None] Delete snapshot completed successfully. Aug 10 13:08:40 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7a26d800-b3f1-4558-8d57-262e64eb0cc6 tempest-VolumeDependencyTests-1552622682 None] Lock "cinder-1309201d-db97-4cd2-a843-35f6d169308b-delete_snapshot" released by "delete_snapshot" :: held 2.268s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:40 devstack sudo[109543]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-591ea214-0d6c-4dd3-ac12-56c5e98997f0 tempest-ProjectReaderTests-2057875875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec58f40c-1167-4c62-8097-a3683f466346" returned: 0 in 0.408s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-591ea214-0d6c-4dd3-ac12-56c5e98997f0 tempest-ProjectReaderTests-2057875875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec58f40c-1167-4c62-8097-a3683f466346 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:40 devstack sudo[109555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec58f40c-1167-4c62-8097-a3683f466346 Aug 10 13:08:40 devstack sudo[109555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:40 devstack sudo[109544]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-46006253-7367-4bd1-ab6e-d440aee4d670 tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0.ef9e30cb-48e2-48a4-b262-c18f5e00d2fe 1G" returned: 0 in 0.576s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-46006253-7367-4bd1-ab6e-d440aee4d670 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0.ef9e30cb-48e2-48a4-b262-c18f5e00d2fe {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:41 devstack sudo[109557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0.ef9e30cb-48e2-48a4-b262-c18f5e00d2fe Aug 10 13:08:41 devstack sudo[109557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:41 devstack sudo[109555]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-591ea214-0d6c-4dd3-ac12-56c5e98997f0 tempest-ProjectReaderTests-2057875875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ec58f40c-1167-4c62-8097-a3683f466346" returned: 0 in 0.288s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:41 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-591ea214-0d6c-4dd3-ac12-56c5e98997f0 tempest-ProjectReaderTests-2057875875 None] Lock "cinder-quobyte-ec58f40c-1167-4c62-8097-a3683f466346" released by "delete_volume" :: held 0.773s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:41 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-591ea214-0d6c-4dd3-ac12-56c5e98997f0 tempest-ProjectReaderTests-2057875875 None] Created reservations ['a0052a77-ca25-4daa-8381-7b6a3969e19e', '5413ab33-5733-42c0-b537-e8598bff9cf7', '819ee6d8-6419-40b4-a93d-4de9c7a1d826', 'bdf730c5-44ff-4d7e-9e48-5ac1f23dfb4f'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:08:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-591ea214-0d6c-4dd3-ac12-56c5e98997f0 tempest-ProjectReaderTests-2057875875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-591ea214-0d6c-4dd3-ac12-56c5e98997f0 tempest-ProjectReaderTests-2057875875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:41 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-591ea214-0d6c-4dd3-ac12-56c5e98997f0 tempest-ProjectReaderTests-2057875875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:41 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-591ea214-0d6c-4dd3-ac12-56c5e98997f0 tempest-ProjectReaderTests-2057875875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-591ea214-0d6c-4dd3-ac12-56c5e98997f0 tempest-ProjectReaderTests-2057875875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-591ea214-0d6c-4dd3-ac12-56c5e98997f0 tempest-ProjectReaderTests-2057875875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:41 devstack sudo[109562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:08:41 devstack sudo[109562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:41 devstack sudo[109557]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-46006253-7367-4bd1-ab6e-d440aee4d670 tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0.ef9e30cb-48e2-48a4-b262-c18f5e00d2fe" returned: 0 in 0.357s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:41 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-46006253-7367-4bd1-ab6e-d440aee4d670 tempest-ProjectReaderTests-1094401723 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0.ef9e30cb-48e2-48a4-b262-c18f5e00d2fe is being set with open permissions: ugo+rw Aug 10 13:08:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-46006253-7367-4bd1-ab6e-d440aee4d670 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0.ef9e30cb-48e2-48a4-b262-c18f5e00d2fe {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:41 devstack sudo[109565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0.ef9e30cb-48e2-48a4-b262-c18f5e00d2fe Aug 10 13:08:41 devstack sudo[109565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-591ea214-0d6c-4dd3-ac12-56c5e98997f0 tempest-ProjectReaderTests-2057875875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.319s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:41 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-591ea214-0d6c-4dd3-ac12-56c5e98997f0 tempest-ProjectReaderTests-2057875875 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:08:41 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-591ea214-0d6c-4dd3-ac12-56c5e98997f0 tempest-ProjectReaderTests-2057875875 None] Deleted volume successfully. Aug 10 13:08:41 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-591ea214-0d6c-4dd3-ac12-56c5e98997f0 tempest-ProjectReaderTests-2057875875 None] Lock "cinder-ec58f40c-1167-4c62-8097-a3683f466346-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:41 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ae06e3cf-c54a-4a2a-80fd-90eb90501d28 tempest-VolumeDependencyTests-1552622682 None] Acquiring lock "cinder-f5d1e3e5-2385-41d7-9ded-af84c82c7a50-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:41 devstack sudo[109562]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:41 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ae06e3cf-c54a-4a2a-80fd-90eb90501d28 tempest-VolumeDependencyTests-1552622682 None] Lock "cinder-f5d1e3e5-2385-41d7-9ded-af84c82c7a50-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:41 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ae06e3cf-c54a-4a2a-80fd-90eb90501d28 tempest-VolumeDependencyTests-1552622682 None] Acquiring lock "cinder-quobyte-f5d1e3e5-2385-41d7-9ded-af84c82c7a50" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:41 devstack sudo[109565]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-46006253-7367-4bd1-ab6e-d440aee4d670 tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0.ef9e30cb-48e2-48a4-b262-c18f5e00d2fe" returned: 0 in 0.527s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:41 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ae06e3cf-c54a-4a2a-80fd-90eb90501d28 tempest-VolumeDependencyTests-1552622682 None] Lock "cinder-quobyte-f5d1e3e5-2385-41d7-9ded-af84c82c7a50" acquired by "delete_volume" :: waited 0.034s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:41 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[516b00b7-f1ae-4f7c-bf4d-12cda23df465]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ae06e3cf-c54a-4a2a-80fd-90eb90501d28 tempest-VolumeDependencyTests-1552622682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-46006253-7367-4bd1-ab6e-d440aee4d670 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:42 devstack sudo[109572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0.info Aug 10 13:08:42 devstack sudo[109572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:42 devstack sudo[109571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50 Aug 10 13:08:42 devstack sudo[109571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-6815d04e-03bd-47de-adaa-8af03a7ea2d0 tempest-ProjectReaderTests-2057875875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6815d04e-03bd-47de-adaa-8af03a7ea2d0 tempest-ProjectReaderTests-2057875875 None] Flow 'volume_create_manager' (2ef9df62-b265-4e6a-9819-3d7b5cae7928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6815d04e-03bd-47de-adaa-8af03a7ea2d0 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0be9db5d-7f3a-4c3e-90eb-8637475f6eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6815d04e-03bd-47de-adaa-8af03a7ea2d0 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0be9db5d-7f3a-4c3e-90eb-8637475f6eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1458977799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=957ce528-d892-4117-866d-b1ee1a8000a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3939179bd0a6491894253cc6e502e7cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:08:42Z,use_quota=True,user_id='89c303066c944631b6118176ddeecbe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6815d04e-03bd-47de-adaa-8af03a7ea2d0 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1248b409-8124-490a-bb5f-62d18d2a8588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6815d04e-03bd-47de-adaa-8af03a7ea2d0 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1248b409-8124-490a-bb5f-62d18d2a8588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6815d04e-03bd-47de-adaa-8af03a7ea2d0 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (468d4dae-15fa-43e9-8e61-70100adc89ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6815d04e-03bd-47de-adaa-8af03a7ea2d0 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (468d4dae-15fa-43e9-8e61-70100adc89ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '957ce528-d892-4117-866d-b1ee1a8000a3', 'volume_name': 'volume-957ce528-d892-4117-866d-b1ee1a8000a3', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6815d04e-03bd-47de-adaa-8af03a7ea2d0 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02bc5d0b-248e-4231-ae4e-36e29ac28a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6815d04e-03bd-47de-adaa-8af03a7ea2d0 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02bc5d0b-248e-4231-ae4e-36e29ac28a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6815d04e-03bd-47de-adaa-8af03a7ea2d0 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6291e34-9963-4eaa-9329-24c565c288be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:42 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-6815d04e-03bd-47de-adaa-8af03a7ea2d0 tempest-ProjectReaderTests-2057875875 None] Volume 957ce528-d892-4117-866d-b1ee1a8000a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-957ce528-d892-4117-866d-b1ee1a8000a3', 'volume_size': 1} Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6815d04e-03bd-47de-adaa-8af03a7ea2d0 tempest-ProjectReaderTests-2057875875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:42 devstack sudo[109572]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-46006253-7367-4bd1-ab6e-d440aee4d670 tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0.info" returned: 0 in 0.337s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:42 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-46006253-7367-4bd1-ab6e-d440aee4d670 tempest-ProjectReaderTests-1094401723 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0.info is being set with open permissions: ugo+rw Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-46006253-7367-4bd1-ab6e-d440aee4d670 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:42 devstack sudo[109576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0.info Aug 10 13:08:42 devstack sudo[109576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:42 devstack sudo[109571]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ae06e3cf-c54a-4a2a-80fd-90eb90501d28 tempest-VolumeDependencyTests-1552622682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50" returned: 0 in 0.455s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ae06e3cf-c54a-4a2a-80fd-90eb90501d28 tempest-VolumeDependencyTests-1552622682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:42 devstack sudo[109581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50 Aug 10 13:08:42 devstack sudo[109581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:42 devstack sudo[109576]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-46006253-7367-4bd1-ab6e-d440aee4d670 tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0.info" returned: 0 in 0.290s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-46006253-7367-4bd1-ab6e-d440aee4d670 tempest-ProjectReaderTests-1094401723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.766s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6815d04e-03bd-47de-adaa-8af03a7ea2d0 tempest-ProjectReaderTests-2057875875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.355s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6815d04e-03bd-47de-adaa-8af03a7ea2d0 tempest-ProjectReaderTests-2057875875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1458977799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=957ce528-d892-4117-866d-b1ee1a8000a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3939179bd0a6491894253cc6e502e7cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:08:42Z,use_quota=True,user_id='89c303066c944631b6118176ddeecbe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-6815d04e-03bd-47de-adaa-8af03a7ea2d0 tempest-ProjectReaderTests-2057875875 None] Creating volume 957ce528-d892-4117-866d-b1ee1a8000a3 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6815d04e-03bd-47de-adaa-8af03a7ea2d0 tempest-ProjectReaderTests-2057875875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6815d04e-03bd-47de-adaa-8af03a7ea2d0 tempest-ProjectReaderTests-2057875875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6815d04e-03bd-47de-adaa-8af03a7ea2d0 tempest-ProjectReaderTests-2057875875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6815d04e-03bd-47de-adaa-8af03a7ea2d0 tempest-ProjectReaderTests-2057875875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6815d04e-03bd-47de-adaa-8af03a7ea2d0 tempest-ProjectReaderTests-2057875875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6815d04e-03bd-47de-adaa-8af03a7ea2d0 tempest-ProjectReaderTests-2057875875 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:08:42 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-6815d04e-03bd-47de-adaa-8af03a7ea2d0 tempest-ProjectReaderTests-2057875875 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6815d04e-03bd-47de-adaa-8af03a7ea2d0 tempest-ProjectReaderTests-2057875875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-957ce528-d892-4117-866d-b1ee1a8000a3 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:UPDATE=322,cinder:SELECT=243,cinder:INSERT=92,cinder:DELETE=29 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 13:08:42 devstack sudo[109585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-957ce528-d892-4117-866d-b1ee1a8000a3 1073741824 Aug 10 13:08:42 devstack sudo[109585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:42 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-46006253-7367-4bd1-ab6e-d440aee4d670 tempest-ProjectReaderTests-1094401723 None] Create snapshot completed successfully Aug 10 13:08:42 devstack sudo[109581]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ae06e3cf-c54a-4a2a-80fd-90eb90501d28 tempest-VolumeDependencyTests-1552622682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-f5d1e3e5-2385-41d7-9ded-af84c82c7a50" returned: 0 in 0.300s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ae06e3cf-c54a-4a2a-80fd-90eb90501d28 tempest-VolumeDependencyTests-1552622682 None] Lock "cinder-quobyte-f5d1e3e5-2385-41d7-9ded-af84c82c7a50" released by "delete_volume" :: held 0.861s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=223,cinder:UPDATE=305,cinder:DELETE=28,cinder:INSERT=76 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-ae06e3cf-c54a-4a2a-80fd-90eb90501d28 tempest-VolumeDependencyTests-1552622682 None] Created reservations ['2fad49ec-baa1-4164-81a4-78052d4e8974', 'ef36150e-9dae-4d98-aff4-1e538684d639', 'f4efea12-c19e-4474-b748-3c9de21d0b80', 'baa1534d-09fb-4e61-b3e5-590342f35a2a'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ae06e3cf-c54a-4a2a-80fd-90eb90501d28 tempest-VolumeDependencyTests-1552622682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ae06e3cf-c54a-4a2a-80fd-90eb90501d28 tempest-VolumeDependencyTests-1552622682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ae06e3cf-c54a-4a2a-80fd-90eb90501d28 tempest-VolumeDependencyTests-1552622682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ae06e3cf-c54a-4a2a-80fd-90eb90501d28 tempest-VolumeDependencyTests-1552622682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ae06e3cf-c54a-4a2a-80fd-90eb90501d28 tempest-VolumeDependencyTests-1552622682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ae06e3cf-c54a-4a2a-80fd-90eb90501d28 tempest-VolumeDependencyTests-1552622682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:42 devstack sudo[109587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:08:42 devstack sudo[109587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:42 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-6c64cf37-93d9-4905-b895-392c0c58aa5d tempest-VolumeDependencyTests-1552622682 None] Acquiring lock "cinder-60972781-e80c-41c2-8267-1d30c6d550c8-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:43 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-6c64cf37-93d9-4905-b895-392c0c58aa5d tempest-VolumeDependencyTests-1552622682 None] Lock "cinder-60972781-e80c-41c2-8267-1d30c6d550c8-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:43 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-6c64cf37-93d9-4905-b895-392c0c58aa5d tempest-VolumeDependencyTests-1552622682 None] Acquiring lock "cinder-quobyte-60972781-e80c-41c2-8267-1d30c6d550c8" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:43 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-6c64cf37-93d9-4905-b895-392c0c58aa5d tempest-VolumeDependencyTests-1552622682 None] Lock "cinder-quobyte-60972781-e80c-41c2-8267-1d30c6d550c8" acquired by "delete_volume" :: waited 0.023s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:43 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e206904f-3e87-4245-bdb5-29b3001d73eb tempest-ProjectReaderTests-1094401723 None] Acquiring lock "cinder-ef9e30cb-48e2-48a4-b262-c18f5e00d2fe-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:43 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a48e9e1-0426-41a6-8167-9b1914cb496f]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6c64cf37-93d9-4905-b895-392c0c58aa5d tempest-VolumeDependencyTests-1552622682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-60972781-e80c-41c2-8267-1d30c6d550c8 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:43 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e206904f-3e87-4245-bdb5-29b3001d73eb tempest-ProjectReaderTests-1094401723 None] Lock "cinder-ef9e30cb-48e2-48a4-b262-c18f5e00d2fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.067s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:43 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e206904f-3e87-4245-bdb5-29b3001d73eb tempest-ProjectReaderTests-1094401723 None] Acquiring lock "cinder-quobyte-5d08f94e-fbe6-4e64-95f5-771c2b8682a0" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:43 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e206904f-3e87-4245-bdb5-29b3001d73eb tempest-ProjectReaderTests-1094401723 None] Lock "cinder-quobyte-5d08f94e-fbe6-4e64-95f5-771c2b8682a0" acquired by "delete_snapshot" :: waited 0.025s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:43 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e206904f-3e87-4245-bdb5-29b3001d73eb tempest-ProjectReaderTests-1094401723 None] Acquiring lock "cinder-quobyte-ef9e30cb-48e2-48a4-b262-c18f5e00d2fe" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:43 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e206904f-3e87-4245-bdb5-29b3001d73eb tempest-ProjectReaderTests-1094401723 None] Lock "cinder-quobyte-ef9e30cb-48e2-48a4-b262-c18f5e00d2fe" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:43 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-e206904f-3e87-4245-bdb5-29b3001d73eb tempest-ProjectReaderTests-1094401723 None] Deleting offline snapshot ef9e30cb-48e2-48a4-b262-c18f5e00d2fe of volume 5d08f94e-fbe6-4e64-95f5-771c2b8682a0 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 13:08:43 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-e206904f-3e87-4245-bdb5-29b3001d73eb tempest-ProjectReaderTests-1094401723 None] snapshot_file for this snap is: volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0.ef9e30cb-48e2-48a4-b262-c18f5e00d2fe {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 13:08:43 devstack sudo[109593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-60972781-e80c-41c2-8267-1d30c6d550c8 Aug 10 13:08:43 devstack sudo[109593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:43 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da48575-9126-4828-b15e-3f92141c7685]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e206904f-3e87-4245-bdb5-29b3001d73eb tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0.ef9e30cb-48e2-48a4-b262-c18f5e00d2fe {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:43 devstack sudo[109585]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6815d04e-03bd-47de-adaa-8af03a7ea2d0 tempest-ProjectReaderTests-2057875875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-957ce528-d892-4117-866d-b1ee1a8000a3 1073741824" returned: 0 in 0.718s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:43 devstack sudo[109587]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ae06e3cf-c54a-4a2a-80fd-90eb90501d28 tempest-VolumeDependencyTests-1552622682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.531s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:43 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-ae06e3cf-c54a-4a2a-80fd-90eb90501d28 tempest-VolumeDependencyTests-1552622682 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:08:43 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-ae06e3cf-c54a-4a2a-80fd-90eb90501d28 tempest-VolumeDependencyTests-1552622682 None] Deleted volume successfully. Aug 10 13:08:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6815d04e-03bd-47de-adaa-8af03a7ea2d0 tempest-ProjectReaderTests-2057875875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-957ce528-d892-4117-866d-b1ee1a8000a3 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:43 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ae06e3cf-c54a-4a2a-80fd-90eb90501d28 tempest-VolumeDependencyTests-1552622682 None] Lock "cinder-f5d1e3e5-2385-41d7-9ded-af84c82c7a50-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:43 devstack sudo[109597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-957ce528-d892-4117-866d-b1ee1a8000a3 Aug 10 13:08:43 devstack sudo[109597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:43 devstack sudo[109595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0.ef9e30cb-48e2-48a4-b262-c18f5e00d2fe Aug 10 13:08:43 devstack sudo[109595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:43 devstack sudo[109593]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6c64cf37-93d9-4905-b895-392c0c58aa5d tempest-VolumeDependencyTests-1552622682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-60972781-e80c-41c2-8267-1d30c6d550c8" returned: 0 in 0.488s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6c64cf37-93d9-4905-b895-392c0c58aa5d tempest-VolumeDependencyTests-1552622682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-60972781-e80c-41c2-8267-1d30c6d550c8 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:43 devstack sudo[109603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-60972781-e80c-41c2-8267-1d30c6d550c8 Aug 10 13:08:43 devstack sudo[109603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:43 devstack sudo[109597]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6815d04e-03bd-47de-adaa-8af03a7ea2d0 tempest-ProjectReaderTests-2057875875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-957ce528-d892-4117-866d-b1ee1a8000a3" returned: 0 in 0.329s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:43 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6815d04e-03bd-47de-adaa-8af03a7ea2d0 tempest-ProjectReaderTests-2057875875 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:08:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6815d04e-03bd-47de-adaa-8af03a7ea2d0 tempest-ProjectReaderTests-2057875875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:43 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6815d04e-03bd-47de-adaa-8af03a7ea2d0 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6291e34-9963-4eaa-9329-24c565c288be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-957ce528-d892-4117-866d-b1ee1a8000a3', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:43 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6815d04e-03bd-47de-adaa-8af03a7ea2d0 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0019d99-f260-47f2-a65b-ccada23d448b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:43 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-6815d04e-03bd-47de-adaa-8af03a7ea2d0 tempest-ProjectReaderTests-2057875875 None] Volume volume-957ce528-d892-4117-866d-b1ee1a8000a3 (957ce528-d892-4117-866d-b1ee1a8000a3): created successfully Aug 10 13:08:43 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6815d04e-03bd-47de-adaa-8af03a7ea2d0 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0019d99-f260-47f2-a65b-ccada23d448b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:43 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-6815d04e-03bd-47de-adaa-8af03a7ea2d0 tempest-ProjectReaderTests-2057875875 None] Flow 'volume_create_manager' (2ef9df62-b265-4e6a-9819-3d7b5cae7928) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:08:43 devstack sudo[109595]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e206904f-3e87-4245-bdb5-29b3001d73eb tempest-ProjectReaderTests-1094401723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0.ef9e30cb-48e2-48a4-b262-c18f5e00d2fe" returned: 0 in 0.497s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:43 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-e206904f-3e87-4245-bdb5-29b3001d73eb tempest-ProjectReaderTests-1094401723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 13:08:43 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-6815d04e-03bd-47de-adaa-8af03a7ea2d0 tempest-ProjectReaderTests-2057875875 None] Created volume successfully. Aug 10 13:08:43 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fdfbea-91c5-48cf-97a4-e6dd41dc0948]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e206904f-3e87-4245-bdb5-29b3001d73eb tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:43 devstack sudo[109603]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6c64cf37-93d9-4905-b895-392c0c58aa5d tempest-VolumeDependencyTests-1552622682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-60972781-e80c-41c2-8267-1d30c6d550c8" returned: 0 in 0.305s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:43 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-6c64cf37-93d9-4905-b895-392c0c58aa5d tempest-VolumeDependencyTests-1552622682 None] Lock "cinder-quobyte-60972781-e80c-41c2-8267-1d30c6d550c8" released by "delete_volume" :: held 0.856s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:43 devstack sudo[109610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0 Aug 10 13:08:43 devstack sudo[109610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:44 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-6c64cf37-93d9-4905-b895-392c0c58aa5d tempest-VolumeDependencyTests-1552622682 None] Created reservations ['91e2d1d0-489d-4925-b07a-3fdab82bce3d', '8675a0e6-16a9-45f6-be23-b7b168ff8eae', '9115069b-86d8-4684-9aa4-4e53017ca5b8', 'ab478493-9c0c-4605-9026-4c7c324381eb'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:08:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6c64cf37-93d9-4905-b895-392c0c58aa5d tempest-VolumeDependencyTests-1552622682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6c64cf37-93d9-4905-b895-392c0c58aa5d tempest-VolumeDependencyTests-1552622682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:44 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6c64cf37-93d9-4905-b895-392c0c58aa5d tempest-VolumeDependencyTests-1552622682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:44 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6c64cf37-93d9-4905-b895-392c0c58aa5d tempest-VolumeDependencyTests-1552622682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6c64cf37-93d9-4905-b895-392c0c58aa5d tempest-VolumeDependencyTests-1552622682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6c64cf37-93d9-4905-b895-392c0c58aa5d tempest-VolumeDependencyTests-1552622682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:44 devstack sudo[109613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:08:44 devstack sudo[109613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:44 devstack sudo[109610]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e206904f-3e87-4245-bdb5-29b3001d73eb tempest-ProjectReaderTests-1094401723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0" returned: 0 in 0.466s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e206904f-3e87-4245-bdb5-29b3001d73eb tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0.ef9e30cb-48e2-48a4-b262-c18f5e00d2fe {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:44 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f9ca7fe0-68d1-454c-a19c-693ae32cf168 tempest-ProjectReaderTests-2057875875 None] Acquiring lock "cinder-957ce528-d892-4117-866d-b1ee1a8000a3-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:44 devstack sudo[109618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0.ef9e30cb-48e2-48a4-b262-c18f5e00d2fe Aug 10 13:08:44 devstack sudo[109618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:44 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f9ca7fe0-68d1-454c-a19c-693ae32cf168 tempest-ProjectReaderTests-2057875875 None] Lock "cinder-957ce528-d892-4117-866d-b1ee1a8000a3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:44 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f9ca7fe0-68d1-454c-a19c-693ae32cf168 tempest-ProjectReaderTests-2057875875 None] Acquiring lock "cinder-quobyte-957ce528-d892-4117-866d-b1ee1a8000a3" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:44 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f9ca7fe0-68d1-454c-a19c-693ae32cf168 tempest-ProjectReaderTests-2057875875 None] Lock "cinder-quobyte-957ce528-d892-4117-866d-b1ee1a8000a3" acquired by "delete_volume" :: waited 0.022s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:44 devstack sudo[109613]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:44 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb081a6-93a4-40e9-b355-5edd01850373]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f9ca7fe0-68d1-454c-a19c-693ae32cf168 tempest-ProjectReaderTests-2057875875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-957ce528-d892-4117-866d-b1ee1a8000a3 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6c64cf37-93d9-4905-b895-392c0c58aa5d tempest-VolumeDependencyTests-1552622682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.422s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:44 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-6c64cf37-93d9-4905-b895-392c0c58aa5d tempest-VolumeDependencyTests-1552622682 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:08:44 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-6c64cf37-93d9-4905-b895-392c0c58aa5d tempest-VolumeDependencyTests-1552622682 None] Deleted volume successfully. Aug 10 13:08:44 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-6c64cf37-93d9-4905-b895-392c0c58aa5d tempest-VolumeDependencyTests-1552622682 None] Lock "cinder-60972781-e80c-41c2-8267-1d30c6d550c8-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:44 devstack sudo[109627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-957ce528-d892-4117-866d-b1ee1a8000a3 Aug 10 13:08:44 devstack sudo[109627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:44 devstack sudo[109618]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e206904f-3e87-4245-bdb5-29b3001d73eb tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0.ef9e30cb-48e2-48a4-b262-c18f5e00d2fe" returned: 0 in 0.546s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e206904f-3e87-4245-bdb5-29b3001d73eb tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0.ef9e30cb-48e2-48a4-b262-c18f5e00d2fe {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:44 devstack sudo[109632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0.ef9e30cb-48e2-48a4-b262-c18f5e00d2fe Aug 10 13:08:44 devstack sudo[109632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:45 devstack sudo[109627]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f9ca7fe0-68d1-454c-a19c-693ae32cf168 tempest-ProjectReaderTests-2057875875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-957ce528-d892-4117-866d-b1ee1a8000a3" returned: 0 in 0.497s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f9ca7fe0-68d1-454c-a19c-693ae32cf168 tempest-ProjectReaderTests-2057875875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-957ce528-d892-4117-866d-b1ee1a8000a3 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:45 devstack sudo[109637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-957ce528-d892-4117-866d-b1ee1a8000a3 Aug 10 13:08:45 devstack sudo[109637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:45 devstack sudo[109632]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e206904f-3e87-4245-bdb5-29b3001d73eb tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0.ef9e30cb-48e2-48a4-b262-c18f5e00d2fe" returned: 0 in 0.346s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:45 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e206904f-3e87-4245-bdb5-29b3001d73eb tempest-ProjectReaderTests-1094401723 None] Lock "cinder-quobyte-ef9e30cb-48e2-48a4-b262-c18f5e00d2fe" released by "_delete_snapshot" :: held 1.985s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:45 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e206904f-3e87-4245-bdb5-29b3001d73eb tempest-ProjectReaderTests-1094401723 None] Lock "cinder-quobyte-5d08f94e-fbe6-4e64-95f5-771c2b8682a0" released by "delete_snapshot" :: held 2.035s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:45 devstack sudo[109637]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f9ca7fe0-68d1-454c-a19c-693ae32cf168 tempest-ProjectReaderTests-2057875875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-957ce528-d892-4117-866d-b1ee1a8000a3" returned: 0 in 0.307s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:45 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f9ca7fe0-68d1-454c-a19c-693ae32cf168 tempest-ProjectReaderTests-2057875875 None] Lock "cinder-quobyte-957ce528-d892-4117-866d-b1ee1a8000a3" released by "delete_volume" :: held 0.883s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:45 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-e206904f-3e87-4245-bdb5-29b3001d73eb tempest-ProjectReaderTests-1094401723 None] Created reservations ['a9fe746a-014c-4aaa-bb1f-0cd2e36d4e9a', '49c70958-be22-46e3-8a3a-f8a56f6ff82b', 'ccfae471-d0f7-4473-82b7-572a8d19b4d4', '35f62e8e-2126-47e3-bce9-47d28e882113'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:08:45 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-f9ca7fe0-68d1-454c-a19c-693ae32cf168 tempest-ProjectReaderTests-2057875875 None] Created reservations ['52c29ed6-4126-4e5d-89e3-a0ca77a6e80e', '4420fae7-f839-4eb0-8e65-c9bd8aab0985', 'eba95acf-3438-43b6-bdd7-2655d64e35ef', '1142b9d4-473e-48dd-ad6a-745c178a0e1f'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:08:45 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-e206904f-3e87-4245-bdb5-29b3001d73eb tempest-ProjectReaderTests-1094401723 None] Delete snapshot completed successfully. Aug 10 13:08:45 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e206904f-3e87-4245-bdb5-29b3001d73eb tempest-ProjectReaderTests-1094401723 None] Lock "cinder-ef9e30cb-48e2-48a4-b262-c18f5e00d2fe-delete_snapshot" released by "delete_snapshot" :: held 2.322s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f9ca7fe0-68d1-454c-a19c-693ae32cf168 tempest-ProjectReaderTests-2057875875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f9ca7fe0-68d1-454c-a19c-693ae32cf168 tempest-ProjectReaderTests-2057875875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:45 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f9ca7fe0-68d1-454c-a19c-693ae32cf168 tempest-ProjectReaderTests-2057875875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:45 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f9ca7fe0-68d1-454c-a19c-693ae32cf168 tempest-ProjectReaderTests-2057875875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f9ca7fe0-68d1-454c-a19c-693ae32cf168 tempest-ProjectReaderTests-2057875875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f9ca7fe0-68d1-454c-a19c-693ae32cf168 tempest-ProjectReaderTests-2057875875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:45 devstack sudo[109641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:08:45 devstack sudo[109641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:45 devstack sudo[109641]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f9ca7fe0-68d1-454c-a19c-693ae32cf168 tempest-ProjectReaderTests-2057875875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.273s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:45 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-f9ca7fe0-68d1-454c-a19c-693ae32cf168 tempest-ProjectReaderTests-2057875875 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:08:45 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-f9ca7fe0-68d1-454c-a19c-693ae32cf168 tempest-ProjectReaderTests-2057875875 None] Deleted volume successfully. Aug 10 13:08:45 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-f9ca7fe0-68d1-454c-a19c-693ae32cf168 tempest-ProjectReaderTests-2057875875 None] Lock "cinder-957ce528-d892-4117-866d-b1ee1a8000a3-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:46 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-3bc399e4-abef-4943-8713-33be625904f7 tempest-ProjectReaderTests-1094401723 None] Acquiring lock "cinder-5d08f94e-fbe6-4e64-95f5-771c2b8682a0-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:46 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-3bc399e4-abef-4943-8713-33be625904f7 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-5d08f94e-fbe6-4e64-95f5-771c2b8682a0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:46 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-3bc399e4-abef-4943-8713-33be625904f7 tempest-ProjectReaderTests-1094401723 None] Acquiring lock "cinder-quobyte-5d08f94e-fbe6-4e64-95f5-771c2b8682a0" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:46 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-3bc399e4-abef-4943-8713-33be625904f7 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-quobyte-5d08f94e-fbe6-4e64-95f5-771c2b8682a0" acquired by "delete_volume" :: waited 0.026s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:46 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86bd0e1-7c90-4f63-96cf-a7996b95561f]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3bc399e4-abef-4943-8713-33be625904f7 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:46 devstack sudo[109644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0 Aug 10 13:08:46 devstack sudo[109644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:47 devstack sudo[109644]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3bc399e4-abef-4943-8713-33be625904f7 tempest-ProjectReaderTests-1094401723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0" returned: 0 in 0.479s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3bc399e4-abef-4943-8713-33be625904f7 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:47 devstack sudo[109650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0 Aug 10 13:08:47 devstack sudo[109650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:47 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4beb8bc-1f7b-4218-bcd0-5e1bb10cc972 tempest-ProjectReaderTests-2057875875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:08:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4beb8bc-1f7b-4218-bcd0-5e1bb10cc972 tempest-ProjectReaderTests-2057875875 None] Flow 'volume_create_manager' (f26ed2ec-2044-4f42-a655-91d1732a9677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:08:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4beb8bc-1f7b-4218-bcd0-5e1bb10cc972 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d02b08b-6441-44e0-ab2a-ff1ddbac6c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:47 devstack sudo[109650]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4beb8bc-1f7b-4218-bcd0-5e1bb10cc972 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d02b08b-6441-44e0-ab2a-ff1ddbac6c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-160287063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77639bb3-7dc4-4d3e-8ceb-94deb1b68f5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3939179bd0a6491894253cc6e502e7cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:08:47Z,use_quota=True,user_id='89c303066c944631b6118176ddeecbe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4beb8bc-1f7b-4218-bcd0-5e1bb10cc972 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (253ce4b5-d9a3-4612-a4ca-743ad785d753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4beb8bc-1f7b-4218-bcd0-5e1bb10cc972 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (253ce4b5-d9a3-4612-a4ca-743ad785d753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4beb8bc-1f7b-4218-bcd0-5e1bb10cc972 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df339132-0ebe-46d8-bda1-47beda5335d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4beb8bc-1f7b-4218-bcd0-5e1bb10cc972 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df339132-0ebe-46d8-bda1-47beda5335d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77639bb3-7dc4-4d3e-8ceb-94deb1b68f5a', 'volume_name': 'volume-77639bb3-7dc4-4d3e-8ceb-94deb1b68f5a', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4beb8bc-1f7b-4218-bcd0-5e1bb10cc972 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2f8431a-be52-4b83-af31-897d01497580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4beb8bc-1f7b-4218-bcd0-5e1bb10cc972 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2f8431a-be52-4b83-af31-897d01497580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4beb8bc-1f7b-4218-bcd0-5e1bb10cc972 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (198e6e7a-0676-497c-b683-578acbcebc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:47 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-f4beb8bc-1f7b-4218-bcd0-5e1bb10cc972 tempest-ProjectReaderTests-2057875875 None] Volume 77639bb3-7dc4-4d3e-8ceb-94deb1b68f5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77639bb3-7dc4-4d3e-8ceb-94deb1b68f5a', 'volume_size': 1} Aug 10 13:08:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f4beb8bc-1f7b-4218-bcd0-5e1bb10cc972 tempest-ProjectReaderTests-2057875875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f4beb8bc-1f7b-4218-bcd0-5e1bb10cc972 tempest-ProjectReaderTests-2057875875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:47 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f4beb8bc-1f7b-4218-bcd0-5e1bb10cc972 tempest-ProjectReaderTests-2057875875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-160287063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77639bb3-7dc4-4d3e-8ceb-94deb1b68f5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3939179bd0a6491894253cc6e502e7cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:08:47Z,use_quota=True,user_id='89c303066c944631b6118176ddeecbe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:08:47 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-f4beb8bc-1f7b-4218-bcd0-5e1bb10cc972 tempest-ProjectReaderTests-2057875875 None] Creating volume 77639bb3-7dc4-4d3e-8ceb-94deb1b68f5a {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:08:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f4beb8bc-1f7b-4218-bcd0-5e1bb10cc972 tempest-ProjectReaderTests-2057875875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f4beb8bc-1f7b-4218-bcd0-5e1bb10cc972 tempest-ProjectReaderTests-2057875875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:47 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f4beb8bc-1f7b-4218-bcd0-5e1bb10cc972 tempest-ProjectReaderTests-2057875875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:47 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f4beb8bc-1f7b-4218-bcd0-5e1bb10cc972 tempest-ProjectReaderTests-2057875875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f4beb8bc-1f7b-4218-bcd0-5e1bb10cc972 tempest-ProjectReaderTests-2057875875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:47 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f4beb8bc-1f7b-4218-bcd0-5e1bb10cc972 tempest-ProjectReaderTests-2057875875 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:08:47 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-f4beb8bc-1f7b-4218-bcd0-5e1bb10cc972 tempest-ProjectReaderTests-2057875875 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:08:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f4beb8bc-1f7b-4218-bcd0-5e1bb10cc972 tempest-ProjectReaderTests-2057875875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-77639bb3-7dc4-4d3e-8ceb-94deb1b68f5a 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3bc399e4-abef-4943-8713-33be625904f7 tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-5d08f94e-fbe6-4e64-95f5-771c2b8682a0" returned: 0 in 0.451s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:47 devstack sudo[109653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-77639bb3-7dc4-4d3e-8ceb-94deb1b68f5a 1073741824 Aug 10 13:08:47 devstack sudo[109653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:47 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-3bc399e4-abef-4943-8713-33be625904f7 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-quobyte-5d08f94e-fbe6-4e64-95f5-771c2b8682a0" released by "delete_volume" :: held 1.006s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:47 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-3bc399e4-abef-4943-8713-33be625904f7 tempest-ProjectReaderTests-1094401723 None] Created reservations ['5309c806-c7f4-44c6-aa43-61872783dbbe', 'b64b208a-e085-4df2-b115-c874029c24c0', 'c84a6fd8-405d-43dd-a89a-bf18736830ee', '3107abd4-7c93-46a6-bcf9-497b6831d0b2'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:08:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3bc399e4-abef-4943-8713-33be625904f7 tempest-ProjectReaderTests-1094401723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3bc399e4-abef-4943-8713-33be625904f7 tempest-ProjectReaderTests-1094401723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:47 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3bc399e4-abef-4943-8713-33be625904f7 tempest-ProjectReaderTests-1094401723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:47 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-3bc399e4-abef-4943-8713-33be625904f7 tempest-ProjectReaderTests-1094401723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-3bc399e4-abef-4943-8713-33be625904f7 tempest-ProjectReaderTests-1094401723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3bc399e4-abef-4943-8713-33be625904f7 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:47 devstack sudo[109655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:08:47 devstack sudo[109655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:47 devstack sudo[109655]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-3bc399e4-abef-4943-8713-33be625904f7 tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.319s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:47 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-3bc399e4-abef-4943-8713-33be625904f7 tempest-ProjectReaderTests-1094401723 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:08:47 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-3bc399e4-abef-4943-8713-33be625904f7 tempest-ProjectReaderTests-1094401723 None] Deleted volume successfully. Aug 10 13:08:48 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-3bc399e4-abef-4943-8713-33be625904f7 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-5d08f94e-fbe6-4e64-95f5-771c2b8682a0-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:48 devstack sudo[109653]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f4beb8bc-1f7b-4218-bcd0-5e1bb10cc972 tempest-ProjectReaderTests-2057875875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-77639bb3-7dc4-4d3e-8ceb-94deb1b68f5a 1073741824" returned: 0 in 0.601s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f4beb8bc-1f7b-4218-bcd0-5e1bb10cc972 tempest-ProjectReaderTests-2057875875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-77639bb3-7dc4-4d3e-8ceb-94deb1b68f5a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:48 devstack sudo[109662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-77639bb3-7dc4-4d3e-8ceb-94deb1b68f5a Aug 10 13:08:48 devstack sudo[109662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:48 devstack sudo[109662]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f4beb8bc-1f7b-4218-bcd0-5e1bb10cc972 tempest-ProjectReaderTests-2057875875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-77639bb3-7dc4-4d3e-8ceb-94deb1b68f5a" returned: 0 in 0.269s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:48 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f4beb8bc-1f7b-4218-bcd0-5e1bb10cc972 tempest-ProjectReaderTests-2057875875 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:08:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f4beb8bc-1f7b-4218-bcd0-5e1bb10cc972 tempest-ProjectReaderTests-2057875875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4beb8bc-1f7b-4218-bcd0-5e1bb10cc972 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (198e6e7a-0676-497c-b683-578acbcebc2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77639bb3-7dc4-4d3e-8ceb-94deb1b68f5a', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4beb8bc-1f7b-4218-bcd0-5e1bb10cc972 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1176c9e1-ae02-4cc7-9097-c1cc8c45e57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:48 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-f4beb8bc-1f7b-4218-bcd0-5e1bb10cc972 tempest-ProjectReaderTests-2057875875 None] Volume volume-77639bb3-7dc4-4d3e-8ceb-94deb1b68f5a (77639bb3-7dc4-4d3e-8ceb-94deb1b68f5a): created successfully Aug 10 13:08:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4beb8bc-1f7b-4218-bcd0-5e1bb10cc972 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1176c9e1-ae02-4cc7-9097-c1cc8c45e57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4beb8bc-1f7b-4218-bcd0-5e1bb10cc972 tempest-ProjectReaderTests-2057875875 None] Flow 'volume_create_manager' (f26ed2ec-2044-4f42-a655-91d1732a9677) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:08:48 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-f4beb8bc-1f7b-4218-bcd0-5e1bb10cc972 tempest-ProjectReaderTests-2057875875 None] Created volume successfully. Aug 10 13:08:48 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e2169123-8b90-44e4-9bb4-f98cd81a81b6 tempest-ProjectAdminTests-485148084 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576522827148, 'free_capacity_gb': 1775.7576522827148, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89096) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4831}} Aug 10 13:08:49 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-e37487d9-f632-4272-8dbb-6c97ef8b2f23 tempest-ProjectReaderTests-1094401723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:08:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e37487d9-f632-4272-8dbb-6c97ef8b2f23 tempest-ProjectReaderTests-1094401723 None] Flow 'volume_create_manager' (7b792728-5572-4469-aa1e-3169791e0b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:08:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e37487d9-f632-4272-8dbb-6c97ef8b2f23 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19eb5fff-b503-4340-9b1c-4110aa89c605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e37487d9-f632-4272-8dbb-6c97ef8b2f23 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19eb5fff-b503-4340-9b1c-4110aa89c605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1786706120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25c7243f-c929-48e5-a9f1-e08a1694f18b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3fbef4ea4b40c2b96647d90e846ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:08:49Z,use_quota=True,user_id='4d8ab61bc38544b882b64c5a57855803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e37487d9-f632-4272-8dbb-6c97ef8b2f23 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfb8fe1e-5d04-4ff1-8095-216f7b7ac754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e37487d9-f632-4272-8dbb-6c97ef8b2f23 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfb8fe1e-5d04-4ff1-8095-216f7b7ac754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e37487d9-f632-4272-8dbb-6c97ef8b2f23 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed743757-8dd7-473e-b7d0-62001c9a478c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e37487d9-f632-4272-8dbb-6c97ef8b2f23 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed743757-8dd7-473e-b7d0-62001c9a478c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25c7243f-c929-48e5-a9f1-e08a1694f18b', 'volume_name': 'volume-25c7243f-c929-48e5-a9f1-e08a1694f18b', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e37487d9-f632-4272-8dbb-6c97ef8b2f23 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a376d797-833b-45e8-bfce-81a4a9a91850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e37487d9-f632-4272-8dbb-6c97ef8b2f23 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a376d797-833b-45e8-bfce-81a4a9a91850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:49 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e37487d9-f632-4272-8dbb-6c97ef8b2f23 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c5b897b-8878-41ad-b95d-99a73a293fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:49 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-e37487d9-f632-4272-8dbb-6c97ef8b2f23 tempest-ProjectReaderTests-1094401723 None] Volume 25c7243f-c929-48e5-a9f1-e08a1694f18b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25c7243f-c929-48e5-a9f1-e08a1694f18b', 'volume_size': 1} Aug 10 13:08:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e37487d9-f632-4272-8dbb-6c97ef8b2f23 tempest-ProjectReaderTests-1094401723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e37487d9-f632-4272-8dbb-6c97ef8b2f23 tempest-ProjectReaderTests-1094401723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:49 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e37487d9-f632-4272-8dbb-6c97ef8b2f23 tempest-ProjectReaderTests-1094401723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1786706120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25c7243f-c929-48e5-a9f1-e08a1694f18b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3fbef4ea4b40c2b96647d90e846ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:08:49Z,use_quota=True,user_id='4d8ab61bc38544b882b64c5a57855803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:08:49 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-e37487d9-f632-4272-8dbb-6c97ef8b2f23 tempest-ProjectReaderTests-1094401723 None] Creating volume 25c7243f-c929-48e5-a9f1-e08a1694f18b {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:08:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e37487d9-f632-4272-8dbb-6c97ef8b2f23 tempest-ProjectReaderTests-1094401723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e37487d9-f632-4272-8dbb-6c97ef8b2f23 tempest-ProjectReaderTests-1094401723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:49 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e37487d9-f632-4272-8dbb-6c97ef8b2f23 tempest-ProjectReaderTests-1094401723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:49 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e37487d9-f632-4272-8dbb-6c97ef8b2f23 tempest-ProjectReaderTests-1094401723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e37487d9-f632-4272-8dbb-6c97ef8b2f23 tempest-ProjectReaderTests-1094401723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:49 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e37487d9-f632-4272-8dbb-6c97ef8b2f23 tempest-ProjectReaderTests-1094401723 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:08:49 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-e37487d9-f632-4272-8dbb-6c97ef8b2f23 tempest-ProjectReaderTests-1094401723 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:08:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e37487d9-f632-4272-8dbb-6c97ef8b2f23 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:49 devstack sudo[109666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b 1073741824 Aug 10 13:08:49 devstack sudo[109666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:49 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-fd1636d8-61c7-4ea4-b801-25d89b6889f7 tempest-ProjectReaderTests-2057875875 None] Acquiring lock "cinder-77639bb3-7dc4-4d3e-8ceb-94deb1b68f5a-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:49 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-fd1636d8-61c7-4ea4-b801-25d89b6889f7 tempest-ProjectReaderTests-2057875875 None] Lock "cinder-77639bb3-7dc4-4d3e-8ceb-94deb1b68f5a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:49 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-fd1636d8-61c7-4ea4-b801-25d89b6889f7 tempest-ProjectReaderTests-2057875875 None] Acquiring lock "cinder-quobyte-77639bb3-7dc4-4d3e-8ceb-94deb1b68f5a" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:49 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-fd1636d8-61c7-4ea4-b801-25d89b6889f7 tempest-ProjectReaderTests-2057875875 None] Lock "cinder-quobyte-77639bb3-7dc4-4d3e-8ceb-94deb1b68f5a" acquired by "delete_volume" :: waited 0.016s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:49 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37786d6-3858-40b2-8118-42da9effeb60]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fd1636d8-61c7-4ea4-b801-25d89b6889f7 tempest-ProjectReaderTests-2057875875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-77639bb3-7dc4-4d3e-8ceb-94deb1b68f5a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:49 devstack sudo[109666]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e37487d9-f632-4272-8dbb-6c97ef8b2f23 tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b 1073741824" returned: 0 in 0.512s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e37487d9-f632-4272-8dbb-6c97ef8b2f23 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:49 devstack sudo[109671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-77639bb3-7dc4-4d3e-8ceb-94deb1b68f5a Aug 10 13:08:49 devstack sudo[109671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:49 devstack sudo[109673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b Aug 10 13:08:49 devstack sudo[109673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:50 devstack sudo[109673]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e37487d9-f632-4272-8dbb-6c97ef8b2f23 tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b" returned: 0 in 0.306s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:50 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e37487d9-f632-4272-8dbb-6c97ef8b2f23 tempest-ProjectReaderTests-1094401723 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:08:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e37487d9-f632-4272-8dbb-6c97ef8b2f23 tempest-ProjectReaderTests-1094401723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:50 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e37487d9-f632-4272-8dbb-6c97ef8b2f23 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c5b897b-8878-41ad-b95d-99a73a293fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25c7243f-c929-48e5-a9f1-e08a1694f18b', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:50 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e37487d9-f632-4272-8dbb-6c97ef8b2f23 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51393ab5-6d56-4569-a1ef-92c34486942c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:50 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-e37487d9-f632-4272-8dbb-6c97ef8b2f23 tempest-ProjectReaderTests-1094401723 None] Volume volume-25c7243f-c929-48e5-a9f1-e08a1694f18b (25c7243f-c929-48e5-a9f1-e08a1694f18b): created successfully Aug 10 13:08:50 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e37487d9-f632-4272-8dbb-6c97ef8b2f23 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51393ab5-6d56-4569-a1ef-92c34486942c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:50 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e37487d9-f632-4272-8dbb-6c97ef8b2f23 tempest-ProjectReaderTests-1094401723 None] Flow 'volume_create_manager' (7b792728-5572-4469-aa1e-3169791e0b96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:08:50 devstack sudo[109671]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fd1636d8-61c7-4ea4-b801-25d89b6889f7 tempest-ProjectReaderTests-2057875875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-77639bb3-7dc4-4d3e-8ceb-94deb1b68f5a" returned: 0 in 0.474s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fd1636d8-61c7-4ea4-b801-25d89b6889f7 tempest-ProjectReaderTests-2057875875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-77639bb3-7dc4-4d3e-8ceb-94deb1b68f5a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:50 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-e37487d9-f632-4272-8dbb-6c97ef8b2f23 tempest-ProjectReaderTests-1094401723 None] Created volume successfully. Aug 10 13:08:50 devstack sudo[109680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-77639bb3-7dc4-4d3e-8ceb-94deb1b68f5a Aug 10 13:08:50 devstack sudo[109680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:50 devstack sudo[109680]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fd1636d8-61c7-4ea4-b801-25d89b6889f7 tempest-ProjectReaderTests-2057875875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-77639bb3-7dc4-4d3e-8ceb-94deb1b68f5a" returned: 0 in 0.264s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:50 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-fd1636d8-61c7-4ea4-b801-25d89b6889f7 tempest-ProjectReaderTests-2057875875 None] Lock "cinder-quobyte-77639bb3-7dc4-4d3e-8ceb-94deb1b68f5a" released by "delete_volume" :: held 0.788s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:50 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-fd1636d8-61c7-4ea4-b801-25d89b6889f7 tempest-ProjectReaderTests-2057875875 None] Created reservations ['140ad90f-02f6-4818-884f-f8b53fb0af61', '1d11e702-d765-44bc-8b5c-31579636e11d', 'fbc742e1-32f4-45f1-9f7b-b657cb67cf2d', '3fa31ce8-3837-4e51-b336-968654c55dae'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:08:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-fd1636d8-61c7-4ea4-b801-25d89b6889f7 tempest-ProjectReaderTests-2057875875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-fd1636d8-61c7-4ea4-b801-25d89b6889f7 tempest-ProjectReaderTests-2057875875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:50 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-fd1636d8-61c7-4ea4-b801-25d89b6889f7 tempest-ProjectReaderTests-2057875875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:50 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-fd1636d8-61c7-4ea4-b801-25d89b6889f7 tempest-ProjectReaderTests-2057875875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-fd1636d8-61c7-4ea4-b801-25d89b6889f7 tempest-ProjectReaderTests-2057875875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fd1636d8-61c7-4ea4-b801-25d89b6889f7 tempest-ProjectReaderTests-2057875875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:50 devstack sudo[109683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:08:50 devstack sudo[109683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:50 devstack sudo[109683]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-fd1636d8-61c7-4ea4-b801-25d89b6889f7 tempest-ProjectReaderTests-2057875875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.272s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:50 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-fd1636d8-61c7-4ea4-b801-25d89b6889f7 tempest-ProjectReaderTests-2057875875 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:08:50 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-fd1636d8-61c7-4ea4-b801-25d89b6889f7 tempest-ProjectReaderTests-2057875875 None] Deleted volume successfully. Aug 10 13:08:50 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-fd1636d8-61c7-4ea4-b801-25d89b6889f7 tempest-ProjectReaderTests-2057875875 None] Lock "cinder-77639bb3-7dc4-4d3e-8ceb-94deb1b68f5a-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:51 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1871019-fd33-4df3-8826-99b2fab3cb32 tempest-ProjectReaderTests-2057875875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:08:51 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d1871019-fd33-4df3-8826-99b2fab3cb32 tempest-ProjectReaderTests-2057875875 None] Flow 'volume_create_manager' (0a3dd024-92cb-48fd-a383-26dd0763ba82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:08:51 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d1871019-fd33-4df3-8826-99b2fab3cb32 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a77fde9-b51b-453e-8a30-f9aca6b0ffcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:51 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d1871019-fd33-4df3-8826-99b2fab3cb32 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a77fde9-b51b-453e-8a30-f9aca6b0ffcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2090222024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7466d5e4-2e3d-4f23-ac40-a671250a79b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3939179bd0a6491894253cc6e502e7cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:08:51Z,use_quota=True,user_id='89c303066c944631b6118176ddeecbe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:51 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d1871019-fd33-4df3-8826-99b2fab3cb32 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b959062e-67e7-4da9-8f9c-9230bdd12a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:51 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d1871019-fd33-4df3-8826-99b2fab3cb32 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b959062e-67e7-4da9-8f9c-9230bdd12a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:51 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d1871019-fd33-4df3-8826-99b2fab3cb32 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c36b6d1f-48d3-45d8-9278-7d26ccb709e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:51 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d1871019-fd33-4df3-8826-99b2fab3cb32 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c36b6d1f-48d3-45d8-9278-7d26ccb709e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7466d5e4-2e3d-4f23-ac40-a671250a79b8', 'volume_name': 'volume-7466d5e4-2e3d-4f23-ac40-a671250a79b8', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:51 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d1871019-fd33-4df3-8826-99b2fab3cb32 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51a04676-1d15-46e4-9205-20bd12ec4ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:51 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d1871019-fd33-4df3-8826-99b2fab3cb32 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51a04676-1d15-46e4-9205-20bd12ec4ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:51 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d1871019-fd33-4df3-8826-99b2fab3cb32 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (837b3bdd-73a7-4ab2-8ef3-1cc74e3c08b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:51 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-d1871019-fd33-4df3-8826-99b2fab3cb32 tempest-ProjectReaderTests-2057875875 None] Volume 7466d5e4-2e3d-4f23-ac40-a671250a79b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7466d5e4-2e3d-4f23-ac40-a671250a79b8', 'volume_size': 1} Aug 10 13:08:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d1871019-fd33-4df3-8826-99b2fab3cb32 tempest-ProjectReaderTests-2057875875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d1871019-fd33-4df3-8826-99b2fab3cb32 tempest-ProjectReaderTests-2057875875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:51 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-d1871019-fd33-4df3-8826-99b2fab3cb32 tempest-ProjectReaderTests-2057875875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2090222024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7466d5e4-2e3d-4f23-ac40-a671250a79b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3939179bd0a6491894253cc6e502e7cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:08:51Z,use_quota=True,user_id='89c303066c944631b6118176ddeecbe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:08:51 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-d1871019-fd33-4df3-8826-99b2fab3cb32 tempest-ProjectReaderTests-2057875875 None] Creating volume 7466d5e4-2e3d-4f23-ac40-a671250a79b8 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:08:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d1871019-fd33-4df3-8826-99b2fab3cb32 tempest-ProjectReaderTests-2057875875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d1871019-fd33-4df3-8826-99b2fab3cb32 tempest-ProjectReaderTests-2057875875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:51 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-d1871019-fd33-4df3-8826-99b2fab3cb32 tempest-ProjectReaderTests-2057875875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:51 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-d1871019-fd33-4df3-8826-99b2fab3cb32 tempest-ProjectReaderTests-2057875875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d1871019-fd33-4df3-8826-99b2fab3cb32 tempest-ProjectReaderTests-2057875875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:51 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-d1871019-fd33-4df3-8826-99b2fab3cb32 tempest-ProjectReaderTests-2057875875 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:08:51 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-d1871019-fd33-4df3-8826-99b2fab3cb32 tempest-ProjectReaderTests-2057875875 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:08:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d1871019-fd33-4df3-8826-99b2fab3cb32 tempest-ProjectReaderTests-2057875875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-7466d5e4-2e3d-4f23-ac40-a671250a79b8 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:51 devstack sudo[109686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-7466d5e4-2e3d-4f23-ac40-a671250a79b8 1073741824 Aug 10 13:08:51 devstack sudo[109686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-dff74eaa-bc40-42e2-89aa-4b19c43bfec4 tempest-ProjectReaderTests-1094401723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:51 devstack sudo[109686]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d1871019-fd33-4df3-8826-99b2fab3cb32 tempest-ProjectReaderTests-2057875875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-7466d5e4-2e3d-4f23-ac40-a671250a79b8 1073741824" returned: 0 in 0.494s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d1871019-fd33-4df3-8826-99b2fab3cb32 tempest-ProjectReaderTests-2057875875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-7466d5e4-2e3d-4f23-ac40-a671250a79b8 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:51 devstack sudo[109693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-7466d5e4-2e3d-4f23-ac40-a671250a79b8 Aug 10 13:08:51 devstack sudo[109693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:52 devstack sudo[109693]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-d1871019-fd33-4df3-8826-99b2fab3cb32 tempest-ProjectReaderTests-2057875875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-7466d5e4-2e3d-4f23-ac40-a671250a79b8" returned: 0 in 0.258s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:52 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-d1871019-fd33-4df3-8826-99b2fab3cb32 tempest-ProjectReaderTests-2057875875 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:08:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-d1871019-fd33-4df3-8826-99b2fab3cb32 tempest-ProjectReaderTests-2057875875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-dff74eaa-bc40-42e2-89aa-4b19c43bfec4 tempest-ProjectReaderTests-1094401723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.682s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d1871019-fd33-4df3-8826-99b2fab3cb32 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (837b3bdd-73a7-4ab2-8ef3-1cc74e3c08b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7466d5e4-2e3d-4f23-ac40-a671250a79b8', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d1871019-fd33-4df3-8826-99b2fab3cb32 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fc838bd-c73a-4b45-b349-6d7f52b9ed7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:52 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-dff74eaa-bc40-42e2-89aa-4b19c43bfec4 tempest-ProjectReaderTests-1094401723 None] Creating offline snapshot 45fc455d-9010-459e-86b3-eaa8c100af89 of volume 25c7243f-c929-48e5-a9f1-e08a1694f18b {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 13:08:52 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-d1871019-fd33-4df3-8826-99b2fab3cb32 tempest-ProjectReaderTests-2057875875 None] Volume volume-7466d5e4-2e3d-4f23-ac40-a671250a79b8 (7466d5e4-2e3d-4f23-ac40-a671250a79b8): created successfully Aug 10 13:08:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d1871019-fd33-4df3-8826-99b2fab3cb32 tempest-ProjectReaderTests-2057875875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fc838bd-c73a-4b45-b349-6d7f52b9ed7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-d1871019-fd33-4df3-8826-99b2fab3cb32 tempest-ProjectReaderTests-2057875875 None] Flow 'volume_create_manager' (0a3dd024-92cb-48fd-a383-26dd0763ba82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:08:52 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c090bdb9-fc23-42e6-8515-847438ddf6bd]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dff74eaa-bc40-42e2-89aa-4b19c43bfec4 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:52 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-d1871019-fd33-4df3-8826-99b2fab3cb32 tempest-ProjectReaderTests-2057875875 None] Created volume successfully. Aug 10 13:08:52 devstack sudo[109696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b Aug 10 13:08:52 devstack sudo[109696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:52 devstack sudo[109696]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dff74eaa-bc40-42e2-89aa-4b19c43bfec4 tempest-ProjectReaderTests-1094401723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b" returned: 0 in 0.365s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dff74eaa-bc40-42e2-89aa-4b19c43bfec4 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b.45fc455d-9010-459e-86b3-eaa8c100af89 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:52 devstack sudo[109701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b.45fc455d-9010-459e-86b3-eaa8c100af89 1G Aug 10 13:08:52 devstack sudo[109701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:52 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-60c258a6-d478-4406-8825-6104ff367986 tempest-ProjectMemberTests-1235695716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:08:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-60c258a6-d478-4406-8825-6104ff367986 tempest-ProjectMemberTests-1235695716 None] Flow 'volume_create_manager' (074d1301-c5e0-4cc4-b59e-6c3151bc6ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:08:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-60c258a6-d478-4406-8825-6104ff367986 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1efc4ec4-a3f0-4bff-ad54-7ae0d38dfddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-60c258a6-d478-4406-8825-6104ff367986 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1efc4ec4-a3f0-4bff-ad54-7ae0d38dfddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1046955166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93d4d056-cb6c-4929-b806-ad9689a87f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d23cdd2ebbe54bcca19b58803c9db992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:08:53Z,use_quota=True,user_id='ecda3994ec61480e95cadb77fda1aac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-60c258a6-d478-4406-8825-6104ff367986 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c529d90-9095-42ca-8499-01a5c5375e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-60c258a6-d478-4406-8825-6104ff367986 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c529d90-9095-42ca-8499-01a5c5375e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:52 devstack sudo[109701]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-60c258a6-d478-4406-8825-6104ff367986 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d1c5f7-d4e4-4a00-b879-a0c316b1d283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-60c258a6-d478-4406-8825-6104ff367986 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d1c5f7-d4e4-4a00-b879-a0c316b1d283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93d4d056-cb6c-4929-b806-ad9689a87f8c', 'volume_name': 'volume-93d4d056-cb6c-4929-b806-ad9689a87f8c', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-60c258a6-d478-4406-8825-6104ff367986 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (963d7802-5ee4-48c0-a124-9652ed12c2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-60c258a6-d478-4406-8825-6104ff367986 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (963d7802-5ee4-48c0-a124-9652ed12c2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-60c258a6-d478-4406-8825-6104ff367986 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f9d481-4d39-4c83-80d3-15c9f82fc2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:52 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-60c258a6-d478-4406-8825-6104ff367986 tempest-ProjectMemberTests-1235695716 None] Volume 93d4d056-cb6c-4929-b806-ad9689a87f8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93d4d056-cb6c-4929-b806-ad9689a87f8c', 'volume_size': 1} Aug 10 13:08:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-60c258a6-d478-4406-8825-6104ff367986 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dff74eaa-bc40-42e2-89aa-4b19c43bfec4 tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b.45fc455d-9010-459e-86b3-eaa8c100af89 1G" returned: 0 in 0.458s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dff74eaa-bc40-42e2-89aa-4b19c43bfec4 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25c7243f-c929-48e5-a9f1-e08a1694f18b -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b.45fc455d-9010-459e-86b3-eaa8c100af89 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:53 devstack sudo[109707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25c7243f-c929-48e5-a9f1-e08a1694f18b -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b.45fc455d-9010-459e-86b3-eaa8c100af89 Aug 10 13:08:53 devstack sudo[109707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:53 devstack sudo[109707]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:53 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5352abe4-ca95-454a-91c2-1f84189e9b43 tempest-ProjectReaderTests-2057875875 None] Acquiring lock "cinder-7466d5e4-2e3d-4f23-ac40-a671250a79b8-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dff74eaa-bc40-42e2-89aa-4b19c43bfec4 tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25c7243f-c929-48e5-a9f1-e08a1694f18b -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b.45fc455d-9010-459e-86b3-eaa8c100af89" returned: 0 in 0.297s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:53 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-dff74eaa-bc40-42e2-89aa-4b19c43bfec4 tempest-ProjectReaderTests-1094401723 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b.45fc455d-9010-459e-86b3-eaa8c100af89 is being set with open permissions: ugo+rw Aug 10 13:08:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dff74eaa-bc40-42e2-89aa-4b19c43bfec4 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b.45fc455d-9010-459e-86b3-eaa8c100af89 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:53 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5352abe4-ca95-454a-91c2-1f84189e9b43 tempest-ProjectReaderTests-2057875875 None] Lock "cinder-7466d5e4-2e3d-4f23-ac40-a671250a79b8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:53 devstack sudo[109712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b.45fc455d-9010-459e-86b3-eaa8c100af89 Aug 10 13:08:53 devstack sudo[109712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:53 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5352abe4-ca95-454a-91c2-1f84189e9b43 tempest-ProjectReaderTests-2057875875 None] Acquiring lock "cinder-quobyte-7466d5e4-2e3d-4f23-ac40-a671250a79b8" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:53 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5352abe4-ca95-454a-91c2-1f84189e9b43 tempest-ProjectReaderTests-2057875875 None] Lock "cinder-quobyte-7466d5e4-2e3d-4f23-ac40-a671250a79b8" acquired by "delete_volume" :: waited 0.024s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:53 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cb22d7-6db4-4235-ac34-6228597ee8dd]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5352abe4-ca95-454a-91c2-1f84189e9b43 tempest-ProjectReaderTests-2057875875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-7466d5e4-2e3d-4f23-ac40-a671250a79b8 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:53 devstack sudo[109714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-7466d5e4-2e3d-4f23-ac40-a671250a79b8 Aug 10 13:08:53 devstack sudo[109714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:53 devstack sudo[109712]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dff74eaa-bc40-42e2-89aa-4b19c43bfec4 tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b.45fc455d-9010-459e-86b3-eaa8c100af89" returned: 0 in 0.257s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dff74eaa-bc40-42e2-89aa-4b19c43bfec4 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:53 devstack sudo[109717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b.info Aug 10 13:08:53 devstack sudo[109717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:53 devstack sudo[109714]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5352abe4-ca95-454a-91c2-1f84189e9b43 tempest-ProjectReaderTests-2057875875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-7466d5e4-2e3d-4f23-ac40-a671250a79b8" returned: 0 in 0.404s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5352abe4-ca95-454a-91c2-1f84189e9b43 tempest-ProjectReaderTests-2057875875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-7466d5e4-2e3d-4f23-ac40-a671250a79b8 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:53 devstack sudo[109717]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dff74eaa-bc40-42e2-89aa-4b19c43bfec4 tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b.info" returned: 0 in 0.265s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:53 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-dff74eaa-bc40-42e2-89aa-4b19c43bfec4 tempest-ProjectReaderTests-1094401723 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b.info is being set with open permissions: ugo+rw Aug 10 13:08:53 devstack sudo[109723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-7466d5e4-2e3d-4f23-ac40-a671250a79b8 Aug 10 13:08:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dff74eaa-bc40-42e2-89aa-4b19c43bfec4 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:53 devstack sudo[109723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:53 devstack sudo[109725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b.info Aug 10 13:08:53 devstack sudo[109725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:54 devstack sudo[109723]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5352abe4-ca95-454a-91c2-1f84189e9b43 tempest-ProjectReaderTests-2057875875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-7466d5e4-2e3d-4f23-ac40-a671250a79b8" returned: 0 in 0.264s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:54 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5352abe4-ca95-454a-91c2-1f84189e9b43 tempest-ProjectReaderTests-2057875875 None] Lock "cinder-quobyte-7466d5e4-2e3d-4f23-ac40-a671250a79b8" released by "delete_volume" :: held 0.713s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:54 devstack sudo[109725]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dff74eaa-bc40-42e2-89aa-4b19c43bfec4 tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b.info" returned: 0 in 0.261s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-dff74eaa-bc40-42e2-89aa-4b19c43bfec4 tempest-ProjectReaderTests-1094401723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.014s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-60c258a6-d478-4406-8825-6104ff367986 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.141s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-60c258a6-d478-4406-8825-6104ff367986 tempest-ProjectMemberTests-1235695716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1046955166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93d4d056-cb6c-4929-b806-ad9689a87f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d23cdd2ebbe54bcca19b58803c9db992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:08:53Z,use_quota=True,user_id='ecda3994ec61480e95cadb77fda1aac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:08:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-60c258a6-d478-4406-8825-6104ff367986 tempest-ProjectMemberTests-1235695716 None] Creating volume 93d4d056-cb6c-4929-b806-ad9689a87f8c {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:08:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-60c258a6-d478-4406-8825-6104ff367986 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-60c258a6-d478-4406-8825-6104ff367986 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-60c258a6-d478-4406-8825-6104ff367986 tempest-ProjectMemberTests-1235695716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-60c258a6-d478-4406-8825-6104ff367986 tempest-ProjectMemberTests-1235695716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-60c258a6-d478-4406-8825-6104ff367986 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-60c258a6-d478-4406-8825-6104ff367986 tempest-ProjectMemberTests-1235695716 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:08:54 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-60c258a6-d478-4406-8825-6104ff367986 tempest-ProjectMemberTests-1235695716 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:08:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-60c258a6-d478-4406-8825-6104ff367986 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:54 devstack sudo[109729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c 1073741824 Aug 10 13:08:54 devstack sudo[109729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:54 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-dff74eaa-bc40-42e2-89aa-4b19c43bfec4 tempest-ProjectReaderTests-1094401723 None] Create snapshot completed successfully Aug 10 13:08:54 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-5352abe4-ca95-454a-91c2-1f84189e9b43 tempest-ProjectReaderTests-2057875875 None] Created reservations ['6c28cede-6519-4c87-9799-e0be5ddb5d65', '7d12ffa8-a609-4778-acac-8937fd7031aa', '8d831b1b-d294-47c7-9147-18b1e3bcc25e', '047ee747-8940-4954-8dfc-4ad07b723ea0'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:08:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5352abe4-ca95-454a-91c2-1f84189e9b43 tempest-ProjectReaderTests-2057875875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5352abe4-ca95-454a-91c2-1f84189e9b43 tempest-ProjectReaderTests-2057875875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-5352abe4-ca95-454a-91c2-1f84189e9b43 tempest-ProjectReaderTests-2057875875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-5352abe4-ca95-454a-91c2-1f84189e9b43 tempest-ProjectReaderTests-2057875875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5352abe4-ca95-454a-91c2-1f84189e9b43 tempest-ProjectReaderTests-2057875875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5352abe4-ca95-454a-91c2-1f84189e9b43 tempest-ProjectReaderTests-2057875875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:54 devstack sudo[109731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:08:54 devstack sudo[109731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:54 devstack sudo[109731]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5352abe4-ca95-454a-91c2-1f84189e9b43 tempest-ProjectReaderTests-2057875875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.279s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:54 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-5352abe4-ca95-454a-91c2-1f84189e9b43 tempest-ProjectReaderTests-2057875875 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:08:54 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-5352abe4-ca95-454a-91c2-1f84189e9b43 tempest-ProjectReaderTests-2057875875 None] Deleted volume successfully. Aug 10 13:08:54 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5352abe4-ca95-454a-91c2-1f84189e9b43 tempest-ProjectReaderTests-2057875875 None] Lock "cinder-7466d5e4-2e3d-4f23-ac40-a671250a79b8-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:54 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b587f575-79cc-4e7a-8089-27a330740a18 tempest-ProjectReaderTests-1094401723 None] Acquiring lock "cinder-45fc455d-9010-459e-86b3-eaa8c100af89-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:54 devstack sudo[109729]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-60c258a6-d478-4406-8825-6104ff367986 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c 1073741824" returned: 0 in 0.534s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:54 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b587f575-79cc-4e7a-8089-27a330740a18 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-45fc455d-9010-459e-86b3-eaa8c100af89-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:54 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b587f575-79cc-4e7a-8089-27a330740a18 tempest-ProjectReaderTests-1094401723 None] Acquiring lock "cinder-quobyte-25c7243f-c929-48e5-a9f1-e08a1694f18b" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:54 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b587f575-79cc-4e7a-8089-27a330740a18 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-quobyte-25c7243f-c929-48e5-a9f1-e08a1694f18b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:54 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b587f575-79cc-4e7a-8089-27a330740a18 tempest-ProjectReaderTests-1094401723 None] Acquiring lock "cinder-quobyte-45fc455d-9010-459e-86b3-eaa8c100af89" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:54 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b587f575-79cc-4e7a-8089-27a330740a18 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-quobyte-45fc455d-9010-459e-86b3-eaa8c100af89" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-b587f575-79cc-4e7a-8089-27a330740a18 tempest-ProjectReaderTests-1094401723 None] Deleting offline snapshot 45fc455d-9010-459e-86b3-eaa8c100af89 of volume 25c7243f-c929-48e5-a9f1-e08a1694f18b {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 13:08:54 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-b587f575-79cc-4e7a-8089-27a330740a18 tempest-ProjectReaderTests-1094401723 None] snapshot_file for this snap is: volume-25c7243f-c929-48e5-a9f1-e08a1694f18b.45fc455d-9010-459e-86b3-eaa8c100af89 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 13:08:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-60c258a6-d478-4406-8825-6104ff367986 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:54 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[0595eb1a-9ec9-465b-a909-a44e9759f439]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:54 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b587f575-79cc-4e7a-8089-27a330740a18 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b.45fc455d-9010-459e-86b3-eaa8c100af89 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:54 devstack sudo[109738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c Aug 10 13:08:54 devstack sudo[109738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:54 devstack sudo[109739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b.45fc455d-9010-459e-86b3-eaa8c100af89 Aug 10 13:08:54 devstack sudo[109739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:55 devstack sudo[109738]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-60c258a6-d478-4406-8825-6104ff367986 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c" returned: 0 in 0.262s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:55 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-60c258a6-d478-4406-8825-6104ff367986 tempest-ProjectMemberTests-1235695716 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:08:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-60c258a6-d478-4406-8825-6104ff367986 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:55 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-60c258a6-d478-4406-8825-6104ff367986 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f9d481-4d39-4c83-80d3-15c9f82fc2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93d4d056-cb6c-4929-b806-ad9689a87f8c', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:55 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-60c258a6-d478-4406-8825-6104ff367986 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f498d1a-eeda-4d95-b3c6-bd123f892bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:55 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-60c258a6-d478-4406-8825-6104ff367986 tempest-ProjectMemberTests-1235695716 None] Volume volume-93d4d056-cb6c-4929-b806-ad9689a87f8c (93d4d056-cb6c-4929-b806-ad9689a87f8c): created successfully Aug 10 13:08:55 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-60c258a6-d478-4406-8825-6104ff367986 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f498d1a-eeda-4d95-b3c6-bd123f892bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:55 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-60c258a6-d478-4406-8825-6104ff367986 tempest-ProjectMemberTests-1235695716 None] Flow 'volume_create_manager' (074d1301-c5e0-4cc4-b59e-6c3151bc6ef6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:08:55 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-60c258a6-d478-4406-8825-6104ff367986 tempest-ProjectMemberTests-1235695716 None] Created volume successfully. Aug 10 13:08:55 devstack sudo[109739]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b587f575-79cc-4e7a-8089-27a330740a18 tempest-ProjectReaderTests-1094401723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b.45fc455d-9010-459e-86b3-eaa8c100af89" returned: 0 in 0.397s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:55 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-b587f575-79cc-4e7a-8089-27a330740a18 tempest-ProjectReaderTests-1094401723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25c7243f-c929-48e5-a9f1-e08a1694f18b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 13:08:55 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[41275613-e235-49d3-a278-6328c9a9a6fc]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b587f575-79cc-4e7a-8089-27a330740a18 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:55 devstack sudo[109747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b Aug 10 13:08:55 devstack sudo[109747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:55 devstack sudo[109747]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b587f575-79cc-4e7a-8089-27a330740a18 tempest-ProjectReaderTests-1094401723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b" returned: 0 in 0.394s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b587f575-79cc-4e7a-8089-27a330740a18 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b.45fc455d-9010-459e-86b3-eaa8c100af89 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:55 devstack sudo[109753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b.45fc455d-9010-459e-86b3-eaa8c100af89 Aug 10 13:08:55 devstack sudo[109753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:55 devstack sudo[109753]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b587f575-79cc-4e7a-8089-27a330740a18 tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b.45fc455d-9010-459e-86b3-eaa8c100af89" returned: 0 in 0.382s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:55 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b587f575-79cc-4e7a-8089-27a330740a18 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b.45fc455d-9010-459e-86b3-eaa8c100af89 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:55 devstack sudo[109758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b.45fc455d-9010-459e-86b3-eaa8c100af89 Aug 10 13:08:55 devstack sudo[109758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:56 devstack sudo[109758]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-b587f575-79cc-4e7a-8089-27a330740a18 tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b.45fc455d-9010-459e-86b3-eaa8c100af89" returned: 0 in 0.262s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:56 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b587f575-79cc-4e7a-8089-27a330740a18 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-quobyte-45fc455d-9010-459e-86b3-eaa8c100af89" released by "_delete_snapshot" :: held 1.552s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:56 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b587f575-79cc-4e7a-8089-27a330740a18 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-quobyte-25c7243f-c929-48e5-a9f1-e08a1694f18b" released by "delete_snapshot" :: held 1.583s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:56 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-b587f575-79cc-4e7a-8089-27a330740a18 tempest-ProjectReaderTests-1094401723 None] Created reservations ['e7aae310-c179-4a43-af9d-d9f589cdad7b', '97d129bc-9306-42e5-b5ed-b93dfe11c5bd', '37a72222-8dcb-4ce9-ad85-6ce5b2c471aa', '9fd3c8d4-51b1-4162-8870-0c4689008c07'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:08:56 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-b587f575-79cc-4e7a-8089-27a330740a18 tempest-ProjectReaderTests-1094401723 None] Delete snapshot completed successfully. Aug 10 13:08:56 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-b587f575-79cc-4e7a-8089-27a330740a18 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-45fc455d-9010-459e-86b3-eaa8c100af89-delete_snapshot" released by "delete_snapshot" :: held 1.760s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9f8ee538-4382-4343-a5c6-df1cee92174e tempest-ProjectMemberTests-1235695716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9f8ee538-4382-4343-a5c6-df1cee92174e tempest-ProjectMemberTests-1235695716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:56 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-9f8ee538-4382-4343-a5c6-df1cee92174e tempest-ProjectMemberTests-1235695716 None] Creating offline snapshot 0d4fe701-d64b-4aae-b39e-dee4450b068c of volume 93d4d056-cb6c-4929-b806-ad9689a87f8c {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 13:08:56 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6a73ae-c63b-44ae-ba8e-8642bed470f9]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9f8ee538-4382-4343-a5c6-df1cee92174e tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:56 devstack sudo[109761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c Aug 10 13:08:56 devstack sudo[109761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:56 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7aa45cbf-0a8a-43b3-95dd-d77bd21902a8 tempest-ProjectReaderTests-1094401723 None] Acquiring lock "cinder-25c7243f-c929-48e5-a9f1-e08a1694f18b-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:56 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7aa45cbf-0a8a-43b3-95dd-d77bd21902a8 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-25c7243f-c929-48e5-a9f1-e08a1694f18b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:56 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7aa45cbf-0a8a-43b3-95dd-d77bd21902a8 tempest-ProjectReaderTests-1094401723 None] Acquiring lock "cinder-quobyte-25c7243f-c929-48e5-a9f1-e08a1694f18b" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:56 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7aa45cbf-0a8a-43b3-95dd-d77bd21902a8 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-quobyte-25c7243f-c929-48e5-a9f1-e08a1694f18b" acquired by "delete_volume" :: waited 0.017s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:56 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94221bf-5f1a-4894-b58f-8a454e79db5b]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:56 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7aa45cbf-0a8a-43b3-95dd-d77bd21902a8 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:57 devstack sudo[109761]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9f8ee538-4382-4343-a5c6-df1cee92174e tempest-ProjectMemberTests-1235695716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c" returned: 0 in 0.365s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9f8ee538-4382-4343-a5c6-df1cee92174e tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c.0d4fe701-d64b-4aae-b39e-dee4450b068c 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:57 devstack sudo[109763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b Aug 10 13:08:57 devstack sudo[109763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:57 devstack sudo[109767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c.0d4fe701-d64b-4aae-b39e-dee4450b068c 1G Aug 10 13:08:57 devstack sudo[109767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:57 devstack sudo[109763]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7aa45cbf-0a8a-43b3-95dd-d77bd21902a8 tempest-ProjectReaderTests-1094401723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b" returned: 0 in 0.369s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7aa45cbf-0a8a-43b3-95dd-d77bd21902a8 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:57 devstack sudo[109777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b Aug 10 13:08:57 devstack sudo[109777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:57 devstack sudo[109767]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9f8ee538-4382-4343-a5c6-df1cee92174e tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c.0d4fe701-d64b-4aae-b39e-dee4450b068c 1G" returned: 0 in 0.390s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9f8ee538-4382-4343-a5c6-df1cee92174e tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93d4d056-cb6c-4929-b806-ad9689a87f8c -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c.0d4fe701-d64b-4aae-b39e-dee4450b068c {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:57 devstack sudo[109780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93d4d056-cb6c-4929-b806-ad9689a87f8c -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c.0d4fe701-d64b-4aae-b39e-dee4450b068c Aug 10 13:08:57 devstack sudo[109780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:57 devstack sudo[109777]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7aa45cbf-0a8a-43b3-95dd-d77bd21902a8 tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-25c7243f-c929-48e5-a9f1-e08a1694f18b" returned: 0 in 0.246s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:57 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7aa45cbf-0a8a-43b3-95dd-d77bd21902a8 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-quobyte-25c7243f-c929-48e5-a9f1-e08a1694f18b" released by "delete_volume" :: held 0.669s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:57 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-7aa45cbf-0a8a-43b3-95dd-d77bd21902a8 tempest-ProjectReaderTests-1094401723 None] Created reservations ['707e41c0-3655-4ff4-9cc7-ee1e97e98750', '80ac14d1-8aba-4aee-914c-c1af2cc2f66c', '54ae66db-a1ef-43a6-a583-1962d2938dc9', '237a2be9-aefc-404f-9866-730d7c40eb35'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:08:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7aa45cbf-0a8a-43b3-95dd-d77bd21902a8 tempest-ProjectReaderTests-1094401723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7aa45cbf-0a8a-43b3-95dd-d77bd21902a8 tempest-ProjectReaderTests-1094401723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:57 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-7aa45cbf-0a8a-43b3-95dd-d77bd21902a8 tempest-ProjectReaderTests-1094401723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:57 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-7aa45cbf-0a8a-43b3-95dd-d77bd21902a8 tempest-ProjectReaderTests-1094401723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7aa45cbf-0a8a-43b3-95dd-d77bd21902a8 tempest-ProjectReaderTests-1094401723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7aa45cbf-0a8a-43b3-95dd-d77bd21902a8 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:57 devstack sudo[109787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:08:57 devstack sudo[109787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:57 devstack sudo[109780]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9f8ee538-4382-4343-a5c6-df1cee92174e tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93d4d056-cb6c-4929-b806-ad9689a87f8c -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c.0d4fe701-d64b-4aae-b39e-dee4450b068c" returned: 0 in 0.340s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:57 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-9f8ee538-4382-4343-a5c6-df1cee92174e tempest-ProjectMemberTests-1235695716 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c.0d4fe701-d64b-4aae-b39e-dee4450b068c is being set with open permissions: ugo+rw Aug 10 13:08:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9f8ee538-4382-4343-a5c6-df1cee92174e tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c.0d4fe701-d64b-4aae-b39e-dee4450b068c {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:57 devstack sudo[109789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c.0d4fe701-d64b-4aae-b39e-dee4450b068c Aug 10 13:08:57 devstack sudo[109789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:57 devstack sudo[109787]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7aa45cbf-0a8a-43b3-95dd-d77bd21902a8 tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.275s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:57 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-7aa45cbf-0a8a-43b3-95dd-d77bd21902a8 tempest-ProjectReaderTests-1094401723 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:08:58 devstack sudo[109789]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:58 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-7aa45cbf-0a8a-43b3-95dd-d77bd21902a8 tempest-ProjectReaderTests-1094401723 None] Deleted volume successfully. Aug 10 13:08:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9f8ee538-4382-4343-a5c6-df1cee92174e tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c.0d4fe701-d64b-4aae-b39e-dee4450b068c" returned: 0 in 0.250s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:58 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7aa45cbf-0a8a-43b3-95dd-d77bd21902a8 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-25c7243f-c929-48e5-a9f1-e08a1694f18b-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:08:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9f8ee538-4382-4343-a5c6-df1cee92174e tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:58 devstack sudo[109793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c.info Aug 10 13:08:58 devstack sudo[109793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:58 devstack sudo[109793]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9f8ee538-4382-4343-a5c6-df1cee92174e tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c.info" returned: 0 in 0.297s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:58 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-9f8ee538-4382-4343-a5c6-df1cee92174e tempest-ProjectMemberTests-1235695716 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c.info is being set with open permissions: ugo+rw Aug 10 13:08:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9f8ee538-4382-4343-a5c6-df1cee92174e tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:58 devstack sudo[109796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c.info Aug 10 13:08:58 devstack sudo[109796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:58 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-e589cab8-6e01-458e-8839-3186aae69832 tempest-ProjectReaderTests-1094401723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:08:58 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e589cab8-6e01-458e-8839-3186aae69832 tempest-ProjectReaderTests-1094401723 None] Flow 'volume_create_manager' (3615be8d-d35d-4d4e-965d-ac2d1f449c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:08:58 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e589cab8-6e01-458e-8839-3186aae69832 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd85fe43-e7d0-4685-b405-3ab6c90b1e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:58 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e589cab8-6e01-458e-8839-3186aae69832 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd85fe43-e7d0-4685-b405-3ab6c90b1e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1293107306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51753f94-c503-41e4-8c66-491892f6688e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3fbef4ea4b40c2b96647d90e846ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:08:58Z,use_quota=True,user_id='4d8ab61bc38544b882b64c5a57855803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:58 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e589cab8-6e01-458e-8839-3186aae69832 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (695c7006-35d1-4f40-90ca-db2a8217fc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:58 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e589cab8-6e01-458e-8839-3186aae69832 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (695c7006-35d1-4f40-90ca-db2a8217fc8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:58 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e589cab8-6e01-458e-8839-3186aae69832 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34e88328-2dc9-4080-8412-637da0ea3f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:58 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e589cab8-6e01-458e-8839-3186aae69832 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34e88328-2dc9-4080-8412-637da0ea3f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51753f94-c503-41e4-8c66-491892f6688e', 'volume_name': 'volume-51753f94-c503-41e4-8c66-491892f6688e', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:58 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e589cab8-6e01-458e-8839-3186aae69832 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ae9ac6f-9c3e-4a47-997a-6b18a9a62c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:58 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e589cab8-6e01-458e-8839-3186aae69832 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ae9ac6f-9c3e-4a47-997a-6b18a9a62c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:58 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e589cab8-6e01-458e-8839-3186aae69832 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02492ce1-ad1b-465f-a4c8-d86d20c6f70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:58 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-e589cab8-6e01-458e-8839-3186aae69832 tempest-ProjectReaderTests-1094401723 None] Volume 51753f94-c503-41e4-8c66-491892f6688e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51753f94-c503-41e4-8c66-491892f6688e', 'volume_size': 1} Aug 10 13:08:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e589cab8-6e01-458e-8839-3186aae69832 tempest-ProjectReaderTests-1094401723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:58 devstack sudo[109796]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9f8ee538-4382-4343-a5c6-df1cee92174e tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c.info" returned: 0 in 0.259s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9f8ee538-4382-4343-a5c6-df1cee92174e tempest-ProjectMemberTests-1235695716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.997s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e589cab8-6e01-458e-8839-3186aae69832 tempest-ProjectReaderTests-1094401723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.084s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:58 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e589cab8-6e01-458e-8839-3186aae69832 tempest-ProjectReaderTests-1094401723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1293107306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51753f94-c503-41e4-8c66-491892f6688e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3fbef4ea4b40c2b96647d90e846ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:08:58Z,use_quota=True,user_id='4d8ab61bc38544b882b64c5a57855803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:08:58 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-e589cab8-6e01-458e-8839-3186aae69832 tempest-ProjectReaderTests-1094401723 None] Creating volume 51753f94-c503-41e4-8c66-491892f6688e {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:08:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e589cab8-6e01-458e-8839-3186aae69832 tempest-ProjectReaderTests-1094401723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:08:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e589cab8-6e01-458e-8839-3186aae69832 tempest-ProjectReaderTests-1094401723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:08:58 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e589cab8-6e01-458e-8839-3186aae69832 tempest-ProjectReaderTests-1094401723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:08:58 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e589cab8-6e01-458e-8839-3186aae69832 tempest-ProjectReaderTests-1094401723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:08:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e589cab8-6e01-458e-8839-3186aae69832 tempest-ProjectReaderTests-1094401723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:58 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e589cab8-6e01-458e-8839-3186aae69832 tempest-ProjectReaderTests-1094401723 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:08:58 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-e589cab8-6e01-458e-8839-3186aae69832 tempest-ProjectReaderTests-1094401723 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:08:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e589cab8-6e01-458e-8839-3186aae69832 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:58 devstack sudo[109800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e 1073741824 Aug 10 13:08:58 devstack sudo[109800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:58 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-9f8ee538-4382-4343-a5c6-df1cee92174e tempest-ProjectMemberTests-1235695716 None] Create snapshot completed successfully Aug 10 13:08:58 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-701d9711-9af6-4bd9-afdc-b24d33d399d1 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-0d4fe701-d64b-4aae-b39e-dee4450b068c-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:58 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-701d9711-9af6-4bd9-afdc-b24d33d399d1 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-0d4fe701-d64b-4aae-b39e-dee4450b068c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:58 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-701d9711-9af6-4bd9-afdc-b24d33d399d1 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-quobyte-93d4d056-cb6c-4929-b806-ad9689a87f8c" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:58 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-701d9711-9af6-4bd9-afdc-b24d33d399d1 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-93d4d056-cb6c-4929-b806-ad9689a87f8c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:58 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-701d9711-9af6-4bd9-afdc-b24d33d399d1 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-quobyte-0d4fe701-d64b-4aae-b39e-dee4450b068c" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:08:58 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-701d9711-9af6-4bd9-afdc-b24d33d399d1 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-0d4fe701-d64b-4aae-b39e-dee4450b068c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:08:58 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-701d9711-9af6-4bd9-afdc-b24d33d399d1 tempest-ProjectMemberTests-1235695716 None] Deleting offline snapshot 0d4fe701-d64b-4aae-b39e-dee4450b068c of volume 93d4d056-cb6c-4929-b806-ad9689a87f8c {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 13:08:58 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-701d9711-9af6-4bd9-afdc-b24d33d399d1 tempest-ProjectMemberTests-1235695716 None] snapshot_file for this snap is: volume-93d4d056-cb6c-4929-b806-ad9689a87f8c.0d4fe701-d64b-4aae-b39e-dee4450b068c {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 13:08:58 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e228c93-78b1-444d-b617-d891e008bad7]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-701d9711-9af6-4bd9-afdc-b24d33d399d1 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c.0d4fe701-d64b-4aae-b39e-dee4450b068c {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:58 devstack sudo[109802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c.0d4fe701-d64b-4aae-b39e-dee4450b068c Aug 10 13:08:58 devstack sudo[109802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:59 devstack sudo[109800]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e589cab8-6e01-458e-8839-3186aae69832 tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e 1073741824" returned: 0 in 0.430s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e589cab8-6e01-458e-8839-3186aae69832 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:59 devstack sudo[109808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e Aug 10 13:08:59 devstack sudo[109808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:59 devstack sudo[109802]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-701d9711-9af6-4bd9-afdc-b24d33d399d1 tempest-ProjectMemberTests-1235695716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c.0d4fe701-d64b-4aae-b39e-dee4450b068c" returned: 0 in 0.368s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-701d9711-9af6-4bd9-afdc-b24d33d399d1 tempest-ProjectMemberTests-1235695716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93d4d056-cb6c-4929-b806-ad9689a87f8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 13:08:59 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c990e61-4435-4c87-8758-d113eb7c2873]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:08:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-701d9711-9af6-4bd9-afdc-b24d33d399d1 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:59 devstack sudo[109813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c Aug 10 13:08:59 devstack sudo[109813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:59 devstack sudo[109808]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e589cab8-6e01-458e-8839-3186aae69832 tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e" returned: 0 in 0.258s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e589cab8-6e01-458e-8839-3186aae69832 tempest-ProjectReaderTests-1094401723 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:08:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e589cab8-6e01-458e-8839-3186aae69832 tempest-ProjectReaderTests-1094401723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:08:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e589cab8-6e01-458e-8839-3186aae69832 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02492ce1-ad1b-465f-a4c8-d86d20c6f70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51753f94-c503-41e4-8c66-491892f6688e', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e589cab8-6e01-458e-8839-3186aae69832 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51c3bf1e-4c69-4a3c-b62b-560a548600cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:08:59 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-e589cab8-6e01-458e-8839-3186aae69832 tempest-ProjectReaderTests-1094401723 None] Volume volume-51753f94-c503-41e4-8c66-491892f6688e (51753f94-c503-41e4-8c66-491892f6688e): created successfully Aug 10 13:08:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e589cab8-6e01-458e-8839-3186aae69832 tempest-ProjectReaderTests-1094401723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51c3bf1e-4c69-4a3c-b62b-560a548600cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:08:59 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e589cab8-6e01-458e-8839-3186aae69832 tempest-ProjectReaderTests-1094401723 None] Flow 'volume_create_manager' (3615be8d-d35d-4d4e-965d-ac2d1f449c8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:08:59 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-e589cab8-6e01-458e-8839-3186aae69832 tempest-ProjectReaderTests-1094401723 None] Created volume successfully. Aug 10 13:08:59 devstack sudo[109813]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-701d9711-9af6-4bd9-afdc-b24d33d399d1 tempest-ProjectMemberTests-1235695716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c" returned: 0 in 0.352s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-701d9711-9af6-4bd9-afdc-b24d33d399d1 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c.0d4fe701-d64b-4aae-b39e-dee4450b068c {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:59 devstack sudo[109820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c.0d4fe701-d64b-4aae-b39e-dee4450b068c Aug 10 13:08:59 devstack sudo[109820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:08:59 devstack sudo[109820]: pam_unix(sudo:session): session closed for user root Aug 10 13:08:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-701d9711-9af6-4bd9-afdc-b24d33d399d1 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c.0d4fe701-d64b-4aae-b39e-dee4450b068c" returned: 0 in 0.336s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:08:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-701d9711-9af6-4bd9-afdc-b24d33d399d1 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c.0d4fe701-d64b-4aae-b39e-dee4450b068c {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:08:59 devstack sudo[109825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c.0d4fe701-d64b-4aae-b39e-dee4450b068c Aug 10 13:08:59 devstack sudo[109825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:00 devstack sudo[109825]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-701d9711-9af6-4bd9-afdc-b24d33d399d1 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c.0d4fe701-d64b-4aae-b39e-dee4450b068c" returned: 0 in 0.237s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:00 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-701d9711-9af6-4bd9-afdc-b24d33d399d1 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-0d4fe701-d64b-4aae-b39e-dee4450b068c" released by "_delete_snapshot" :: held 1.388s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:00 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-701d9711-9af6-4bd9-afdc-b24d33d399d1 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-93d4d056-cb6c-4929-b806-ad9689a87f8c" released by "delete_snapshot" :: held 1.412s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:00 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-701d9711-9af6-4bd9-afdc-b24d33d399d1 tempest-ProjectMemberTests-1235695716 None] Created reservations ['79ecbb28-43ce-4107-9afd-9dd40728148f', 'd0fa426e-94f2-4c09-9bfb-a45a881bcd2a', '7bc553e1-14d0-4be0-aad2-1e6784b40ae0', 'e26dcb9b-236b-4d60-b6fa-c4634523683b'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:09:00 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-701d9711-9af6-4bd9-afdc-b24d33d399d1 tempest-ProjectMemberTests-1235695716 None] Delete snapshot completed successfully. Aug 10 13:09:00 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-701d9711-9af6-4bd9-afdc-b24d33d399d1 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-0d4fe701-d64b-4aae-b39e-dee4450b068c-delete_snapshot" released by "delete_snapshot" :: held 1.544s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-92d2e108-72e4-49f3-9307-9386d67fbd9a tempest-ProjectReaderTests-1094401723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:09:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-92d2e108-72e4-49f3-9307-9386d67fbd9a tempest-ProjectReaderTests-1094401723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:09:00 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-92d2e108-72e4-49f3-9307-9386d67fbd9a tempest-ProjectReaderTests-1094401723 None] Creating offline snapshot 621a3955-799a-4852-8693-2a2c89ba520e of volume 51753f94-c503-41e4-8c66-491892f6688e {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 13:09:00 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01339cb-7d04-4c2e-9aa8-1a16791817b4]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:09:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-92d2e108-72e4-49f3-9307-9386d67fbd9a tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:00 devstack sudo[109828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e Aug 10 13:09:00 devstack sudo[109828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:00 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-23c04772-ade4-4fc3-b1ac-94f71b8d2aff tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-93d4d056-cb6c-4929-b806-ad9689a87f8c-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:00 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-23c04772-ade4-4fc3-b1ac-94f71b8d2aff tempest-ProjectMemberTests-1235695716 None] Lock "cinder-93d4d056-cb6c-4929-b806-ad9689a87f8c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:00 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-23c04772-ade4-4fc3-b1ac-94f71b8d2aff tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-quobyte-93d4d056-cb6c-4929-b806-ad9689a87f8c" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:01 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-23c04772-ade4-4fc3-b1ac-94f71b8d2aff tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-93d4d056-cb6c-4929-b806-ad9689a87f8c" acquired by "delete_volume" :: waited 0.018s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:01 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9c449f-b463-4421-9e79-0834d76ad119]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:09:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-23c04772-ade4-4fc3-b1ac-94f71b8d2aff tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:01 devstack sudo[109828]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-92d2e108-72e4-49f3-9307-9386d67fbd9a tempest-ProjectReaderTests-1094401723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e" returned: 0 in 0.389s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-92d2e108-72e4-49f3-9307-9386d67fbd9a tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e.621a3955-799a-4852-8693-2a2c89ba520e 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:01 devstack sudo[109836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e.621a3955-799a-4852-8693-2a2c89ba520e 1G Aug 10 13:09:01 devstack sudo[109836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:01 devstack sudo[109834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c Aug 10 13:09:01 devstack sudo[109834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:01 devstack sudo[109834]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-23c04772-ade4-4fc3-b1ac-94f71b8d2aff tempest-ProjectMemberTests-1235695716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c" returned: 0 in 0.396s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-23c04772-ade4-4fc3-b1ac-94f71b8d2aff tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:01 devstack sudo[109845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c Aug 10 13:09:01 devstack sudo[109845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:01 devstack sudo[109836]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-92d2e108-72e4-49f3-9307-9386d67fbd9a tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e.621a3955-799a-4852-8693-2a2c89ba520e 1G" returned: 0 in 0.428s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-92d2e108-72e4-49f3-9307-9386d67fbd9a tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51753f94-c503-41e4-8c66-491892f6688e -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e.621a3955-799a-4852-8693-2a2c89ba520e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:01 devstack sudo[109847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51753f94-c503-41e4-8c66-491892f6688e -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e.621a3955-799a-4852-8693-2a2c89ba520e Aug 10 13:09:01 devstack sudo[109847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:01 devstack sudo[109845]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-23c04772-ade4-4fc3-b1ac-94f71b8d2aff tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-93d4d056-cb6c-4929-b806-ad9689a87f8c" returned: 0 in 0.256s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:01 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-23c04772-ade4-4fc3-b1ac-94f71b8d2aff tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-93d4d056-cb6c-4929-b806-ad9689a87f8c" released by "delete_volume" :: held 0.715s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:01 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-23c04772-ade4-4fc3-b1ac-94f71b8d2aff tempest-ProjectMemberTests-1235695716 None] Created reservations ['a274260c-f874-443b-a9fa-1f7d94b94a12', '9359c2bb-ff99-4cf6-9b49-d32c1ee982bf', '2af79b0b-80fc-4891-8492-44a8866bfab1', 'f5c0c2af-7567-42fc-b9dc-0e84d5833de2'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:09:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-23c04772-ade4-4fc3-b1ac-94f71b8d2aff tempest-ProjectMemberTests-1235695716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:09:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-23c04772-ade4-4fc3-b1ac-94f71b8d2aff tempest-ProjectMemberTests-1235695716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:09:01 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-23c04772-ade4-4fc3-b1ac-94f71b8d2aff tempest-ProjectMemberTests-1235695716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:09:01 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-23c04772-ade4-4fc3-b1ac-94f71b8d2aff tempest-ProjectMemberTests-1235695716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:09:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-23c04772-ade4-4fc3-b1ac-94f71b8d2aff tempest-ProjectMemberTests-1235695716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:09:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-23c04772-ade4-4fc3-b1ac-94f71b8d2aff tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:01 devstack sudo[109853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:09:01 devstack sudo[109847]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:01 devstack sudo[109853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-92d2e108-72e4-49f3-9307-9386d67fbd9a tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51753f94-c503-41e4-8c66-491892f6688e -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e.621a3955-799a-4852-8693-2a2c89ba520e" returned: 0 in 0.324s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:01 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-92d2e108-72e4-49f3-9307-9386d67fbd9a tempest-ProjectReaderTests-1094401723 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e.621a3955-799a-4852-8693-2a2c89ba520e is being set with open permissions: ugo+rw Aug 10 13:09:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-92d2e108-72e4-49f3-9307-9386d67fbd9a tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e.621a3955-799a-4852-8693-2a2c89ba520e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:01 devstack sudo[109855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e.621a3955-799a-4852-8693-2a2c89ba520e Aug 10 13:09:01 devstack sudo[109855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:02 devstack sudo[109853]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-23c04772-ade4-4fc3-b1ac-94f71b8d2aff tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.256s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:02 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-23c04772-ade4-4fc3-b1ac-94f71b8d2aff tempest-ProjectMemberTests-1235695716 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:09:02 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-23c04772-ade4-4fc3-b1ac-94f71b8d2aff tempest-ProjectMemberTests-1235695716 None] Deleted volume successfully. Aug 10 13:09:02 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-23c04772-ade4-4fc3-b1ac-94f71b8d2aff tempest-ProjectMemberTests-1235695716 None] Lock "cinder-93d4d056-cb6c-4929-b806-ad9689a87f8c-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:02 devstack sudo[109855]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-92d2e108-72e4-49f3-9307-9386d67fbd9a tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e.621a3955-799a-4852-8693-2a2c89ba520e" returned: 0 in 0.266s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-92d2e108-72e4-49f3-9307-9386d67fbd9a tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:02 devstack sudo[109859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e.info Aug 10 13:09:02 devstack sudo[109859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:02 devstack sudo[109859]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-92d2e108-72e4-49f3-9307-9386d67fbd9a tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e.info" returned: 0 in 0.278s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:02 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-92d2e108-72e4-49f3-9307-9386d67fbd9a tempest-ProjectReaderTests-1094401723 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e.info is being set with open permissions: ugo+rw Aug 10 13:09:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-92d2e108-72e4-49f3-9307-9386d67fbd9a tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:02 devstack sudo[109862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e.info Aug 10 13:09:02 devstack sudo[109862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:02 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-2140c2ad-6c65-492d-8791-33af8d477016 tempest-ProjectMemberTests-1235695716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:09:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-2140c2ad-6c65-492d-8791-33af8d477016 tempest-ProjectMemberTests-1235695716 None] Flow 'volume_create_manager' (d14f05b5-f426-443c-bc16-e673ab3dd950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:09:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-2140c2ad-6c65-492d-8791-33af8d477016 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a06195ee-d107-4d19-bc87-45799bff5ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-2140c2ad-6c65-492d-8791-33af8d477016 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a06195ee-d107-4d19-bc87-45799bff5ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-836029986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1139d13c-106a-41e8-b09c-904577c7bc98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d23cdd2ebbe54bcca19b58803c9db992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:09:03Z,use_quota=True,user_id='ecda3994ec61480e95cadb77fda1aac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-2140c2ad-6c65-492d-8791-33af8d477016 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb566848-0b71-48c9-a338-00ed6a8430f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-2140c2ad-6c65-492d-8791-33af8d477016 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb566848-0b71-48c9-a338-00ed6a8430f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-2140c2ad-6c65-492d-8791-33af8d477016 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e9c3f00-7eac-4d05-b734-c17c99794051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-2140c2ad-6c65-492d-8791-33af8d477016 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e9c3f00-7eac-4d05-b734-c17c99794051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1139d13c-106a-41e8-b09c-904577c7bc98', 'volume_name': 'volume-1139d13c-106a-41e8-b09c-904577c7bc98', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-2140c2ad-6c65-492d-8791-33af8d477016 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a739a209-8543-4849-96f3-282ab8a62cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-2140c2ad-6c65-492d-8791-33af8d477016 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a739a209-8543-4849-96f3-282ab8a62cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:02 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-2140c2ad-6c65-492d-8791-33af8d477016 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ae32e1c-442a-4617-9e53-63d22a4e8d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:02 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-2140c2ad-6c65-492d-8791-33af8d477016 tempest-ProjectMemberTests-1235695716 None] Volume 1139d13c-106a-41e8-b09c-904577c7bc98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1139d13c-106a-41e8-b09c-904577c7bc98', 'volume_size': 1} Aug 10 13:09:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2140c2ad-6c65-492d-8791-33af8d477016 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:09:02 devstack sudo[109862]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-92d2e108-72e4-49f3-9307-9386d67fbd9a tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e.info" returned: 0 in 0.266s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-92d2e108-72e4-49f3-9307-9386d67fbd9a tempest-ProjectReaderTests-1094401723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.033s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:09:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2140c2ad-6c65-492d-8791-33af8d477016 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.111s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:09:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-2140c2ad-6c65-492d-8791-33af8d477016 tempest-ProjectMemberTests-1235695716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-836029986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1139d13c-106a-41e8-b09c-904577c7bc98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d23cdd2ebbe54bcca19b58803c9db992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:09:03Z,use_quota=True,user_id='ecda3994ec61480e95cadb77fda1aac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:09:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-2140c2ad-6c65-492d-8791-33af8d477016 tempest-ProjectMemberTests-1235695716 None] Creating volume 1139d13c-106a-41e8-b09c-904577c7bc98 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:09:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2140c2ad-6c65-492d-8791-33af8d477016 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:09:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2140c2ad-6c65-492d-8791-33af8d477016 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:09:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-2140c2ad-6c65-492d-8791-33af8d477016 tempest-ProjectMemberTests-1235695716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:09:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-2140c2ad-6c65-492d-8791-33af8d477016 tempest-ProjectMemberTests-1235695716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:09:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2140c2ad-6c65-492d-8791-33af8d477016 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:09:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-2140c2ad-6c65-492d-8791-33af8d477016 tempest-ProjectMemberTests-1235695716 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:09:02 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-2140c2ad-6c65-492d-8791-33af8d477016 tempest-ProjectMemberTests-1235695716 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:09:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2140c2ad-6c65-492d-8791-33af8d477016 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:02 devstack sudo[109865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98 1073741824 Aug 10 13:09:02 devstack sudo[109865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:02 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-92d2e108-72e4-49f3-9307-9386d67fbd9a tempest-ProjectReaderTests-1094401723 None] Create snapshot completed successfully Aug 10 13:09:03 devstack sudo[109865]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2140c2ad-6c65-492d-8791-33af8d477016 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98 1073741824" returned: 0 in 0.424s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2140c2ad-6c65-492d-8791-33af8d477016 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:03 devstack sudo[109871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98 Aug 10 13:09:03 devstack sudo[109871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:03 devstack sudo[109871]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2140c2ad-6c65-492d-8791-33af8d477016 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98" returned: 0 in 0.248s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-2140c2ad-6c65-492d-8791-33af8d477016 tempest-ProjectMemberTests-1235695716 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:09:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2140c2ad-6c65-492d-8791-33af8d477016 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:09:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-2140c2ad-6c65-492d-8791-33af8d477016 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ae32e1c-442a-4617-9e53-63d22a4e8d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1139d13c-106a-41e8-b09c-904577c7bc98', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-2140c2ad-6c65-492d-8791-33af8d477016 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45730850-019b-4902-9f6b-9a348c1e6016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:03 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-2140c2ad-6c65-492d-8791-33af8d477016 tempest-ProjectMemberTests-1235695716 None] Volume volume-1139d13c-106a-41e8-b09c-904577c7bc98 (1139d13c-106a-41e8-b09c-904577c7bc98): created successfully Aug 10 13:09:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-2140c2ad-6c65-492d-8791-33af8d477016 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45730850-019b-4902-9f6b-9a348c1e6016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:03 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-2140c2ad-6c65-492d-8791-33af8d477016 tempest-ProjectMemberTests-1235695716 None] Flow 'volume_create_manager' (d14f05b5-f426-443c-bc16-e673ab3dd950) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:09:03 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-2140c2ad-6c65-492d-8791-33af8d477016 tempest-ProjectMemberTests-1235695716 None] Created volume successfully. Aug 10 13:09:03 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5d2a907e-ae72-49cc-a712-1ed2f9cc7a80 tempest-ProjectReaderTests-1094401723 None] Acquiring lock "cinder-621a3955-799a-4852-8693-2a2c89ba520e-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:03 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5d2a907e-ae72-49cc-a712-1ed2f9cc7a80 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-621a3955-799a-4852-8693-2a2c89ba520e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:03 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5d2a907e-ae72-49cc-a712-1ed2f9cc7a80 tempest-ProjectReaderTests-1094401723 None] Acquiring lock "cinder-quobyte-51753f94-c503-41e4-8c66-491892f6688e" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:03 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5d2a907e-ae72-49cc-a712-1ed2f9cc7a80 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-quobyte-51753f94-c503-41e4-8c66-491892f6688e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:03 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5d2a907e-ae72-49cc-a712-1ed2f9cc7a80 tempest-ProjectReaderTests-1094401723 None] Acquiring lock "cinder-quobyte-621a3955-799a-4852-8693-2a2c89ba520e" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:03 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5d2a907e-ae72-49cc-a712-1ed2f9cc7a80 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-quobyte-621a3955-799a-4852-8693-2a2c89ba520e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-5d2a907e-ae72-49cc-a712-1ed2f9cc7a80 tempest-ProjectReaderTests-1094401723 None] Deleting offline snapshot 621a3955-799a-4852-8693-2a2c89ba520e of volume 51753f94-c503-41e4-8c66-491892f6688e {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 13:09:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-5d2a907e-ae72-49cc-a712-1ed2f9cc7a80 tempest-ProjectReaderTests-1094401723 None] snapshot_file for this snap is: volume-51753f94-c503-41e4-8c66-491892f6688e.621a3955-799a-4852-8693-2a2c89ba520e {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 13:09:03 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 13:09:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:09:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:09:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:09:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:09:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:09:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:03 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[418ff425-6fef-4731-9689-969821a7c4a5]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:09:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5d2a907e-ae72-49cc-a712-1ed2f9cc7a80 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e.621a3955-799a-4852-8693-2a2c89ba520e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:03 devstack sudo[109874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:09:03 devstack sudo[109874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:04 devstack sudo[109875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e.621a3955-799a-4852-8693-2a2c89ba520e Aug 10 13:09:04 devstack sudo[109875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:04 devstack sudo[109874]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.239s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:04 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:09:04 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager._thread_info {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 13:09:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread count: 28 {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 13:09:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread info: [<_MainThread(MainThread, started 130607683133568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Aug 10 13:09:04 devstack sudo[109875]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5d2a907e-ae72-49cc-a712-1ed2f9cc7a80 tempest-ProjectReaderTests-1094401723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e.621a3955-799a-4852-8693-2a2c89ba520e" returned: 0 in 0.369s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-5d2a907e-ae72-49cc-a712-1ed2f9cc7a80 tempest-ProjectReaderTests-1094401723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51753f94-c503-41e4-8c66-491892f6688e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 13:09:04 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fca6b4-881b-4a6c-baad-fc4642c12531]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:09:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5d2a907e-ae72-49cc-a712-1ed2f9cc7a80 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:04 devstack sudo[109882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e Aug 10 13:09:04 devstack sudo[109882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:04 devstack sudo[109882]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5d2a907e-ae72-49cc-a712-1ed2f9cc7a80 tempest-ProjectReaderTests-1094401723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e" returned: 0 in 0.395s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5d2a907e-ae72-49cc-a712-1ed2f9cc7a80 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e.621a3955-799a-4852-8693-2a2c89ba520e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:04 devstack sudo[109887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e.621a3955-799a-4852-8693-2a2c89ba520e Aug 10 13:09:04 devstack sudo[109887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7229d04d-d767-4483-b514-376b1d05d041 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:09:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7229d04d-d767-4483-b514-376b1d05d041 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:09:04 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-7229d04d-d767-4483-b514-376b1d05d041 tempest-ProjectMemberTests-1235695716 None] Creating offline snapshot 030bf296-5a37-4b4e-88ea-d3ec7a81582b of volume 1139d13c-106a-41e8-b09c-904577c7bc98 {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 13:09:04 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0309dfc-532f-49fa-a678-d02eb5402d9b]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:09:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7229d04d-d767-4483-b514-376b1d05d041 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:04 devstack sudo[109889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98 Aug 10 13:09:04 devstack sudo[109889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:05 devstack sudo[109887]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5d2a907e-ae72-49cc-a712-1ed2f9cc7a80 tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e.621a3955-799a-4852-8693-2a2c89ba520e" returned: 0 in 0.356s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5d2a907e-ae72-49cc-a712-1ed2f9cc7a80 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e.621a3955-799a-4852-8693-2a2c89ba520e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:05 devstack sudo[109894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e.621a3955-799a-4852-8693-2a2c89ba520e Aug 10 13:09:05 devstack sudo[109894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:05 devstack sudo[109889]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7229d04d-d767-4483-b514-376b1d05d041 tempest-ProjectMemberTests-1235695716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98" returned: 0 in 0.371s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7229d04d-d767-4483-b514-376b1d05d041 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98.030bf296-5a37-4b4e-88ea-d3ec7a81582b 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:05 devstack sudo[109899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98.030bf296-5a37-4b4e-88ea-d3ec7a81582b 1G Aug 10 13:09:05 devstack sudo[109899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:05 devstack sudo[109894]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5d2a907e-ae72-49cc-a712-1ed2f9cc7a80 tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e.621a3955-799a-4852-8693-2a2c89ba520e" returned: 0 in 0.252s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:05 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5d2a907e-ae72-49cc-a712-1ed2f9cc7a80 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-quobyte-621a3955-799a-4852-8693-2a2c89ba520e" released by "_delete_snapshot" :: held 1.479s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:05 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5d2a907e-ae72-49cc-a712-1ed2f9cc7a80 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-quobyte-51753f94-c503-41e4-8c66-491892f6688e" released by "delete_snapshot" :: held 1.500s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:05 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-5d2a907e-ae72-49cc-a712-1ed2f9cc7a80 tempest-ProjectReaderTests-1094401723 None] Created reservations ['d245b4b9-4dde-41ce-b2fe-e7eba0526422', 'd29d02bd-5b3f-4a26-bc18-45078f7e888f', '3980a94a-3766-476a-aefa-f94812fa2573', '731c8b87-3108-4739-b870-97c2bc435d49'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:09:05 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-5d2a907e-ae72-49cc-a712-1ed2f9cc7a80 tempest-ProjectReaderTests-1094401723 None] Delete snapshot completed successfully. Aug 10 13:09:05 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5d2a907e-ae72-49cc-a712-1ed2f9cc7a80 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-621a3955-799a-4852-8693-2a2c89ba520e-delete_snapshot" released by "delete_snapshot" :: held 1.655s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:05 devstack sudo[109899]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7229d04d-d767-4483-b514-376b1d05d041 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98.030bf296-5a37-4b4e-88ea-d3ec7a81582b 1G" returned: 0 in 0.438s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7229d04d-d767-4483-b514-376b1d05d041 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1139d13c-106a-41e8-b09c-904577c7bc98 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98.030bf296-5a37-4b4e-88ea-d3ec7a81582b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:05 devstack sudo[109907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1139d13c-106a-41e8-b09c-904577c7bc98 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98.030bf296-5a37-4b4e-88ea-d3ec7a81582b Aug 10 13:09:05 devstack sudo[109907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:05 devstack sudo[109907]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7229d04d-d767-4483-b514-376b1d05d041 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1139d13c-106a-41e8-b09c-904577c7bc98 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98.030bf296-5a37-4b4e-88ea-d3ec7a81582b" returned: 0 in 0.287s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:05 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-7229d04d-d767-4483-b514-376b1d05d041 tempest-ProjectMemberTests-1235695716 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98.030bf296-5a37-4b4e-88ea-d3ec7a81582b is being set with open permissions: ugo+rw Aug 10 13:09:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7229d04d-d767-4483-b514-376b1d05d041 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98.030bf296-5a37-4b4e-88ea-d3ec7a81582b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:05 devstack sudo[109912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98.030bf296-5a37-4b4e-88ea-d3ec7a81582b Aug 10 13:09:05 devstack sudo[109912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:06 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-6641c287-39ff-4ede-a15a-51d58dee6c72 tempest-ProjectReaderTests-1094401723 None] Acquiring lock "cinder-51753f94-c503-41e4-8c66-491892f6688e-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:06 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-6641c287-39ff-4ede-a15a-51d58dee6c72 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-51753f94-c503-41e4-8c66-491892f6688e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:06 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-6641c287-39ff-4ede-a15a-51d58dee6c72 tempest-ProjectReaderTests-1094401723 None] Acquiring lock "cinder-quobyte-51753f94-c503-41e4-8c66-491892f6688e" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:06 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-6641c287-39ff-4ede-a15a-51d58dee6c72 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-quobyte-51753f94-c503-41e4-8c66-491892f6688e" acquired by "delete_volume" :: waited 0.016s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:06 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff90c67a-8133-4e4e-933a-a39831efc4ed]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:09:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6641c287-39ff-4ede-a15a-51d58dee6c72 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:06 devstack sudo[109912]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7229d04d-d767-4483-b514-376b1d05d041 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98.030bf296-5a37-4b4e-88ea-d3ec7a81582b" returned: 0 in 0.264s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7229d04d-d767-4483-b514-376b1d05d041 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:06 devstack sudo[109916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98.info Aug 10 13:09:06 devstack sudo[109916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:06 devstack sudo[109915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e Aug 10 13:09:06 devstack sudo[109915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:06 devstack sudo[109916]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7229d04d-d767-4483-b514-376b1d05d041 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98.info" returned: 0 in 0.262s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:06 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-7229d04d-d767-4483-b514-376b1d05d041 tempest-ProjectMemberTests-1235695716 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98.info is being set with open permissions: ugo+rw Aug 10 13:09:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7229d04d-d767-4483-b514-376b1d05d041 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:06 devstack sudo[109923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98.info Aug 10 13:09:06 devstack sudo[109923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:06 devstack sudo[109915]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6641c287-39ff-4ede-a15a-51d58dee6c72 tempest-ProjectReaderTests-1094401723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e" returned: 0 in 0.374s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6641c287-39ff-4ede-a15a-51d58dee6c72 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:06 devstack sudo[109926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e Aug 10 13:09:06 devstack sudo[109926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:06 devstack sudo[109923]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7229d04d-d767-4483-b514-376b1d05d041 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98.info" returned: 0 in 0.263s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7229d04d-d767-4483-b514-376b1d05d041 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.977s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:09:06 devstack sudo[109926]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6641c287-39ff-4ede-a15a-51d58dee6c72 tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-51753f94-c503-41e4-8c66-491892f6688e" returned: 0 in 0.254s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:06 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-7229d04d-d767-4483-b514-376b1d05d041 tempest-ProjectMemberTests-1235695716 None] Create snapshot completed successfully Aug 10 13:09:06 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-6641c287-39ff-4ede-a15a-51d58dee6c72 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-quobyte-51753f94-c503-41e4-8c66-491892f6688e" released by "delete_volume" :: held 0.697s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:06 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-6641c287-39ff-4ede-a15a-51d58dee6c72 tempest-ProjectReaderTests-1094401723 None] Created reservations ['8704f72f-9700-4720-bd91-2825f9d35562', 'e1cb930d-88d7-412e-a2ee-fe32b67d1381', '22110630-dca2-43b1-8972-3ee7b78bf791', '22097193-5775-4305-90f2-01d6f5a556bb'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:09:06 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8a30558e-f79d-4888-bb8f-26197d15307b tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-030bf296-5a37-4b4e-88ea-d3ec7a81582b-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:06 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8a30558e-f79d-4888-bb8f-26197d15307b tempest-ProjectMemberTests-1235695716 None] Lock "cinder-030bf296-5a37-4b4e-88ea-d3ec7a81582b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:06 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8a30558e-f79d-4888-bb8f-26197d15307b tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-quobyte-1139d13c-106a-41e8-b09c-904577c7bc98" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:06 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8a30558e-f79d-4888-bb8f-26197d15307b tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-1139d13c-106a-41e8-b09c-904577c7bc98" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:06 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8a30558e-f79d-4888-bb8f-26197d15307b tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-quobyte-030bf296-5a37-4b4e-88ea-d3ec7a81582b" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:06 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8a30558e-f79d-4888-bb8f-26197d15307b tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-030bf296-5a37-4b4e-88ea-d3ec7a81582b" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:06 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-8a30558e-f79d-4888-bb8f-26197d15307b tempest-ProjectMemberTests-1235695716 None] Deleting offline snapshot 030bf296-5a37-4b4e-88ea-d3ec7a81582b of volume 1139d13c-106a-41e8-b09c-904577c7bc98 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 13:09:06 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-8a30558e-f79d-4888-bb8f-26197d15307b tempest-ProjectMemberTests-1235695716 None] snapshot_file for this snap is: volume-1139d13c-106a-41e8-b09c-904577c7bc98.030bf296-5a37-4b4e-88ea-d3ec7a81582b {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 13:09:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6641c287-39ff-4ede-a15a-51d58dee6c72 tempest-ProjectReaderTests-1094401723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:09:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6641c287-39ff-4ede-a15a-51d58dee6c72 tempest-ProjectReaderTests-1094401723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:09:06 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6641c287-39ff-4ede-a15a-51d58dee6c72 tempest-ProjectReaderTests-1094401723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:09:06 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-6641c287-39ff-4ede-a15a-51d58dee6c72 tempest-ProjectReaderTests-1094401723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:09:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-6641c287-39ff-4ede-a15a-51d58dee6c72 tempest-ProjectReaderTests-1094401723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:09:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6641c287-39ff-4ede-a15a-51d58dee6c72 tempest-ProjectReaderTests-1094401723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:06 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[501d76e9-86d0-4e0b-8014-4a2f128965a9]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:09:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8a30558e-f79d-4888-bb8f-26197d15307b tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98.030bf296-5a37-4b4e-88ea-d3ec7a81582b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:07 devstack sudo[109930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:09:07 devstack sudo[109930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:07 devstack sudo[109931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98.030bf296-5a37-4b4e-88ea-d3ec7a81582b Aug 10 13:09:07 devstack sudo[109931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:07 devstack sudo[109930]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-6641c287-39ff-4ede-a15a-51d58dee6c72 tempest-ProjectReaderTests-1094401723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.245s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:07 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-6641c287-39ff-4ede-a15a-51d58dee6c72 tempest-ProjectReaderTests-1094401723 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:09:07 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-6641c287-39ff-4ede-a15a-51d58dee6c72 tempest-ProjectReaderTests-1094401723 None] Deleted volume successfully. Aug 10 13:09:07 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-6641c287-39ff-4ede-a15a-51d58dee6c72 tempest-ProjectReaderTests-1094401723 None] Lock "cinder-51753f94-c503-41e4-8c66-491892f6688e-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:07 devstack sudo[109931]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8a30558e-f79d-4888-bb8f-26197d15307b tempest-ProjectMemberTests-1235695716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98.030bf296-5a37-4b4e-88ea-d3ec7a81582b" returned: 0 in 0.374s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:07 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-8a30558e-f79d-4888-bb8f-26197d15307b tempest-ProjectMemberTests-1235695716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1139d13c-106a-41e8-b09c-904577c7bc98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 13:09:07 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1b4f88-f705-4fc1-b136-3c7db2b70555]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:09:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8a30558e-f79d-4888-bb8f-26197d15307b tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:07 devstack sudo[109938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98 Aug 10 13:09:07 devstack sudo[109938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:07 devstack sudo[109938]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8a30558e-f79d-4888-bb8f-26197d15307b tempest-ProjectMemberTests-1235695716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98" returned: 0 in 0.366s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8a30558e-f79d-4888-bb8f-26197d15307b tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98.030bf296-5a37-4b4e-88ea-d3ec7a81582b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:07 devstack sudo[109943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98.030bf296-5a37-4b4e-88ea-d3ec7a81582b Aug 10 13:09:07 devstack sudo[109943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:08 devstack sudo[109943]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8a30558e-f79d-4888-bb8f-26197d15307b tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98.030bf296-5a37-4b4e-88ea-d3ec7a81582b" returned: 0 in 0.346s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8a30558e-f79d-4888-bb8f-26197d15307b tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98.030bf296-5a37-4b4e-88ea-d3ec7a81582b {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:08 devstack sudo[109948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98.030bf296-5a37-4b4e-88ea-d3ec7a81582b Aug 10 13:09:08 devstack sudo[109948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:08 devstack sudo[109948]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8a30558e-f79d-4888-bb8f-26197d15307b tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98.030bf296-5a37-4b4e-88ea-d3ec7a81582b" returned: 0 in 0.287s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:08 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8a30558e-f79d-4888-bb8f-26197d15307b tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-030bf296-5a37-4b4e-88ea-d3ec7a81582b" released by "_delete_snapshot" :: held 1.500s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:08 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8a30558e-f79d-4888-bb8f-26197d15307b tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-1139d13c-106a-41e8-b09c-904577c7bc98" released by "delete_snapshot" :: held 1.534s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:08 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-8a30558e-f79d-4888-bb8f-26197d15307b tempest-ProjectMemberTests-1235695716 None] Created reservations ['cd7a3a69-bb06-4b4d-9c06-427b95626750', '12586842-c217-4677-8f22-adb25e3f9b27', '0c06365d-6540-42dd-adb6-23dab3b572df', '8ae0b1d7-0b14-48ff-ad13-97464a86b32e'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:09:08 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-8a30558e-f79d-4888-bb8f-26197d15307b tempest-ProjectMemberTests-1235695716 None] Delete snapshot completed successfully. Aug 10 13:09:08 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8a30558e-f79d-4888-bb8f-26197d15307b tempest-ProjectMemberTests-1235695716 None] Lock "cinder-030bf296-5a37-4b4e-88ea-d3ec7a81582b-delete_snapshot" released by "delete_snapshot" :: held 1.686s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:09 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0a778689-5f52-4817-9875-6ab9193e4ef7 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-1139d13c-106a-41e8-b09c-904577c7bc98-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:09 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0a778689-5f52-4817-9875-6ab9193e4ef7 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-1139d13c-106a-41e8-b09c-904577c7bc98-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:09 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0a778689-5f52-4817-9875-6ab9193e4ef7 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-quobyte-1139d13c-106a-41e8-b09c-904577c7bc98" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:09 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0a778689-5f52-4817-9875-6ab9193e4ef7 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-1139d13c-106a-41e8-b09c-904577c7bc98" acquired by "delete_volume" :: waited 0.017s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:09 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[0caea975-bc27-4c7b-881f-07f0c13f32a4]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:09:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0a778689-5f52-4817-9875-6ab9193e4ef7 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:09 devstack sudo[109953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98 Aug 10 13:09:09 devstack sudo[109953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:09 devstack sudo[109953]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0a778689-5f52-4817-9875-6ab9193e4ef7 tempest-ProjectMemberTests-1235695716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98" returned: 0 in 0.369s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0a778689-5f52-4817-9875-6ab9193e4ef7 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:09 devstack sudo[109958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98 Aug 10 13:09:09 devstack sudo[109958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:09 devstack sudo[109958]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0a778689-5f52-4817-9875-6ab9193e4ef7 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-1139d13c-106a-41e8-b09c-904577c7bc98" returned: 0 in 0.258s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:09 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0a778689-5f52-4817-9875-6ab9193e4ef7 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-1139d13c-106a-41e8-b09c-904577c7bc98" released by "delete_volume" :: held 0.688s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:09 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-0a778689-5f52-4817-9875-6ab9193e4ef7 tempest-ProjectMemberTests-1235695716 None] Created reservations ['768127d8-6024-49a9-af6e-3913d8e10e28', 'ac4de37c-7288-42e4-ad9c-dce7c3a91e17', '63facc9b-20e2-4d36-9c2e-7643c2d37883', '0dc2951b-98bc-446e-adfc-a047a48f1555'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:09:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0a778689-5f52-4817-9875-6ab9193e4ef7 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:09:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0a778689-5f52-4817-9875-6ab9193e4ef7 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:09:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0a778689-5f52-4817-9875-6ab9193e4ef7 tempest-ProjectMemberTests-1235695716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:09:09 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0a778689-5f52-4817-9875-6ab9193e4ef7 tempest-ProjectMemberTests-1235695716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:09:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0a778689-5f52-4817-9875-6ab9193e4ef7 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:09:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0a778689-5f52-4817-9875-6ab9193e4ef7 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:10 devstack sudo[109961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:09:10 devstack sudo[109961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:10 devstack sudo[109961]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0a778689-5f52-4817-9875-6ab9193e4ef7 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.268s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:10 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-0a778689-5f52-4817-9875-6ab9193e4ef7 tempest-ProjectMemberTests-1235695716 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:09:10 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-0a778689-5f52-4817-9875-6ab9193e4ef7 tempest-ProjectMemberTests-1235695716 None] Deleted volume successfully. Aug 10 13:09:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0a778689-5f52-4817-9875-6ab9193e4ef7 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-1139d13c-106a-41e8-b09c-904577c7bc98-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:10 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-e493b335-af56-431a-8671-6e8aebbf422c tempest-ProjectMemberTests-1235695716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:09:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e493b335-af56-431a-8671-6e8aebbf422c tempest-ProjectMemberTests-1235695716 None] Flow 'volume_create_manager' (815693c6-e84a-436c-a24f-580f8ab61a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:09:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e493b335-af56-431a-8671-6e8aebbf422c tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06b59d31-8354-431a-8d29-0dcca0f503a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e493b335-af56-431a-8671-6e8aebbf422c tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06b59d31-8354-431a-8d29-0dcca0f503a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2132542426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e2c44d2-1d2b-4f99-b426-af62eb822203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d23cdd2ebbe54bcca19b58803c9db992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:09:11Z,use_quota=True,user_id='ecda3994ec61480e95cadb77fda1aac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e493b335-af56-431a-8671-6e8aebbf422c tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f64f912-71e3-4805-acdf-855fa40cf9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e493b335-af56-431a-8671-6e8aebbf422c tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f64f912-71e3-4805-acdf-855fa40cf9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e493b335-af56-431a-8671-6e8aebbf422c tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (284ea0f1-a48a-4e08-a041-a8541aa19f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e493b335-af56-431a-8671-6e8aebbf422c tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (284ea0f1-a48a-4e08-a041-a8541aa19f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e2c44d2-1d2b-4f99-b426-af62eb822203', 'volume_name': 'volume-6e2c44d2-1d2b-4f99-b426-af62eb822203', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e493b335-af56-431a-8671-6e8aebbf422c tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61e20477-028f-4913-bbbf-1425434d44e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e493b335-af56-431a-8671-6e8aebbf422c tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61e20477-028f-4913-bbbf-1425434d44e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:10 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e493b335-af56-431a-8671-6e8aebbf422c tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (342d1f61-ffca-41d4-83a4-66b506b6a967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:10 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-e493b335-af56-431a-8671-6e8aebbf422c tempest-ProjectMemberTests-1235695716 None] Volume 6e2c44d2-1d2b-4f99-b426-af62eb822203: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e2c44d2-1d2b-4f99-b426-af62eb822203', 'volume_size': 1} Aug 10 13:09:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e493b335-af56-431a-8671-6e8aebbf422c tempest-ProjectMemberTests-1235695716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:09:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e493b335-af56-431a-8671-6e8aebbf422c tempest-ProjectMemberTests-1235695716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:09:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e493b335-af56-431a-8671-6e8aebbf422c tempest-ProjectMemberTests-1235695716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2132542426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e2c44d2-1d2b-4f99-b426-af62eb822203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d23cdd2ebbe54bcca19b58803c9db992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:09:11Z,use_quota=True,user_id='ecda3994ec61480e95cadb77fda1aac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:09:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-e493b335-af56-431a-8671-6e8aebbf422c tempest-ProjectMemberTests-1235695716 None] Creating volume 6e2c44d2-1d2b-4f99-b426-af62eb822203 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:09:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e493b335-af56-431a-8671-6e8aebbf422c tempest-ProjectMemberTests-1235695716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:09:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e493b335-af56-431a-8671-6e8aebbf422c tempest-ProjectMemberTests-1235695716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:09:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e493b335-af56-431a-8671-6e8aebbf422c tempest-ProjectMemberTests-1235695716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:09:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e493b335-af56-431a-8671-6e8aebbf422c tempest-ProjectMemberTests-1235695716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:09:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e493b335-af56-431a-8671-6e8aebbf422c tempest-ProjectMemberTests-1235695716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:09:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e493b335-af56-431a-8671-6e8aebbf422c tempest-ProjectMemberTests-1235695716 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:09:10 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-e493b335-af56-431a-8671-6e8aebbf422c tempest-ProjectMemberTests-1235695716 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:09:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e493b335-af56-431a-8671-6e8aebbf422c tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:10 devstack sudo[109964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203 1073741824 Aug 10 13:09:10 devstack sudo[109964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:11 devstack sudo[109964]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e493b335-af56-431a-8671-6e8aebbf422c tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203 1073741824" returned: 0 in 0.403s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e493b335-af56-431a-8671-6e8aebbf422c tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:11 devstack sudo[109970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203 Aug 10 13:09:11 devstack sudo[109970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:11 devstack sudo[109970]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e493b335-af56-431a-8671-6e8aebbf422c tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203" returned: 0 in 0.248s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:11 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e493b335-af56-431a-8671-6e8aebbf422c tempest-ProjectMemberTests-1235695716 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:09:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e493b335-af56-431a-8671-6e8aebbf422c tempest-ProjectMemberTests-1235695716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:09:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e493b335-af56-431a-8671-6e8aebbf422c tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (342d1f61-ffca-41d4-83a4-66b506b6a967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e2c44d2-1d2b-4f99-b426-af62eb822203', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e493b335-af56-431a-8671-6e8aebbf422c tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7925cd2a-732c-4408-adc7-c9361fa50a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:11 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-e493b335-af56-431a-8671-6e8aebbf422c tempest-ProjectMemberTests-1235695716 None] Volume volume-6e2c44d2-1d2b-4f99-b426-af62eb822203 (6e2c44d2-1d2b-4f99-b426-af62eb822203): created successfully Aug 10 13:09:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e493b335-af56-431a-8671-6e8aebbf422c tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7925cd2a-732c-4408-adc7-c9361fa50a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:11 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e493b335-af56-431a-8671-6e8aebbf422c tempest-ProjectMemberTests-1235695716 None] Flow 'volume_create_manager' (815693c6-e84a-436c-a24f-580f8ab61a80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:09:11 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-e493b335-af56-431a-8671-6e8aebbf422c tempest-ProjectMemberTests-1235695716 None] Created volume successfully. Aug 10 13:09:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0e775deb-e2f5-4853-9fdb-223f0130ea47 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:09:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0e775deb-e2f5-4853-9fdb-223f0130ea47 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:09:11 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-0e775deb-e2f5-4853-9fdb-223f0130ea47 tempest-ProjectMemberTests-1235695716 None] Creating offline snapshot bac8a164-7b4d-479c-92dd-6077abcbe6df of volume 6e2c44d2-1d2b-4f99-b426-af62eb822203 {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 13:09:11 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa53c43-4742-4c25-852b-1ce337004f9f]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:09:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0e775deb-e2f5-4853-9fdb-223f0130ea47 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:12 devstack sudo[109973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203 Aug 10 13:09:12 devstack sudo[109973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:12 devstack sudo[109973]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0e775deb-e2f5-4853-9fdb-223f0130ea47 tempest-ProjectMemberTests-1235695716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203" returned: 0 in 0.378s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0e775deb-e2f5-4853-9fdb-223f0130ea47 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203.bac8a164-7b4d-479c-92dd-6077abcbe6df 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:12 devstack sudo[109978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203.bac8a164-7b4d-479c-92dd-6077abcbe6df 1G Aug 10 13:09:12 devstack sudo[109978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:12 devstack sudo[109978]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0e775deb-e2f5-4853-9fdb-223f0130ea47 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203.bac8a164-7b4d-479c-92dd-6077abcbe6df 1G" returned: 0 in 0.416s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0e775deb-e2f5-4853-9fdb-223f0130ea47 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e2c44d2-1d2b-4f99-b426-af62eb822203 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203.bac8a164-7b4d-479c-92dd-6077abcbe6df {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:12 devstack sudo[109984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e2c44d2-1d2b-4f99-b426-af62eb822203 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203.bac8a164-7b4d-479c-92dd-6077abcbe6df Aug 10 13:09:12 devstack sudo[109984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:13 devstack sudo[109984]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0e775deb-e2f5-4853-9fdb-223f0130ea47 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e2c44d2-1d2b-4f99-b426-af62eb822203 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203.bac8a164-7b4d-479c-92dd-6077abcbe6df" returned: 0 in 0.285s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:13 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-0e775deb-e2f5-4853-9fdb-223f0130ea47 tempest-ProjectMemberTests-1235695716 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203.bac8a164-7b4d-479c-92dd-6077abcbe6df is being set with open permissions: ugo+rw Aug 10 13:09:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0e775deb-e2f5-4853-9fdb-223f0130ea47 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203.bac8a164-7b4d-479c-92dd-6077abcbe6df {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:13 devstack sudo[109989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203.bac8a164-7b4d-479c-92dd-6077abcbe6df Aug 10 13:09:13 devstack sudo[109989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:13 devstack sudo[109989]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0e775deb-e2f5-4853-9fdb-223f0130ea47 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203.bac8a164-7b4d-479c-92dd-6077abcbe6df" returned: 0 in 0.252s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0e775deb-e2f5-4853-9fdb-223f0130ea47 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:13 devstack sudo[109992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203.info Aug 10 13:09:13 devstack sudo[109992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:13 devstack sudo[109992]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0e775deb-e2f5-4853-9fdb-223f0130ea47 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203.info" returned: 0 in 0.254s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:13 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-0e775deb-e2f5-4853-9fdb-223f0130ea47 tempest-ProjectMemberTests-1235695716 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203.info is being set with open permissions: ugo+rw Aug 10 13:09:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0e775deb-e2f5-4853-9fdb-223f0130ea47 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:13 devstack sudo[109995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203.info Aug 10 13:09:13 devstack sudo[109995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:13 devstack sudo[109995]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0e775deb-e2f5-4853-9fdb-223f0130ea47 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203.info" returned: 0 in 0.273s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0e775deb-e2f5-4853-9fdb-223f0130ea47 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.938s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:09:13 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-0e775deb-e2f5-4853-9fdb-223f0130ea47 tempest-ProjectMemberTests-1235695716 None] Create snapshot completed successfully Aug 10 13:09:14 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4e75ff5c-973c-46c3-9d6c-7347b8c9b7db tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-bac8a164-7b4d-479c-92dd-6077abcbe6df-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:14 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4e75ff5c-973c-46c3-9d6c-7347b8c9b7db tempest-ProjectMemberTests-1235695716 None] Lock "cinder-bac8a164-7b4d-479c-92dd-6077abcbe6df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:14 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4e75ff5c-973c-46c3-9d6c-7347b8c9b7db tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-quobyte-6e2c44d2-1d2b-4f99-b426-af62eb822203" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:14 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4e75ff5c-973c-46c3-9d6c-7347b8c9b7db tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-6e2c44d2-1d2b-4f99-b426-af62eb822203" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:14 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4e75ff5c-973c-46c3-9d6c-7347b8c9b7db tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-quobyte-bac8a164-7b4d-479c-92dd-6077abcbe6df" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:14 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4e75ff5c-973c-46c3-9d6c-7347b8c9b7db tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-bac8a164-7b4d-479c-92dd-6077abcbe6df" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:14 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-4e75ff5c-973c-46c3-9d6c-7347b8c9b7db tempest-ProjectMemberTests-1235695716 None] Deleting offline snapshot bac8a164-7b4d-479c-92dd-6077abcbe6df of volume 6e2c44d2-1d2b-4f99-b426-af62eb822203 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 13:09:14 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-4e75ff5c-973c-46c3-9d6c-7347b8c9b7db tempest-ProjectMemberTests-1235695716 None] snapshot_file for this snap is: volume-6e2c44d2-1d2b-4f99-b426-af62eb822203.bac8a164-7b4d-479c-92dd-6077abcbe6df {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 13:09:14 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e61a140-8a39-499f-bd8a-1430deafb984]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:09:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4e75ff5c-973c-46c3-9d6c-7347b8c9b7db tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203.bac8a164-7b4d-479c-92dd-6077abcbe6df {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:14 devstack sudo[109998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203.bac8a164-7b4d-479c-92dd-6077abcbe6df Aug 10 13:09:14 devstack sudo[109998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:14 devstack sudo[109998]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4e75ff5c-973c-46c3-9d6c-7347b8c9b7db tempest-ProjectMemberTests-1235695716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203.bac8a164-7b4d-479c-92dd-6077abcbe6df" returned: 0 in 0.348s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:14 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-4e75ff5c-973c-46c3-9d6c-7347b8c9b7db tempest-ProjectMemberTests-1235695716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e2c44d2-1d2b-4f99-b426-af62eb822203(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 13:09:14 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e377954-9c57-4fa6-bae7-1bb9d9a42f2e]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:09:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4e75ff5c-973c-46c3-9d6c-7347b8c9b7db tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:14 devstack sudo[110003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203 Aug 10 13:09:14 devstack sudo[110003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:14 devstack sudo[110003]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4e75ff5c-973c-46c3-9d6c-7347b8c9b7db tempest-ProjectMemberTests-1235695716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203" returned: 0 in 0.348s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:14 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4e75ff5c-973c-46c3-9d6c-7347b8c9b7db tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203.bac8a164-7b4d-479c-92dd-6077abcbe6df {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:14 devstack sudo[110008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203.bac8a164-7b4d-479c-92dd-6077abcbe6df Aug 10 13:09:14 devstack sudo[110008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:15 devstack sudo[110008]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4e75ff5c-973c-46c3-9d6c-7347b8c9b7db tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203.bac8a164-7b4d-479c-92dd-6077abcbe6df" returned: 0 in 0.341s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4e75ff5c-973c-46c3-9d6c-7347b8c9b7db tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203.bac8a164-7b4d-479c-92dd-6077abcbe6df {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:15 devstack sudo[110014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203.bac8a164-7b4d-479c-92dd-6077abcbe6df Aug 10 13:09:15 devstack sudo[110014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:15 devstack sudo[110014]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:15 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4e75ff5c-973c-46c3-9d6c-7347b8c9b7db tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203.bac8a164-7b4d-479c-92dd-6077abcbe6df" returned: 0 in 0.255s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:15 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4e75ff5c-973c-46c3-9d6c-7347b8c9b7db tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-bac8a164-7b4d-479c-92dd-6077abcbe6df" released by "_delete_snapshot" :: held 1.394s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:15 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4e75ff5c-973c-46c3-9d6c-7347b8c9b7db tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-6e2c44d2-1d2b-4f99-b426-af62eb822203" released by "delete_snapshot" :: held 1.419s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:15 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-4e75ff5c-973c-46c3-9d6c-7347b8c9b7db tempest-ProjectMemberTests-1235695716 None] Created reservations ['089dd1be-bb93-4013-acdd-d09c16807269', '2d6daa55-b1de-4f80-ae8f-0c9964315c86', 'af5f6c12-9b42-4351-8eb3-016e1fbe3f0b', '4335ce00-5541-440c-8a2e-50ffce2ddd6a'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:09:15 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-4e75ff5c-973c-46c3-9d6c-7347b8c9b7db tempest-ProjectMemberTests-1235695716 None] Delete snapshot completed successfully. Aug 10 13:09:15 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4e75ff5c-973c-46c3-9d6c-7347b8c9b7db tempest-ProjectMemberTests-1235695716 None] Lock "cinder-bac8a164-7b4d-479c-92dd-6077abcbe6df-delete_snapshot" released by "delete_snapshot" :: held 1.582s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:16 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4a1c8300-8049-4f28-b338-ac6d268921c9 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-6e2c44d2-1d2b-4f99-b426-af62eb822203-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:16 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4a1c8300-8049-4f28-b338-ac6d268921c9 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-6e2c44d2-1d2b-4f99-b426-af62eb822203-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:16 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4a1c8300-8049-4f28-b338-ac6d268921c9 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-quobyte-6e2c44d2-1d2b-4f99-b426-af62eb822203" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:16 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4a1c8300-8049-4f28-b338-ac6d268921c9 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-6e2c44d2-1d2b-4f99-b426-af62eb822203" acquired by "delete_volume" :: waited 0.017s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:16 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[247aa2ee-ad1b-49ad-a34b-79629961a10c]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:09:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4a1c8300-8049-4f28-b338-ac6d268921c9 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:16 devstack sudo[110017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203 Aug 10 13:09:16 devstack sudo[110017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:16 devstack sudo[110017]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4a1c8300-8049-4f28-b338-ac6d268921c9 tempest-ProjectMemberTests-1235695716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203" returned: 0 in 0.380s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:16 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4a1c8300-8049-4f28-b338-ac6d268921c9 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:16 devstack sudo[110022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203 Aug 10 13:09:16 devstack sudo[110022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:16 devstack sudo[110022]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4a1c8300-8049-4f28-b338-ac6d268921c9 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-6e2c44d2-1d2b-4f99-b426-af62eb822203" returned: 0 in 0.253s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:17 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4a1c8300-8049-4f28-b338-ac6d268921c9 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-6e2c44d2-1d2b-4f99-b426-af62eb822203" released by "delete_volume" :: held 0.695s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:17 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-4a1c8300-8049-4f28-b338-ac6d268921c9 tempest-ProjectMemberTests-1235695716 None] Created reservations ['98473fe3-4cd0-4780-80b0-2bc7281f6f0e', 'e83b194f-73b5-4702-ab9c-221b73a77a8a', 'cd39af2d-2385-4182-b935-20d6fd942429', 'dd75b82f-0f36-4739-b794-ea6e817a56a0'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:09:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4a1c8300-8049-4f28-b338-ac6d268921c9 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:09:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4a1c8300-8049-4f28-b338-ac6d268921c9 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:09:17 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4a1c8300-8049-4f28-b338-ac6d268921c9 tempest-ProjectMemberTests-1235695716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:09:17 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4a1c8300-8049-4f28-b338-ac6d268921c9 tempest-ProjectMemberTests-1235695716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:09:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4a1c8300-8049-4f28-b338-ac6d268921c9 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:09:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4a1c8300-8049-4f28-b338-ac6d268921c9 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:17 devstack sudo[110025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:09:17 devstack sudo[110025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:17 devstack sudo[110025]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4a1c8300-8049-4f28-b338-ac6d268921c9 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.251s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:17 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-4a1c8300-8049-4f28-b338-ac6d268921c9 tempest-ProjectMemberTests-1235695716 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:09:17 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-4a1c8300-8049-4f28-b338-ac6d268921c9 tempest-ProjectMemberTests-1235695716 None] Deleted volume successfully. Aug 10 13:09:17 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4a1c8300-8049-4f28-b338-ac6d268921c9 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-6e2c44d2-1d2b-4f99-b426-af62eb822203-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:17 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7338d88-954f-49e3-871f-836824fc4b5e tempest-ProjectMemberTests-1235695716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:09:17 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e7338d88-954f-49e3-871f-836824fc4b5e tempest-ProjectMemberTests-1235695716 None] Flow 'volume_create_manager' (1037bab1-7642-4652-b618-63da6110a9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:09:17 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e7338d88-954f-49e3-871f-836824fc4b5e tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb384f13-87b3-4920-a30d-148a84968ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:17 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e7338d88-954f-49e3-871f-836824fc4b5e tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb384f13-87b3-4920-a30d-148a84968ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1007933207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff4ba381-28c5-4433-8150-e2adcb94c640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d23cdd2ebbe54bcca19b58803c9db992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:09:18Z,use_quota=True,user_id='ecda3994ec61480e95cadb77fda1aac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:17 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e7338d88-954f-49e3-871f-836824fc4b5e tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe80c0b-8747-4957-be8b-d6c8c2fd599d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:17 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e7338d88-954f-49e3-871f-836824fc4b5e tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe80c0b-8747-4957-be8b-d6c8c2fd599d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:17 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e7338d88-954f-49e3-871f-836824fc4b5e tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f956c0af-c645-4123-afc8-f9284e812fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:17 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e7338d88-954f-49e3-871f-836824fc4b5e tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f956c0af-c645-4123-afc8-f9284e812fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff4ba381-28c5-4433-8150-e2adcb94c640', 'volume_name': 'volume-ff4ba381-28c5-4433-8150-e2adcb94c640', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:17 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e7338d88-954f-49e3-871f-836824fc4b5e tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84c20018-205c-492d-9b43-a80ea8eedadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:17 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e7338d88-954f-49e3-871f-836824fc4b5e tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84c20018-205c-492d-9b43-a80ea8eedadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:17 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e7338d88-954f-49e3-871f-836824fc4b5e tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b5cc24-c3b0-4ebe-9335-1d681cdbbbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:17 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-e7338d88-954f-49e3-871f-836824fc4b5e tempest-ProjectMemberTests-1235695716 None] Volume ff4ba381-28c5-4433-8150-e2adcb94c640: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff4ba381-28c5-4433-8150-e2adcb94c640', 'volume_size': 1} Aug 10 13:09:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e7338d88-954f-49e3-871f-836824fc4b5e tempest-ProjectMemberTests-1235695716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:09:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e7338d88-954f-49e3-871f-836824fc4b5e tempest-ProjectMemberTests-1235695716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:09:17 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e7338d88-954f-49e3-871f-836824fc4b5e tempest-ProjectMemberTests-1235695716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1007933207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff4ba381-28c5-4433-8150-e2adcb94c640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d23cdd2ebbe54bcca19b58803c9db992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:09:18Z,use_quota=True,user_id='ecda3994ec61480e95cadb77fda1aac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:09:17 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-e7338d88-954f-49e3-871f-836824fc4b5e tempest-ProjectMemberTests-1235695716 None] Creating volume ff4ba381-28c5-4433-8150-e2adcb94c640 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:09:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e7338d88-954f-49e3-871f-836824fc4b5e tempest-ProjectMemberTests-1235695716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:09:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e7338d88-954f-49e3-871f-836824fc4b5e tempest-ProjectMemberTests-1235695716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:09:17 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e7338d88-954f-49e3-871f-836824fc4b5e tempest-ProjectMemberTests-1235695716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:09:17 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e7338d88-954f-49e3-871f-836824fc4b5e tempest-ProjectMemberTests-1235695716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:09:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e7338d88-954f-49e3-871f-836824fc4b5e tempest-ProjectMemberTests-1235695716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:09:17 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e7338d88-954f-49e3-871f-836824fc4b5e tempest-ProjectMemberTests-1235695716 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:09:17 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-e7338d88-954f-49e3-871f-836824fc4b5e tempest-ProjectMemberTests-1235695716 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:09:17 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e7338d88-954f-49e3-871f-836824fc4b5e tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:18 devstack sudo[110028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640 1073741824 Aug 10 13:09:18 devstack sudo[110028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:18 devstack sudo[110028]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e7338d88-954f-49e3-871f-836824fc4b5e tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640 1073741824" returned: 0 in 0.450s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e7338d88-954f-49e3-871f-836824fc4b5e tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:18 devstack sudo[110034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640 Aug 10 13:09:18 devstack sudo[110034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:18 devstack sudo[110034]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e7338d88-954f-49e3-871f-836824fc4b5e tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640" returned: 0 in 0.248s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:18 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e7338d88-954f-49e3-871f-836824fc4b5e tempest-ProjectMemberTests-1235695716 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:09:18 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e7338d88-954f-49e3-871f-836824fc4b5e tempest-ProjectMemberTests-1235695716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:09:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e7338d88-954f-49e3-871f-836824fc4b5e tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b5cc24-c3b0-4ebe-9335-1d681cdbbbb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff4ba381-28c5-4433-8150-e2adcb94c640', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e7338d88-954f-49e3-871f-836824fc4b5e tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd761794-8ac3-45ff-99fe-b229e6aae9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:18 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-e7338d88-954f-49e3-871f-836824fc4b5e tempest-ProjectMemberTests-1235695716 None] Volume volume-ff4ba381-28c5-4433-8150-e2adcb94c640 (ff4ba381-28c5-4433-8150-e2adcb94c640): created successfully Aug 10 13:09:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e7338d88-954f-49e3-871f-836824fc4b5e tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd761794-8ac3-45ff-99fe-b229e6aae9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:18 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-e7338d88-954f-49e3-871f-836824fc4b5e tempest-ProjectMemberTests-1235695716 None] Flow 'volume_create_manager' (1037bab1-7642-4652-b618-63da6110a9e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:09:18 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-e7338d88-954f-49e3-871f-836824fc4b5e tempest-ProjectMemberTests-1235695716 None] Created volume successfully. Aug 10 13:09:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5b102afe-776d-4f4c-a695-b200a45e31ec tempest-ProjectMemberTests-1235695716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:09:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5b102afe-776d-4f4c-a695-b200a45e31ec tempest-ProjectMemberTests-1235695716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:09:19 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-5b102afe-776d-4f4c-a695-b200a45e31ec tempest-ProjectMemberTests-1235695716 None] Creating offline snapshot 30e9b288-7e50-44b3-b2cd-0baa6e050cb4 of volume ff4ba381-28c5-4433-8150-e2adcb94c640 {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 13:09:19 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ad13aa-e7fb-426d-925d-606e5a76776c]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:09:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5b102afe-776d-4f4c-a695-b200a45e31ec tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:19 devstack sudo[110038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640 Aug 10 13:09:19 devstack sudo[110038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:19 devstack sudo[110038]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5b102afe-776d-4f4c-a695-b200a45e31ec tempest-ProjectMemberTests-1235695716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640" returned: 0 in 0.354s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5b102afe-776d-4f4c-a695-b200a45e31ec tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640.30e9b288-7e50-44b3-b2cd-0baa6e050cb4 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:19 devstack sudo[110043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640.30e9b288-7e50-44b3-b2cd-0baa6e050cb4 1G Aug 10 13:09:19 devstack sudo[110043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:19 devstack sudo[110043]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5b102afe-776d-4f4c-a695-b200a45e31ec tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640.30e9b288-7e50-44b3-b2cd-0baa6e050cb4 1G" returned: 0 in 0.391s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:19 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5b102afe-776d-4f4c-a695-b200a45e31ec tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff4ba381-28c5-4433-8150-e2adcb94c640 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640.30e9b288-7e50-44b3-b2cd-0baa6e050cb4 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:19 devstack sudo[110049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff4ba381-28c5-4433-8150-e2adcb94c640 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640.30e9b288-7e50-44b3-b2cd-0baa6e050cb4 Aug 10 13:09:19 devstack sudo[110049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:20 devstack sudo[110049]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5b102afe-776d-4f4c-a695-b200a45e31ec tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff4ba381-28c5-4433-8150-e2adcb94c640 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640.30e9b288-7e50-44b3-b2cd-0baa6e050cb4" returned: 0 in 0.302s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:20 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-5b102afe-776d-4f4c-a695-b200a45e31ec tempest-ProjectMemberTests-1235695716 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640.30e9b288-7e50-44b3-b2cd-0baa6e050cb4 is being set with open permissions: ugo+rw Aug 10 13:09:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5b102afe-776d-4f4c-a695-b200a45e31ec tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640.30e9b288-7e50-44b3-b2cd-0baa6e050cb4 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:20 devstack sudo[110054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640.30e9b288-7e50-44b3-b2cd-0baa6e050cb4 Aug 10 13:09:20 devstack sudo[110054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:20 devstack sudo[110054]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5b102afe-776d-4f4c-a695-b200a45e31ec tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640.30e9b288-7e50-44b3-b2cd-0baa6e050cb4" returned: 0 in 0.249s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5b102afe-776d-4f4c-a695-b200a45e31ec tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:20 devstack sudo[110057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640.info Aug 10 13:09:20 devstack sudo[110057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:20 devstack sudo[110057]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5b102afe-776d-4f4c-a695-b200a45e31ec tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640.info" returned: 0 in 0.275s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:20 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-5b102afe-776d-4f4c-a695-b200a45e31ec tempest-ProjectMemberTests-1235695716 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640.info is being set with open permissions: ugo+rw Aug 10 13:09:20 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5b102afe-776d-4f4c-a695-b200a45e31ec tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:20 devstack sudo[110061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640.info Aug 10 13:09:20 devstack sudo[110061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:21 devstack sudo[110061]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5b102afe-776d-4f4c-a695-b200a45e31ec tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640.info" returned: 0 in 0.305s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:21 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5b102afe-776d-4f4c-a695-b200a45e31ec tempest-ProjectMemberTests-1235695716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.966s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:09:21 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-5b102afe-776d-4f4c-a695-b200a45e31ec tempest-ProjectMemberTests-1235695716 None] Create snapshot completed successfully Aug 10 13:09:22 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4c26a942-c6fb-4ac0-bdcf-a88377ca2d43 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-30e9b288-7e50-44b3-b2cd-0baa6e050cb4-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:22 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4c26a942-c6fb-4ac0-bdcf-a88377ca2d43 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-30e9b288-7e50-44b3-b2cd-0baa6e050cb4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:22 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4c26a942-c6fb-4ac0-bdcf-a88377ca2d43 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-quobyte-ff4ba381-28c5-4433-8150-e2adcb94c640" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:22 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4c26a942-c6fb-4ac0-bdcf-a88377ca2d43 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-ff4ba381-28c5-4433-8150-e2adcb94c640" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:22 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4c26a942-c6fb-4ac0-bdcf-a88377ca2d43 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-quobyte-30e9b288-7e50-44b3-b2cd-0baa6e050cb4" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:22 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4c26a942-c6fb-4ac0-bdcf-a88377ca2d43 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-30e9b288-7e50-44b3-b2cd-0baa6e050cb4" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:22 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-4c26a942-c6fb-4ac0-bdcf-a88377ca2d43 tempest-ProjectMemberTests-1235695716 None] Deleting offline snapshot 30e9b288-7e50-44b3-b2cd-0baa6e050cb4 of volume ff4ba381-28c5-4433-8150-e2adcb94c640 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 13:09:22 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-4c26a942-c6fb-4ac0-bdcf-a88377ca2d43 tempest-ProjectMemberTests-1235695716 None] snapshot_file for this snap is: volume-ff4ba381-28c5-4433-8150-e2adcb94c640.30e9b288-7e50-44b3-b2cd-0baa6e050cb4 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 13:09:22 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a0eb14-2f22-4a52-bf76-202e82865a16]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:09:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c26a942-c6fb-4ac0-bdcf-a88377ca2d43 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640.30e9b288-7e50-44b3-b2cd-0baa6e050cb4 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:22 devstack sudo[110064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640.30e9b288-7e50-44b3-b2cd-0baa6e050cb4 Aug 10 13:09:22 devstack sudo[110064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:22 devstack sudo[110064]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c26a942-c6fb-4ac0-bdcf-a88377ca2d43 tempest-ProjectMemberTests-1235695716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640.30e9b288-7e50-44b3-b2cd-0baa6e050cb4" returned: 0 in 0.401s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:22 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-4c26a942-c6fb-4ac0-bdcf-a88377ca2d43 tempest-ProjectMemberTests-1235695716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff4ba381-28c5-4433-8150-e2adcb94c640(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 13:09:22 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[54106b2d-0b6a-4b6c-a9a6-13074109381d]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:09:22 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c26a942-c6fb-4ac0-bdcf-a88377ca2d43 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:22 devstack sudo[110069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640 Aug 10 13:09:22 devstack sudo[110069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:23 devstack sudo[110069]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c26a942-c6fb-4ac0-bdcf-a88377ca2d43 tempest-ProjectMemberTests-1235695716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640" returned: 0 in 0.364s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c26a942-c6fb-4ac0-bdcf-a88377ca2d43 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640.30e9b288-7e50-44b3-b2cd-0baa6e050cb4 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:23 devstack sudo[110074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640.30e9b288-7e50-44b3-b2cd-0baa6e050cb4 Aug 10 13:09:23 devstack sudo[110074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:23 devstack sudo[110074]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c26a942-c6fb-4ac0-bdcf-a88377ca2d43 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640.30e9b288-7e50-44b3-b2cd-0baa6e050cb4" returned: 0 in 0.383s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c26a942-c6fb-4ac0-bdcf-a88377ca2d43 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640.30e9b288-7e50-44b3-b2cd-0baa6e050cb4 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:23 devstack sudo[110079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640.30e9b288-7e50-44b3-b2cd-0baa6e050cb4 Aug 10 13:09:23 devstack sudo[110079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:23 devstack sudo[110079]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:23 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4c26a942-c6fb-4ac0-bdcf-a88377ca2d43 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640.30e9b288-7e50-44b3-b2cd-0baa6e050cb4" returned: 0 in 0.252s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:23 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4c26a942-c6fb-4ac0-bdcf-a88377ca2d43 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-30e9b288-7e50-44b3-b2cd-0baa6e050cb4" released by "_delete_snapshot" :: held 1.514s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:23 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4c26a942-c6fb-4ac0-bdcf-a88377ca2d43 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-ff4ba381-28c5-4433-8150-e2adcb94c640" released by "delete_snapshot" :: held 1.536s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:23 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-4c26a942-c6fb-4ac0-bdcf-a88377ca2d43 tempest-ProjectMemberTests-1235695716 None] Created reservations ['c7723255-7c4e-425f-aea6-853aa57e0922', '7e908ab1-e8ec-4796-9513-522612ea4a20', '82878409-ee2e-46e1-9652-fd45112833ad', 'e04f60cb-3e9e-48df-83bf-85a177a26d3d'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:09:23 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-4c26a942-c6fb-4ac0-bdcf-a88377ca2d43 tempest-ProjectMemberTests-1235695716 None] Delete snapshot completed successfully. Aug 10 13:09:23 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4c26a942-c6fb-4ac0-bdcf-a88377ca2d43 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-30e9b288-7e50-44b3-b2cd-0baa6e050cb4-delete_snapshot" released by "delete_snapshot" :: held 1.690s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:24 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4ec5f77e-dd38-4abe-a8d0-7b1ddb560938 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-ff4ba381-28c5-4433-8150-e2adcb94c640-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:24 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4ec5f77e-dd38-4abe-a8d0-7b1ddb560938 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-ff4ba381-28c5-4433-8150-e2adcb94c640-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:24 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4ec5f77e-dd38-4abe-a8d0-7b1ddb560938 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-quobyte-ff4ba381-28c5-4433-8150-e2adcb94c640" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:24 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4ec5f77e-dd38-4abe-a8d0-7b1ddb560938 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-ff4ba381-28c5-4433-8150-e2adcb94c640" acquired by "delete_volume" :: waited 0.019s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:24 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47889ff-e2ca-4ed7-8043-5a5f0d7e359e]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:09:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4ec5f77e-dd38-4abe-a8d0-7b1ddb560938 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:24 devstack sudo[110082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640 Aug 10 13:09:24 devstack sudo[110082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:24 devstack sudo[110082]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4ec5f77e-dd38-4abe-a8d0-7b1ddb560938 tempest-ProjectMemberTests-1235695716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640" returned: 0 in 0.365s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:24 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4ec5f77e-dd38-4abe-a8d0-7b1ddb560938 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:24 devstack sudo[110087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640 Aug 10 13:09:24 devstack sudo[110087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:25 devstack sudo[110087]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4ec5f77e-dd38-4abe-a8d0-7b1ddb560938 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ff4ba381-28c5-4433-8150-e2adcb94c640" returned: 0 in 0.265s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4ec5f77e-dd38-4abe-a8d0-7b1ddb560938 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-ff4ba381-28c5-4433-8150-e2adcb94c640" released by "delete_volume" :: held 0.688s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:25 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-4ec5f77e-dd38-4abe-a8d0-7b1ddb560938 tempest-ProjectMemberTests-1235695716 None] Created reservations ['4e6a92f5-3be0-4f80-b107-1fecc7d71af5', '3f50909c-2ada-4773-b6e6-dd884e930477', 'cebffb7f-2b43-4dc3-abb0-1b25252fac5a', 'c204ab7e-cd8f-4e2f-89fb-b92c8fdf2d95'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:09:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4ec5f77e-dd38-4abe-a8d0-7b1ddb560938 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:09:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4ec5f77e-dd38-4abe-a8d0-7b1ddb560938 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:09:25 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4ec5f77e-dd38-4abe-a8d0-7b1ddb560938 tempest-ProjectMemberTests-1235695716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:09:25 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-4ec5f77e-dd38-4abe-a8d0-7b1ddb560938 tempest-ProjectMemberTests-1235695716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:09:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-4ec5f77e-dd38-4abe-a8d0-7b1ddb560938 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:09:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4ec5f77e-dd38-4abe-a8d0-7b1ddb560938 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:25 devstack sudo[110090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:09:25 devstack sudo[110090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:25 devstack sudo[110090]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-4ec5f77e-dd38-4abe-a8d0-7b1ddb560938 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.270s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:25 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-4ec5f77e-dd38-4abe-a8d0-7b1ddb560938 tempest-ProjectMemberTests-1235695716 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:09:25 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-4ec5f77e-dd38-4abe-a8d0-7b1ddb560938 tempest-ProjectMemberTests-1235695716 None] Deleted volume successfully. Aug 10 13:09:25 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-4ec5f77e-dd38-4abe-a8d0-7b1ddb560938 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-ff4ba381-28c5-4433-8150-e2adcb94c640-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:26 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-5af6a3de-a72b-4d86-bb38-881c79bed211 tempest-ProjectMemberTests-1235695716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:09:26 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5af6a3de-a72b-4d86-bb38-881c79bed211 tempest-ProjectMemberTests-1235695716 None] Flow 'volume_create_manager' (3b78b50c-7c5d-41be-a247-0f966c4ed05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:09:26 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5af6a3de-a72b-4d86-bb38-881c79bed211 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad04b86a-b1f6-4638-9673-a51da847ec6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:26 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5af6a3de-a72b-4d86-bb38-881c79bed211 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad04b86a-b1f6-4638-9673-a51da847ec6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1303355468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=793770f5-250e-4b85-9534-32a640a2187d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d23cdd2ebbe54bcca19b58803c9db992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:09:26Z,use_quota=True,user_id='ecda3994ec61480e95cadb77fda1aac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:26 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5af6a3de-a72b-4d86-bb38-881c79bed211 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b3a5ad0-c72f-4fed-a683-5138a457ba85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:26 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5af6a3de-a72b-4d86-bb38-881c79bed211 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b3a5ad0-c72f-4fed-a683-5138a457ba85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:26 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5af6a3de-a72b-4d86-bb38-881c79bed211 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fad9ec13-1593-4eae-b179-f3c33325fa95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:26 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5af6a3de-a72b-4d86-bb38-881c79bed211 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fad9ec13-1593-4eae-b179-f3c33325fa95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '793770f5-250e-4b85-9534-32a640a2187d', 'volume_name': 'volume-793770f5-250e-4b85-9534-32a640a2187d', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:26 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5af6a3de-a72b-4d86-bb38-881c79bed211 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27b2982c-1ef2-4ee5-b62d-27670720b41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:26 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5af6a3de-a72b-4d86-bb38-881c79bed211 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27b2982c-1ef2-4ee5-b62d-27670720b41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:26 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5af6a3de-a72b-4d86-bb38-881c79bed211 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8aaef0a-cced-4810-b821-1653fac9e203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:26 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-5af6a3de-a72b-4d86-bb38-881c79bed211 tempest-ProjectMemberTests-1235695716 None] Volume 793770f5-250e-4b85-9534-32a640a2187d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-793770f5-250e-4b85-9534-32a640a2187d', 'volume_size': 1} Aug 10 13:09:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5af6a3de-a72b-4d86-bb38-881c79bed211 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:09:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5af6a3de-a72b-4d86-bb38-881c79bed211 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:09:26 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-5af6a3de-a72b-4d86-bb38-881c79bed211 tempest-ProjectMemberTests-1235695716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1303355468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=793770f5-250e-4b85-9534-32a640a2187d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d23cdd2ebbe54bcca19b58803c9db992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:09:26Z,use_quota=True,user_id='ecda3994ec61480e95cadb77fda1aac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:09:26 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-5af6a3de-a72b-4d86-bb38-881c79bed211 tempest-ProjectMemberTests-1235695716 None] Creating volume 793770f5-250e-4b85-9534-32a640a2187d {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:09:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5af6a3de-a72b-4d86-bb38-881c79bed211 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:09:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5af6a3de-a72b-4d86-bb38-881c79bed211 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:09:26 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-5af6a3de-a72b-4d86-bb38-881c79bed211 tempest-ProjectMemberTests-1235695716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:09:26 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-5af6a3de-a72b-4d86-bb38-881c79bed211 tempest-ProjectMemberTests-1235695716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:09:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5af6a3de-a72b-4d86-bb38-881c79bed211 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:09:26 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-5af6a3de-a72b-4d86-bb38-881c79bed211 tempest-ProjectMemberTests-1235695716 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:09:26 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-5af6a3de-a72b-4d86-bb38-881c79bed211 tempest-ProjectMemberTests-1235695716 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:09:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5af6a3de-a72b-4d86-bb38-881c79bed211 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:26 devstack sudo[110093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d 1073741824 Aug 10 13:09:26 devstack sudo[110093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:26 devstack sudo[110093]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5af6a3de-a72b-4d86-bb38-881c79bed211 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d 1073741824" returned: 0 in 0.452s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5af6a3de-a72b-4d86-bb38-881c79bed211 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:26 devstack sudo[110098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d Aug 10 13:09:26 devstack sudo[110098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:27 devstack sudo[110098]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5af6a3de-a72b-4d86-bb38-881c79bed211 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d" returned: 0 in 0.262s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:27 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-5af6a3de-a72b-4d86-bb38-881c79bed211 tempest-ProjectMemberTests-1235695716 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:09:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5af6a3de-a72b-4d86-bb38-881c79bed211 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:09:27 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5af6a3de-a72b-4d86-bb38-881c79bed211 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8aaef0a-cced-4810-b821-1653fac9e203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-793770f5-250e-4b85-9534-32a640a2187d', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:27 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5af6a3de-a72b-4d86-bb38-881c79bed211 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c35a9b10-2b04-4059-9cf2-a0d306124500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:27 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-5af6a3de-a72b-4d86-bb38-881c79bed211 tempest-ProjectMemberTests-1235695716 None] Volume volume-793770f5-250e-4b85-9534-32a640a2187d (793770f5-250e-4b85-9534-32a640a2187d): created successfully Aug 10 13:09:27 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5af6a3de-a72b-4d86-bb38-881c79bed211 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c35a9b10-2b04-4059-9cf2-a0d306124500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:27 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-5af6a3de-a72b-4d86-bb38-881c79bed211 tempest-ProjectMemberTests-1235695716 None] Flow 'volume_create_manager' (3b78b50c-7c5d-41be-a247-0f966c4ed05d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:09:27 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-5af6a3de-a72b-4d86-bb38-881c79bed211 tempest-ProjectMemberTests-1235695716 None] Created volume successfully. Aug 10 13:09:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8c716a6e-b904-4f25-ad4d-6db63d816a04 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:09:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8c716a6e-b904-4f25-ad4d-6db63d816a04 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:09:28 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-8c716a6e-b904-4f25-ad4d-6db63d816a04 tempest-ProjectMemberTests-1235695716 None] Creating offline snapshot 5320e980-8c5f-4bdd-b980-7690166525c1 of volume 793770f5-250e-4b85-9534-32a640a2187d {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 13:09:28 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[617f0d85-0ad1-4ddf-9de4-78e3fcec5dd5]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:09:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c716a6e-b904-4f25-ad4d-6db63d816a04 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:28 devstack sudo[110101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d Aug 10 13:09:28 devstack sudo[110101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:28 devstack sudo[110101]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c716a6e-b904-4f25-ad4d-6db63d816a04 tempest-ProjectMemberTests-1235695716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d" returned: 0 in 0.372s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c716a6e-b904-4f25-ad4d-6db63d816a04 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d.5320e980-8c5f-4bdd-b980-7690166525c1 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:28 devstack sudo[110106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d.5320e980-8c5f-4bdd-b980-7690166525c1 1G Aug 10 13:09:28 devstack sudo[110106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:29 devstack sudo[110106]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c716a6e-b904-4f25-ad4d-6db63d816a04 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d.5320e980-8c5f-4bdd-b980-7690166525c1 1G" returned: 0 in 0.414s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c716a6e-b904-4f25-ad4d-6db63d816a04 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-793770f5-250e-4b85-9534-32a640a2187d -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d.5320e980-8c5f-4bdd-b980-7690166525c1 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:29 devstack sudo[110113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-793770f5-250e-4b85-9534-32a640a2187d -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d.5320e980-8c5f-4bdd-b980-7690166525c1 Aug 10 13:09:29 devstack sudo[110113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:29 devstack sudo[110113]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c716a6e-b904-4f25-ad4d-6db63d816a04 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-793770f5-250e-4b85-9534-32a640a2187d -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d.5320e980-8c5f-4bdd-b980-7690166525c1" returned: 0 in 0.395s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:29 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-8c716a6e-b904-4f25-ad4d-6db63d816a04 tempest-ProjectMemberTests-1235695716 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d.5320e980-8c5f-4bdd-b980-7690166525c1 is being set with open permissions: ugo+rw Aug 10 13:09:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c716a6e-b904-4f25-ad4d-6db63d816a04 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d.5320e980-8c5f-4bdd-b980-7690166525c1 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:29 devstack sudo[110118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d.5320e980-8c5f-4bdd-b980-7690166525c1 Aug 10 13:09:29 devstack sudo[110118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:29 devstack sudo[110118]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c716a6e-b904-4f25-ad4d-6db63d816a04 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d.5320e980-8c5f-4bdd-b980-7690166525c1" returned: 0 in 0.266s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c716a6e-b904-4f25-ad4d-6db63d816a04 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:29 devstack sudo[110121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d.info Aug 10 13:09:29 devstack sudo[110121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:30 devstack sudo[110121]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c716a6e-b904-4f25-ad4d-6db63d816a04 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d.info" returned: 0 in 0.282s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:30 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-8c716a6e-b904-4f25-ad4d-6db63d816a04 tempest-ProjectMemberTests-1235695716 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d.info is being set with open permissions: ugo+rw Aug 10 13:09:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c716a6e-b904-4f25-ad4d-6db63d816a04 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:30 devstack sudo[110124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d.info Aug 10 13:09:30 devstack sudo[110124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:30 devstack sudo[110124]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8c716a6e-b904-4f25-ad4d-6db63d816a04 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d.info" returned: 0 in 0.280s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8c716a6e-b904-4f25-ad4d-6db63d816a04 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.110s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:09:30 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-8c716a6e-b904-4f25-ad4d-6db63d816a04 tempest-ProjectMemberTests-1235695716 None] Create snapshot completed successfully Aug 10 13:09:31 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8cbcd0af-442e-49cc-86b5-fe3afc71d2d9 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-5320e980-8c5f-4bdd-b980-7690166525c1-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:31 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8cbcd0af-442e-49cc-86b5-fe3afc71d2d9 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-5320e980-8c5f-4bdd-b980-7690166525c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:31 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8cbcd0af-442e-49cc-86b5-fe3afc71d2d9 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-quobyte-793770f5-250e-4b85-9534-32a640a2187d" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:31 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8cbcd0af-442e-49cc-86b5-fe3afc71d2d9 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-793770f5-250e-4b85-9534-32a640a2187d" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:31 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8cbcd0af-442e-49cc-86b5-fe3afc71d2d9 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-quobyte-5320e980-8c5f-4bdd-b980-7690166525c1" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:31 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8cbcd0af-442e-49cc-86b5-fe3afc71d2d9 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-5320e980-8c5f-4bdd-b980-7690166525c1" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:31 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-8cbcd0af-442e-49cc-86b5-fe3afc71d2d9 tempest-ProjectMemberTests-1235695716 None] Deleting offline snapshot 5320e980-8c5f-4bdd-b980-7690166525c1 of volume 793770f5-250e-4b85-9534-32a640a2187d {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 13:09:31 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-8cbcd0af-442e-49cc-86b5-fe3afc71d2d9 tempest-ProjectMemberTests-1235695716 None] snapshot_file for this snap is: volume-793770f5-250e-4b85-9534-32a640a2187d.5320e980-8c5f-4bdd-b980-7690166525c1 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 13:09:31 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[a767ac90-eebc-4c80-8383-1fc42187bff4]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:09:31 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8cbcd0af-442e-49cc-86b5-fe3afc71d2d9 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d.5320e980-8c5f-4bdd-b980-7690166525c1 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:31 devstack sudo[110127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d.5320e980-8c5f-4bdd-b980-7690166525c1 Aug 10 13:09:31 devstack sudo[110127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:32 devstack sudo[110127]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8cbcd0af-442e-49cc-86b5-fe3afc71d2d9 tempest-ProjectMemberTests-1235695716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d.5320e980-8c5f-4bdd-b980-7690166525c1" returned: 0 in 0.446s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:32 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-8cbcd0af-442e-49cc-86b5-fe3afc71d2d9 tempest-ProjectMemberTests-1235695716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-793770f5-250e-4b85-9534-32a640a2187d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 13:09:32 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8f198c-13d3-421d-a668-c08ea3c8b2f2]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:09:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8cbcd0af-442e-49cc-86b5-fe3afc71d2d9 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:32 devstack sudo[110132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d Aug 10 13:09:32 devstack sudo[110132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:32 devstack sudo[110132]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8cbcd0af-442e-49cc-86b5-fe3afc71d2d9 tempest-ProjectMemberTests-1235695716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d" returned: 0 in 0.426s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:32 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8cbcd0af-442e-49cc-86b5-fe3afc71d2d9 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d.5320e980-8c5f-4bdd-b980-7690166525c1 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:32 devstack sudo[110138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d.5320e980-8c5f-4bdd-b980-7690166525c1 Aug 10 13:09:32 devstack sudo[110138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:33 devstack sudo[110138]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8cbcd0af-442e-49cc-86b5-fe3afc71d2d9 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d.5320e980-8c5f-4bdd-b980-7690166525c1" returned: 0 in 0.351s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8cbcd0af-442e-49cc-86b5-fe3afc71d2d9 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d.5320e980-8c5f-4bdd-b980-7690166525c1 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:33 devstack sudo[110143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d.5320e980-8c5f-4bdd-b980-7690166525c1 Aug 10 13:09:33 devstack sudo[110143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:33 devstack sudo[110143]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:33 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8cbcd0af-442e-49cc-86b5-fe3afc71d2d9 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d.5320e980-8c5f-4bdd-b980-7690166525c1" returned: 0 in 0.259s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:33 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8cbcd0af-442e-49cc-86b5-fe3afc71d2d9 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-5320e980-8c5f-4bdd-b980-7690166525c1" released by "_delete_snapshot" :: held 1.637s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:33 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8cbcd0af-442e-49cc-86b5-fe3afc71d2d9 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-793770f5-250e-4b85-9534-32a640a2187d" released by "delete_snapshot" :: held 1.688s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:33 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-8cbcd0af-442e-49cc-86b5-fe3afc71d2d9 tempest-ProjectMemberTests-1235695716 None] Created reservations ['308bfd71-e29a-4c33-b18e-65e528333d6b', '866f373a-8153-4aa3-9063-4355912e2b4e', '0ba200bb-6a06-4328-a9bb-1f344fc7e2b4', 'a30f89d6-fa02-4c7a-b391-24d443761140'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:09:33 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-8cbcd0af-442e-49cc-86b5-fe3afc71d2d9 tempest-ProjectMemberTests-1235695716 None] Delete snapshot completed successfully. Aug 10 13:09:33 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-8cbcd0af-442e-49cc-86b5-fe3afc71d2d9 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-5320e980-8c5f-4bdd-b980-7690166525c1-delete_snapshot" released by "delete_snapshot" :: held 1.845s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:33 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-95c6bd9c-4c1c-4366-a265-19da082389ea tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-793770f5-250e-4b85-9534-32a640a2187d-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:33 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-95c6bd9c-4c1c-4366-a265-19da082389ea tempest-ProjectMemberTests-1235695716 None] Lock "cinder-793770f5-250e-4b85-9534-32a640a2187d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:34 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-95c6bd9c-4c1c-4366-a265-19da082389ea tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-quobyte-793770f5-250e-4b85-9534-32a640a2187d" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:34 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-95c6bd9c-4c1c-4366-a265-19da082389ea tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-793770f5-250e-4b85-9534-32a640a2187d" acquired by "delete_volume" :: waited 0.020s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:34 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[420fbb1d-1593-433f-a34f-29508d5f98f4]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:09:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-95c6bd9c-4c1c-4366-a265-19da082389ea tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:34 devstack sudo[110182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d Aug 10 13:09:34 devstack sudo[110182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:34 devstack sudo[110182]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-95c6bd9c-4c1c-4366-a265-19da082389ea tempest-ProjectMemberTests-1235695716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d" returned: 0 in 0.416s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-95c6bd9c-4c1c-4366-a265-19da082389ea tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:34 devstack sudo[110187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d Aug 10 13:09:34 devstack sudo[110187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:34 devstack sudo[110187]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-95c6bd9c-4c1c-4366-a265-19da082389ea tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-793770f5-250e-4b85-9534-32a640a2187d" returned: 0 in 0.279s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:34 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-95c6bd9c-4c1c-4366-a265-19da082389ea tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-793770f5-250e-4b85-9534-32a640a2187d" released by "delete_volume" :: held 0.782s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:34 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-95c6bd9c-4c1c-4366-a265-19da082389ea tempest-ProjectMemberTests-1235695716 None] Created reservations ['b05435f9-4754-4870-8957-0cca5bd64912', '9f36e999-3c9d-45b7-b093-38c689d27a23', '0be58a1e-4ba9-433e-a6c3-01eb45305b54', '734e8403-b2a7-4a7e-9db6-9588498c4be6'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:09:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-95c6bd9c-4c1c-4366-a265-19da082389ea tempest-ProjectMemberTests-1235695716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:09:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-95c6bd9c-4c1c-4366-a265-19da082389ea tempest-ProjectMemberTests-1235695716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:09:34 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-95c6bd9c-4c1c-4366-a265-19da082389ea tempest-ProjectMemberTests-1235695716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:09:34 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-95c6bd9c-4c1c-4366-a265-19da082389ea tempest-ProjectMemberTests-1235695716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:09:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-95c6bd9c-4c1c-4366-a265-19da082389ea tempest-ProjectMemberTests-1235695716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:09:34 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-95c6bd9c-4c1c-4366-a265-19da082389ea tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:34 devstack sudo[110190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:09:34 devstack sudo[110190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:35 devstack sudo[110190]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-95c6bd9c-4c1c-4366-a265-19da082389ea tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.265s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:35 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-95c6bd9c-4c1c-4366-a265-19da082389ea tempest-ProjectMemberTests-1235695716 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:09:35 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-95c6bd9c-4c1c-4366-a265-19da082389ea tempest-ProjectMemberTests-1235695716 None] Deleted volume successfully. Aug 10 13:09:35 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-95c6bd9c-4c1c-4366-a265-19da082389ea tempest-ProjectMemberTests-1235695716 None] Lock "cinder-793770f5-250e-4b85-9534-32a640a2187d-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:35 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-81f1a12e-265e-4146-8ad4-f9303d893de7 tempest-ProjectMemberTests-1235695716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:09:35 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81f1a12e-265e-4146-8ad4-f9303d893de7 tempest-ProjectMemberTests-1235695716 None] Flow 'volume_create_manager' (445569a8-9840-4943-b2a2-7ff4521b67b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:09:35 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81f1a12e-265e-4146-8ad4-f9303d893de7 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5dad88-9bed-4c77-8d1f-1fd021ebd6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:35 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81f1a12e-265e-4146-8ad4-f9303d893de7 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5dad88-9bed-4c77-8d1f-1fd021ebd6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-373458910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2ec75bf-1040-4500-8f69-5de5a3aebc1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d23cdd2ebbe54bcca19b58803c9db992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:09:36Z,use_quota=True,user_id='ecda3994ec61480e95cadb77fda1aac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:35 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81f1a12e-265e-4146-8ad4-f9303d893de7 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (759c1fdb-7a4c-4433-9c9d-decffec698e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:35 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81f1a12e-265e-4146-8ad4-f9303d893de7 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (759c1fdb-7a4c-4433-9c9d-decffec698e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:35 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81f1a12e-265e-4146-8ad4-f9303d893de7 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa62492e-d239-4ad8-ae22-2cb1e1b9269e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:35 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81f1a12e-265e-4146-8ad4-f9303d893de7 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa62492e-d239-4ad8-ae22-2cb1e1b9269e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2ec75bf-1040-4500-8f69-5de5a3aebc1a', 'volume_name': 'volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:35 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81f1a12e-265e-4146-8ad4-f9303d893de7 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c78eb4-91c0-4e50-9061-665ff36de93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:35 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81f1a12e-265e-4146-8ad4-f9303d893de7 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c78eb4-91c0-4e50-9061-665ff36de93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:35 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81f1a12e-265e-4146-8ad4-f9303d893de7 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (807111a6-bf49-4a70-af85-473cccbf23f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:35 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-81f1a12e-265e-4146-8ad4-f9303d893de7 tempest-ProjectMemberTests-1235695716 None] Volume c2ec75bf-1040-4500-8f69-5de5a3aebc1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a', 'volume_size': 1} Aug 10 13:09:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-81f1a12e-265e-4146-8ad4-f9303d893de7 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:09:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-81f1a12e-265e-4146-8ad4-f9303d893de7 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:09:35 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-81f1a12e-265e-4146-8ad4-f9303d893de7 tempest-ProjectMemberTests-1235695716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-373458910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2ec75bf-1040-4500-8f69-5de5a3aebc1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d23cdd2ebbe54bcca19b58803c9db992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:09:36Z,use_quota=True,user_id='ecda3994ec61480e95cadb77fda1aac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:09:35 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-81f1a12e-265e-4146-8ad4-f9303d893de7 tempest-ProjectMemberTests-1235695716 None] Creating volume c2ec75bf-1040-4500-8f69-5de5a3aebc1a {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:09:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-81f1a12e-265e-4146-8ad4-f9303d893de7 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:09:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-81f1a12e-265e-4146-8ad4-f9303d893de7 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:09:35 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-81f1a12e-265e-4146-8ad4-f9303d893de7 tempest-ProjectMemberTests-1235695716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:09:35 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-81f1a12e-265e-4146-8ad4-f9303d893de7 tempest-ProjectMemberTests-1235695716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:09:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-81f1a12e-265e-4146-8ad4-f9303d893de7 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:09:35 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-81f1a12e-265e-4146-8ad4-f9303d893de7 tempest-ProjectMemberTests-1235695716 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:09:35 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-81f1a12e-265e-4146-8ad4-f9303d893de7 tempest-ProjectMemberTests-1235695716 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:09:35 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-81f1a12e-265e-4146-8ad4-f9303d893de7 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:35 devstack sudo[110193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a 1073741824 Aug 10 13:09:35 devstack sudo[110193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:36 devstack sudo[110193]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-81f1a12e-265e-4146-8ad4-f9303d893de7 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a 1073741824" returned: 0 in 0.438s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-81f1a12e-265e-4146-8ad4-f9303d893de7 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:36 devstack sudo[110198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a Aug 10 13:09:36 devstack sudo[110198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:36 devstack sudo[110198]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-81f1a12e-265e-4146-8ad4-f9303d893de7 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a" returned: 0 in 0.250s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:36 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-81f1a12e-265e-4146-8ad4-f9303d893de7 tempest-ProjectMemberTests-1235695716 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:09:36 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-81f1a12e-265e-4146-8ad4-f9303d893de7 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:09:36 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81f1a12e-265e-4146-8ad4-f9303d893de7 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (807111a6-bf49-4a70-af85-473cccbf23f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:36 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81f1a12e-265e-4146-8ad4-f9303d893de7 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c73c9271-edb5-404d-a460-a737c8042674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:36 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-81f1a12e-265e-4146-8ad4-f9303d893de7 tempest-ProjectMemberTests-1235695716 None] Volume volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a (c2ec75bf-1040-4500-8f69-5de5a3aebc1a): created successfully Aug 10 13:09:36 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81f1a12e-265e-4146-8ad4-f9303d893de7 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c73c9271-edb5-404d-a460-a737c8042674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:36 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-81f1a12e-265e-4146-8ad4-f9303d893de7 tempest-ProjectMemberTests-1235695716 None] Flow 'volume_create_manager' (445569a8-9840-4943-b2a2-7ff4521b67b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:09:36 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-81f1a12e-265e-4146-8ad4-f9303d893de7 tempest-ProjectMemberTests-1235695716 None] Created volume successfully. Aug 10 13:09:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0e40bde9-150c-40fe-8219-24f2e116e551 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:09:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0e40bde9-150c-40fe-8219-24f2e116e551 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:09:37 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-0e40bde9-150c-40fe-8219-24f2e116e551 tempest-ProjectMemberTests-1235695716 None] Creating offline snapshot 0fcb5b3f-6df3-4cb4-864d-2d73196ee876 of volume c2ec75bf-1040-4500-8f69-5de5a3aebc1a {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 13:09:37 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbffcb6-2799-422b-99de-c9b528155529]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:09:37 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0e40bde9-150c-40fe-8219-24f2e116e551 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:38 devstack sudo[110201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a Aug 10 13:09:38 devstack sudo[110201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:38 devstack sudo[110201]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0e40bde9-150c-40fe-8219-24f2e116e551 tempest-ProjectMemberTests-1235695716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a" returned: 0 in 0.383s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0e40bde9-150c-40fe-8219-24f2e116e551 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a.0fcb5b3f-6df3-4cb4-864d-2d73196ee876 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:38 devstack sudo[110207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a.0fcb5b3f-6df3-4cb4-864d-2d73196ee876 1G Aug 10 13:09:38 devstack sudo[110207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:38 devstack sudo[110207]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0e40bde9-150c-40fe-8219-24f2e116e551 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a.0fcb5b3f-6df3-4cb4-864d-2d73196ee876 1G" returned: 0 in 0.418s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:38 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0e40bde9-150c-40fe-8219-24f2e116e551 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a.0fcb5b3f-6df3-4cb4-864d-2d73196ee876 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:38 devstack sudo[110213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a.0fcb5b3f-6df3-4cb4-864d-2d73196ee876 Aug 10 13:09:38 devstack sudo[110213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:39 devstack sudo[110213]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0e40bde9-150c-40fe-8219-24f2e116e551 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a.0fcb5b3f-6df3-4cb4-864d-2d73196ee876" returned: 0 in 0.400s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:39 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-0e40bde9-150c-40fe-8219-24f2e116e551 tempest-ProjectMemberTests-1235695716 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a.0fcb5b3f-6df3-4cb4-864d-2d73196ee876 is being set with open permissions: ugo+rw Aug 10 13:09:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0e40bde9-150c-40fe-8219-24f2e116e551 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a.0fcb5b3f-6df3-4cb4-864d-2d73196ee876 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:39 devstack sudo[110219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a.0fcb5b3f-6df3-4cb4-864d-2d73196ee876 Aug 10 13:09:39 devstack sudo[110219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:39 devstack sudo[110219]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0e40bde9-150c-40fe-8219-24f2e116e551 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a.0fcb5b3f-6df3-4cb4-864d-2d73196ee876" returned: 0 in 0.278s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0e40bde9-150c-40fe-8219-24f2e116e551 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:39 devstack sudo[110222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a.info Aug 10 13:09:39 devstack sudo[110222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:39 devstack sudo[110222]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0e40bde9-150c-40fe-8219-24f2e116e551 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a.info" returned: 0 in 0.265s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:39 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-0e40bde9-150c-40fe-8219-24f2e116e551 tempest-ProjectMemberTests-1235695716 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a.info is being set with open permissions: ugo+rw Aug 10 13:09:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0e40bde9-150c-40fe-8219-24f2e116e551 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:39 devstack sudo[110225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a.info Aug 10 13:09:39 devstack sudo[110225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:39 devstack sudo[110225]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:39 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0e40bde9-150c-40fe-8219-24f2e116e551 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a.info" returned: 0 in 0.246s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:40 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0e40bde9-150c-40fe-8219-24f2e116e551 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.089s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:09:40 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-0e40bde9-150c-40fe-8219-24f2e116e551 tempest-ProjectMemberTests-1235695716 None] Create snapshot completed successfully Aug 10 13:09:41 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-07533cf2-fe57-44c2-a769-eaa718bab186 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-0fcb5b3f-6df3-4cb4-864d-2d73196ee876-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:41 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-07533cf2-fe57-44c2-a769-eaa718bab186 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-0fcb5b3f-6df3-4cb4-864d-2d73196ee876-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:41 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-07533cf2-fe57-44c2-a769-eaa718bab186 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-quobyte-c2ec75bf-1040-4500-8f69-5de5a3aebc1a" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:41 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-07533cf2-fe57-44c2-a769-eaa718bab186 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-c2ec75bf-1040-4500-8f69-5de5a3aebc1a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:41 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-07533cf2-fe57-44c2-a769-eaa718bab186 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-quobyte-0fcb5b3f-6df3-4cb4-864d-2d73196ee876" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:41 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-07533cf2-fe57-44c2-a769-eaa718bab186 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-0fcb5b3f-6df3-4cb4-864d-2d73196ee876" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:41 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-07533cf2-fe57-44c2-a769-eaa718bab186 tempest-ProjectMemberTests-1235695716 None] Deleting offline snapshot 0fcb5b3f-6df3-4cb4-864d-2d73196ee876 of volume c2ec75bf-1040-4500-8f69-5de5a3aebc1a {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 13:09:41 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-07533cf2-fe57-44c2-a769-eaa718bab186 tempest-ProjectMemberTests-1235695716 None] snapshot_file for this snap is: volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a.0fcb5b3f-6df3-4cb4-864d-2d73196ee876 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 13:09:41 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5dfa78-3de3-42b4-a5cd-fe327b1728bb]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:09:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-07533cf2-fe57-44c2-a769-eaa718bab186 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a.0fcb5b3f-6df3-4cb4-864d-2d73196ee876 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:41 devstack sudo[110228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a.0fcb5b3f-6df3-4cb4-864d-2d73196ee876 Aug 10 13:09:41 devstack sudo[110228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:41 devstack sudo[110228]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-07533cf2-fe57-44c2-a769-eaa718bab186 tempest-ProjectMemberTests-1235695716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a.0fcb5b3f-6df3-4cb4-864d-2d73196ee876" returned: 0 in 0.411s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:41 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-07533cf2-fe57-44c2-a769-eaa718bab186 tempest-ProjectMemberTests-1235695716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 13:09:41 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6c785e-5ca7-4ce7-8d7e-d318444ad150]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:09:41 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-07533cf2-fe57-44c2-a769-eaa718bab186 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:41 devstack sudo[110234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a Aug 10 13:09:41 devstack sudo[110234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:42 devstack sudo[110234]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-07533cf2-fe57-44c2-a769-eaa718bab186 tempest-ProjectMemberTests-1235695716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a" returned: 0 in 0.379s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-07533cf2-fe57-44c2-a769-eaa718bab186 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a.0fcb5b3f-6df3-4cb4-864d-2d73196ee876 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:42 devstack sudo[110239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a.0fcb5b3f-6df3-4cb4-864d-2d73196ee876 Aug 10 13:09:42 devstack sudo[110239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:42 devstack sudo[110239]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-07533cf2-fe57-44c2-a769-eaa718bab186 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a.0fcb5b3f-6df3-4cb4-864d-2d73196ee876" returned: 0 in 0.374s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-07533cf2-fe57-44c2-a769-eaa718bab186 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a.0fcb5b3f-6df3-4cb4-864d-2d73196ee876 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:42 devstack sudo[110245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a.0fcb5b3f-6df3-4cb4-864d-2d73196ee876 Aug 10 13:09:42 devstack sudo[110245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:42 devstack sudo[110245]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:42 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-07533cf2-fe57-44c2-a769-eaa718bab186 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a.0fcb5b3f-6df3-4cb4-864d-2d73196ee876" returned: 0 in 0.258s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:42 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-07533cf2-fe57-44c2-a769-eaa718bab186 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-0fcb5b3f-6df3-4cb4-864d-2d73196ee876" released by "_delete_snapshot" :: held 1.559s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:42 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-07533cf2-fe57-44c2-a769-eaa718bab186 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-c2ec75bf-1040-4500-8f69-5de5a3aebc1a" released by "delete_snapshot" :: held 1.586s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:42 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=140,cinder:INSERT=61,cinder:UPDATE=187,cinder:DELETE=14 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 13:09:42 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:INSERT=42,cinder:UPDATE=198,cinder:SELECT=152,cinder:DELETE=18 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 13:09:42 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-07533cf2-fe57-44c2-a769-eaa718bab186 tempest-ProjectMemberTests-1235695716 None] Created reservations ['827ea117-c3f5-40a0-a2fd-98e1286257dd', 'c01e272f-268a-4592-a3f0-29c11c371ed4', 'b53a3f19-7781-452d-aff7-5d6afd76c3dd', 'a30c5267-6671-4167-a678-cb236d271b4a'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:09:42 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-07533cf2-fe57-44c2-a769-eaa718bab186 tempest-ProjectMemberTests-1235695716 None] Delete snapshot completed successfully. Aug 10 13:09:42 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-07533cf2-fe57-44c2-a769-eaa718bab186 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-0fcb5b3f-6df3-4cb4-864d-2d73196ee876-delete_snapshot" released by "delete_snapshot" :: held 1.734s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:43 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e6137dae-8647-41f4-8a32-65adfb84039e tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-c2ec75bf-1040-4500-8f69-5de5a3aebc1a-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:43 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e6137dae-8647-41f4-8a32-65adfb84039e tempest-ProjectMemberTests-1235695716 None] Lock "cinder-c2ec75bf-1040-4500-8f69-5de5a3aebc1a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:43 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e6137dae-8647-41f4-8a32-65adfb84039e tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-quobyte-c2ec75bf-1040-4500-8f69-5de5a3aebc1a" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:43 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e6137dae-8647-41f4-8a32-65adfb84039e tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-c2ec75bf-1040-4500-8f69-5de5a3aebc1a" acquired by "delete_volume" :: waited 0.019s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:43 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f983ad-5a6b-4443-ad53-70529d398e6d]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:09:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e6137dae-8647-41f4-8a32-65adfb84039e tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:43 devstack sudo[110248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a Aug 10 13:09:43 devstack sudo[110248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:43 devstack sudo[110248]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e6137dae-8647-41f4-8a32-65adfb84039e tempest-ProjectMemberTests-1235695716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a" returned: 0 in 0.368s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:43 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e6137dae-8647-41f4-8a32-65adfb84039e tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:43 devstack sudo[110254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a Aug 10 13:09:43 devstack sudo[110254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:44 devstack sudo[110254]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e6137dae-8647-41f4-8a32-65adfb84039e tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-c2ec75bf-1040-4500-8f69-5de5a3aebc1a" returned: 0 in 0.260s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:44 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e6137dae-8647-41f4-8a32-65adfb84039e tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-c2ec75bf-1040-4500-8f69-5de5a3aebc1a" released by "delete_volume" :: held 0.687s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:44 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-e6137dae-8647-41f4-8a32-65adfb84039e tempest-ProjectMemberTests-1235695716 None] Created reservations ['4e549987-dbfe-4529-b25b-6e114fce3d66', '12e52fab-d115-4aba-8585-2d796692356e', 'fb581a17-a2f8-4533-9615-a9d91d1d0b4b', '6cd5fc90-18ca-44f1-9766-228ab126fe54'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:09:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e6137dae-8647-41f4-8a32-65adfb84039e tempest-ProjectMemberTests-1235695716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:09:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e6137dae-8647-41f4-8a32-65adfb84039e tempest-ProjectMemberTests-1235695716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:09:44 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e6137dae-8647-41f4-8a32-65adfb84039e tempest-ProjectMemberTests-1235695716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:09:44 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-e6137dae-8647-41f4-8a32-65adfb84039e tempest-ProjectMemberTests-1235695716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:09:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-e6137dae-8647-41f4-8a32-65adfb84039e tempest-ProjectMemberTests-1235695716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:09:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e6137dae-8647-41f4-8a32-65adfb84039e tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:44 devstack sudo[110257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:09:44 devstack sudo[110257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:44 devstack sudo[110257]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:44 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-e6137dae-8647-41f4-8a32-65adfb84039e tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.264s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:44 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-e6137dae-8647-41f4-8a32-65adfb84039e tempest-ProjectMemberTests-1235695716 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:09:44 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-e6137dae-8647-41f4-8a32-65adfb84039e tempest-ProjectMemberTests-1235695716 None] Deleted volume successfully. Aug 10 13:09:44 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-e6137dae-8647-41f4-8a32-65adfb84039e tempest-ProjectMemberTests-1235695716 None] Lock "cinder-c2ec75bf-1040-4500-8f69-5de5a3aebc1a-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:44 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a05bf84-cc4d-49fd-be02-61118ea1f632 tempest-ProjectMemberTests-1235695716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:09:44 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a05bf84-cc4d-49fd-be02-61118ea1f632 tempest-ProjectMemberTests-1235695716 None] Flow 'volume_create_manager' (90f42b63-3916-427d-b773-3cebcfa61790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:09:44 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a05bf84-cc4d-49fd-be02-61118ea1f632 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2725cb8-5c47-4c04-96f3-24154e5e77b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a05bf84-cc4d-49fd-be02-61118ea1f632 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2725cb8-5c47-4c04-96f3-24154e5e77b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1954486398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dd0bd86-0586-40ae-846b-88178aec9820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d23cdd2ebbe54bcca19b58803c9db992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:09:45Z,use_quota=True,user_id='ecda3994ec61480e95cadb77fda1aac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a05bf84-cc4d-49fd-be02-61118ea1f632 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed2064a8-5c26-4c9e-8ab1-677773526737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a05bf84-cc4d-49fd-be02-61118ea1f632 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed2064a8-5c26-4c9e-8ab1-677773526737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a05bf84-cc4d-49fd-be02-61118ea1f632 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e30d86-d5b2-4669-8e21-aa55078b6f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a05bf84-cc4d-49fd-be02-61118ea1f632 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e30d86-d5b2-4669-8e21-aa55078b6f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dd0bd86-0586-40ae-846b-88178aec9820', 'volume_name': 'volume-4dd0bd86-0586-40ae-846b-88178aec9820', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a05bf84-cc4d-49fd-be02-61118ea1f632 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b11cd2-129e-46b5-988d-b39dfd7a34d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a05bf84-cc4d-49fd-be02-61118ea1f632 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b11cd2-129e-46b5-988d-b39dfd7a34d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a05bf84-cc4d-49fd-be02-61118ea1f632 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4d2ace1-b53d-48e1-b168-1b5730991410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:45 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-1a05bf84-cc4d-49fd-be02-61118ea1f632 tempest-ProjectMemberTests-1235695716 None] Volume 4dd0bd86-0586-40ae-846b-88178aec9820: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dd0bd86-0586-40ae-846b-88178aec9820', 'volume_size': 1} Aug 10 13:09:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1a05bf84-cc4d-49fd-be02-61118ea1f632 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:09:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1a05bf84-cc4d-49fd-be02-61118ea1f632 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:09:45 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1a05bf84-cc4d-49fd-be02-61118ea1f632 tempest-ProjectMemberTests-1235695716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1954486398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dd0bd86-0586-40ae-846b-88178aec9820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d23cdd2ebbe54bcca19b58803c9db992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:09:45Z,use_quota=True,user_id='ecda3994ec61480e95cadb77fda1aac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:09:45 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-1a05bf84-cc4d-49fd-be02-61118ea1f632 tempest-ProjectMemberTests-1235695716 None] Creating volume 4dd0bd86-0586-40ae-846b-88178aec9820 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:09:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1a05bf84-cc4d-49fd-be02-61118ea1f632 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:09:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1a05bf84-cc4d-49fd-be02-61118ea1f632 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:09:45 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1a05bf84-cc4d-49fd-be02-61118ea1f632 tempest-ProjectMemberTests-1235695716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:09:45 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1a05bf84-cc4d-49fd-be02-61118ea1f632 tempest-ProjectMemberTests-1235695716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:09:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1a05bf84-cc4d-49fd-be02-61118ea1f632 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:09:45 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1a05bf84-cc4d-49fd-be02-61118ea1f632 tempest-ProjectMemberTests-1235695716 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:09:45 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-1a05bf84-cc4d-49fd-be02-61118ea1f632 tempest-ProjectMemberTests-1235695716 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:09:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1a05bf84-cc4d-49fd-be02-61118ea1f632 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:45 devstack sudo[110266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820 1073741824 Aug 10 13:09:45 devstack sudo[110266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:45 devstack sudo[110266]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1a05bf84-cc4d-49fd-be02-61118ea1f632 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820 1073741824" returned: 0 in 0.506s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1a05bf84-cc4d-49fd-be02-61118ea1f632 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:45 devstack sudo[110271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820 Aug 10 13:09:45 devstack sudo[110271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:45 devstack sudo[110271]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-1a05bf84-cc4d-49fd-be02-61118ea1f632 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820" returned: 0 in 0.314s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:45 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-1a05bf84-cc4d-49fd-be02-61118ea1f632 tempest-ProjectMemberTests-1235695716 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:09:45 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-1a05bf84-cc4d-49fd-be02-61118ea1f632 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:09:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a05bf84-cc4d-49fd-be02-61118ea1f632 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4d2ace1-b53d-48e1-b168-1b5730991410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dd0bd86-0586-40ae-846b-88178aec9820', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a05bf84-cc4d-49fd-be02-61118ea1f632 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46210824-7fce-457d-bdd8-695f55424aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:45 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-1a05bf84-cc4d-49fd-be02-61118ea1f632 tempest-ProjectMemberTests-1235695716 None] Volume volume-4dd0bd86-0586-40ae-846b-88178aec9820 (4dd0bd86-0586-40ae-846b-88178aec9820): created successfully Aug 10 13:09:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a05bf84-cc4d-49fd-be02-61118ea1f632 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46210824-7fce-457d-bdd8-695f55424aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:45 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-1a05bf84-cc4d-49fd-be02-61118ea1f632 tempest-ProjectMemberTests-1235695716 None] Flow 'volume_create_manager' (90f42b63-3916-427d-b773-3cebcfa61790) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:09:46 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-1a05bf84-cc4d-49fd-be02-61118ea1f632 tempest-ProjectMemberTests-1235695716 None] Created volume successfully. Aug 10 13:09:46 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef7078d6-5a14-4345-b367-f572951d5f19 tempest-SnapshotDependencyTests-1802238765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:09:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ef7078d6-5a14-4345-b367-f572951d5f19 tempest-SnapshotDependencyTests-1802238765 None] Flow 'volume_create_manager' (12a1519c-bd01-4874-a9cd-64eafd599d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:09:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ef7078d6-5a14-4345-b367-f572951d5f19 tempest-SnapshotDependencyTests-1802238765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fb37471-c124-4bcf-b801-8dae9bf44cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ef7078d6-5a14-4345-b367-f572951d5f19 tempest-SnapshotDependencyTests-1802238765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fb37471-c124-4bcf-b801-8dae9bf44cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-765732763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55ac6633-ed69-4bf1-9566-d9d7c9ca2cab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45580377ddf54a22afc1d0e3e2f4bb50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:09:46Z,use_quota=True,user_id='23a6c216e1a7453fbfd1f043383832d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ef7078d6-5a14-4345-b367-f572951d5f19 tempest-SnapshotDependencyTests-1802238765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8476eea-0d2b-4d01-bcb5-52db89a4d2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ef7078d6-5a14-4345-b367-f572951d5f19 tempest-SnapshotDependencyTests-1802238765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8476eea-0d2b-4d01-bcb5-52db89a4d2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ef7078d6-5a14-4345-b367-f572951d5f19 tempest-SnapshotDependencyTests-1802238765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (477bad33-d3b0-49d0-bdcc-16b85b909b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ef7078d6-5a14-4345-b367-f572951d5f19 tempest-SnapshotDependencyTests-1802238765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (477bad33-d3b0-49d0-bdcc-16b85b909b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55ac6633-ed69-4bf1-9566-d9d7c9ca2cab', 'volume_name': 'volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ef7078d6-5a14-4345-b367-f572951d5f19 tempest-SnapshotDependencyTests-1802238765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94119e75-159b-4e40-bbda-7a60b26fbd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ef7078d6-5a14-4345-b367-f572951d5f19 tempest-SnapshotDependencyTests-1802238765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94119e75-159b-4e40-bbda-7a60b26fbd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:46 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ef7078d6-5a14-4345-b367-f572951d5f19 tempest-SnapshotDependencyTests-1802238765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fed95e3-520f-407a-8789-bc465848889a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:46 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-ef7078d6-5a14-4345-b367-f572951d5f19 tempest-SnapshotDependencyTests-1802238765 None] Volume 55ac6633-ed69-4bf1-9566-d9d7c9ca2cab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab', 'volume_size': 1} Aug 10 13:09:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ef7078d6-5a14-4345-b367-f572951d5f19 tempest-SnapshotDependencyTests-1802238765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:09:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ef7078d6-5a14-4345-b367-f572951d5f19 tempest-SnapshotDependencyTests-1802238765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:09:46 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ef7078d6-5a14-4345-b367-f572951d5f19 tempest-SnapshotDependencyTests-1802238765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-765732763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55ac6633-ed69-4bf1-9566-d9d7c9ca2cab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45580377ddf54a22afc1d0e3e2f4bb50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:09:46Z,use_quota=True,user_id='23a6c216e1a7453fbfd1f043383832d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:09:46 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-ef7078d6-5a14-4345-b367-f572951d5f19 tempest-SnapshotDependencyTests-1802238765 None] Creating volume 55ac6633-ed69-4bf1-9566-d9d7c9ca2cab {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:09:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ef7078d6-5a14-4345-b367-f572951d5f19 tempest-SnapshotDependencyTests-1802238765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:09:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ef7078d6-5a14-4345-b367-f572951d5f19 tempest-SnapshotDependencyTests-1802238765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:09:46 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ef7078d6-5a14-4345-b367-f572951d5f19 tempest-SnapshotDependencyTests-1802238765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:09:46 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ef7078d6-5a14-4345-b367-f572951d5f19 tempest-SnapshotDependencyTests-1802238765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:09:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ef7078d6-5a14-4345-b367-f572951d5f19 tempest-SnapshotDependencyTests-1802238765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:09:46 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ef7078d6-5a14-4345-b367-f572951d5f19 tempest-SnapshotDependencyTests-1802238765 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:09:46 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-ef7078d6-5a14-4345-b367-f572951d5f19 tempest-SnapshotDependencyTests-1802238765 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:09:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ef7078d6-5a14-4345-b367-f572951d5f19 tempest-SnapshotDependencyTests-1802238765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:46 devstack sudo[110274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab 1073741824 Aug 10 13:09:46 devstack sudo[110274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:46 devstack sudo[110274]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:46 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ef7078d6-5a14-4345-b367-f572951d5f19 tempest-SnapshotDependencyTests-1802238765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab 1073741824" returned: 0 in 0.438s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ef7078d6-5a14-4345-b367-f572951d5f19 tempest-SnapshotDependencyTests-1802238765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:47 devstack sudo[110279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab Aug 10 13:09:47 devstack sudo[110279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-460c6d89-a405-499b-b74d-fc9c46190f39 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:09:47 devstack sudo[110279]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ef7078d6-5a14-4345-b367-f572951d5f19 tempest-SnapshotDependencyTests-1802238765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab" returned: 0 in 0.256s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:47 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-ef7078d6-5a14-4345-b367-f572951d5f19 tempest-SnapshotDependencyTests-1802238765 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:09:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-ef7078d6-5a14-4345-b367-f572951d5f19 tempest-SnapshotDependencyTests-1802238765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:09:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-460c6d89-a405-499b-b74d-fc9c46190f39 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.052s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:09:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ef7078d6-5a14-4345-b367-f572951d5f19 tempest-SnapshotDependencyTests-1802238765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fed95e3-520f-407a-8789-bc465848889a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ef7078d6-5a14-4345-b367-f572951d5f19 tempest-SnapshotDependencyTests-1802238765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c05355-a577-435b-93d7-998b7f1235f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:47 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-460c6d89-a405-499b-b74d-fc9c46190f39 tempest-ProjectMemberTests-1235695716 None] Creating offline snapshot 2d7f75ff-4633-4ac0-af04-ab6416027a2e of volume 4dd0bd86-0586-40ae-846b-88178aec9820 {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 13:09:47 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-ef7078d6-5a14-4345-b367-f572951d5f19 tempest-SnapshotDependencyTests-1802238765 None] Volume volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab (55ac6633-ed69-4bf1-9566-d9d7c9ca2cab): created successfully Aug 10 13:09:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ef7078d6-5a14-4345-b367-f572951d5f19 tempest-SnapshotDependencyTests-1802238765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c05355-a577-435b-93d7-998b7f1235f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:47 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-ef7078d6-5a14-4345-b367-f572951d5f19 tempest-SnapshotDependencyTests-1802238765 None] Flow 'volume_create_manager' (12a1519c-bd01-4874-a9cd-64eafd599d3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:09:47 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6ca829-1fa9-45d7-8d1a-83b48f0c08d4]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:09:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-460c6d89-a405-499b-b74d-fc9c46190f39 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:47 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-ef7078d6-5a14-4345-b367-f572951d5f19 tempest-SnapshotDependencyTests-1802238765 None] Created volume successfully. Aug 10 13:09:47 devstack sudo[110282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820 Aug 10 13:09:47 devstack sudo[110282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:47 devstack sudo[110282]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-460c6d89-a405-499b-b74d-fc9c46190f39 tempest-ProjectMemberTests-1235695716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820" returned: 0 in 0.358s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:47 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-460c6d89-a405-499b-b74d-fc9c46190f39 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820.2d7f75ff-4633-4ac0-af04-ab6416027a2e 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:47 devstack sudo[110287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820.2d7f75ff-4633-4ac0-af04-ab6416027a2e 1G Aug 10 13:09:47 devstack sudo[110287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:48 devstack sudo[110287]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-460c6d89-a405-499b-b74d-fc9c46190f39 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820.2d7f75ff-4633-4ac0-af04-ab6416027a2e 1G" returned: 0 in 0.371s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-460c6d89-a405-499b-b74d-fc9c46190f39 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dd0bd86-0586-40ae-846b-88178aec9820 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820.2d7f75ff-4633-4ac0-af04-ab6416027a2e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:48 devstack sudo[110293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dd0bd86-0586-40ae-846b-88178aec9820 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820.2d7f75ff-4633-4ac0-af04-ab6416027a2e Aug 10 13:09:48 devstack sudo[110293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:48 devstack sudo[110293]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-460c6d89-a405-499b-b74d-fc9c46190f39 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dd0bd86-0586-40ae-846b-88178aec9820 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820.2d7f75ff-4633-4ac0-af04-ab6416027a2e" returned: 0 in 0.291s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:48 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-460c6d89-a405-499b-b74d-fc9c46190f39 tempest-ProjectMemberTests-1235695716 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820.2d7f75ff-4633-4ac0-af04-ab6416027a2e is being set with open permissions: ugo+rw Aug 10 13:09:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-460c6d89-a405-499b-b74d-fc9c46190f39 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820.2d7f75ff-4633-4ac0-af04-ab6416027a2e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:48 devstack sudo[110298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820.2d7f75ff-4633-4ac0-af04-ab6416027a2e Aug 10 13:09:48 devstack sudo[110298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:48 devstack sudo[110298]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-460c6d89-a405-499b-b74d-fc9c46190f39 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820.2d7f75ff-4633-4ac0-af04-ab6416027a2e" returned: 0 in 0.250s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-460c6d89-a405-499b-b74d-fc9c46190f39 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:48 devstack sudo[110301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820.info Aug 10 13:09:48 devstack sudo[110301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-dec3805c-fc67-4d3d-9613-b30f17230c9c tempest-SnapshotDependencyTests-1802238765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:09:48 devstack sudo[110301]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-460c6d89-a405-499b-b74d-fc9c46190f39 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820.info" returned: 0 in 0.252s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:48 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-460c6d89-a405-499b-b74d-fc9c46190f39 tempest-ProjectMemberTests-1235695716 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820.info is being set with open permissions: ugo+rw Aug 10 13:09:48 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-460c6d89-a405-499b-b74d-fc9c46190f39 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:48 devstack sudo[110304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820.info Aug 10 13:09:48 devstack sudo[110304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:49 devstack sudo[110304]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-460c6d89-a405-499b-b74d-fc9c46190f39 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820.info" returned: 0 in 0.238s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-460c6d89-a405-499b-b74d-fc9c46190f39 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.902s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:09:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-dec3805c-fc67-4d3d-9613-b30f17230c9c tempest-SnapshotDependencyTests-1802238765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.459s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:09:49 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-dec3805c-fc67-4d3d-9613-b30f17230c9c tempest-SnapshotDependencyTests-1802238765 None] Creating offline snapshot e3f71c56-b1db-4369-b9e2-6d315e733d05 of volume 55ac6633-ed69-4bf1-9566-d9d7c9ca2cab {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 13:09:49 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-460c6d89-a405-499b-b74d-fc9c46190f39 tempest-ProjectMemberTests-1235695716 None] Create snapshot completed successfully Aug 10 13:09:49 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ccb8f3-636d-4a26-8c8d-8a50601ce140]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:09:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dec3805c-fc67-4d3d-9613-b30f17230c9c tempest-SnapshotDependencyTests-1802238765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:49 devstack sudo[110308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab Aug 10 13:09:49 devstack sudo[110308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:49 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a049623f-e7b1-4ab3-b4ab-7c31379e9bae tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-2d7f75ff-4633-4ac0-af04-ab6416027a2e-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:49 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a049623f-e7b1-4ab3-b4ab-7c31379e9bae tempest-ProjectMemberTests-1235695716 None] Lock "cinder-2d7f75ff-4633-4ac0-af04-ab6416027a2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:49 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a049623f-e7b1-4ab3-b4ab-7c31379e9bae tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-quobyte-4dd0bd86-0586-40ae-846b-88178aec9820" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:49 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a049623f-e7b1-4ab3-b4ab-7c31379e9bae tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-4dd0bd86-0586-40ae-846b-88178aec9820" acquired by "delete_snapshot" :: waited 0.015s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:49 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a049623f-e7b1-4ab3-b4ab-7c31379e9bae tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-quobyte-2d7f75ff-4633-4ac0-af04-ab6416027a2e" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:49 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a049623f-e7b1-4ab3-b4ab-7c31379e9bae tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-2d7f75ff-4633-4ac0-af04-ab6416027a2e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:49 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-a049623f-e7b1-4ab3-b4ab-7c31379e9bae tempest-ProjectMemberTests-1235695716 None] Deleting offline snapshot 2d7f75ff-4633-4ac0-af04-ab6416027a2e of volume 4dd0bd86-0586-40ae-846b-88178aec9820 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 13:09:49 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-a049623f-e7b1-4ab3-b4ab-7c31379e9bae tempest-ProjectMemberTests-1235695716 None] snapshot_file for this snap is: volume-4dd0bd86-0586-40ae-846b-88178aec9820.2d7f75ff-4633-4ac0-af04-ab6416027a2e {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 13:09:49 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bdb7e8-f15f-445f-aa5c-4a51a72c3a90]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:09:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a049623f-e7b1-4ab3-b4ab-7c31379e9bae tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820.2d7f75ff-4633-4ac0-af04-ab6416027a2e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:49 devstack sudo[110310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820.2d7f75ff-4633-4ac0-af04-ab6416027a2e Aug 10 13:09:49 devstack sudo[110310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:49 devstack sudo[110308]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dec3805c-fc67-4d3d-9613-b30f17230c9c tempest-SnapshotDependencyTests-1802238765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab" returned: 0 in 0.394s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dec3805c-fc67-4d3d-9613-b30f17230c9c tempest-SnapshotDependencyTests-1802238765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab.e3f71c56-b1db-4369-b9e2-6d315e733d05 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:49 devstack sudo[110315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab.e3f71c56-b1db-4369-b9e2-6d315e733d05 1G Aug 10 13:09:49 devstack sudo[110315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:49 devstack sudo[110310]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a049623f-e7b1-4ab3-b4ab-7c31379e9bae tempest-ProjectMemberTests-1235695716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820.2d7f75ff-4633-4ac0-af04-ab6416027a2e" returned: 0 in 0.372s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:49 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-a049623f-e7b1-4ab3-b4ab-7c31379e9bae tempest-ProjectMemberTests-1235695716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4dd0bd86-0586-40ae-846b-88178aec9820(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 13:09:49 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aac12a3-113d-4837-bc76-c73f91aabc62]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:09:49 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a049623f-e7b1-4ab3-b4ab-7c31379e9bae tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:49 devstack sudo[110322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820 Aug 10 13:09:49 devstack sudo[110322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:50 devstack sudo[110315]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dec3805c-fc67-4d3d-9613-b30f17230c9c tempest-SnapshotDependencyTests-1802238765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab.e3f71c56-b1db-4369-b9e2-6d315e733d05 1G" returned: 0 in 0.414s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dec3805c-fc67-4d3d-9613-b30f17230c9c tempest-SnapshotDependencyTests-1802238765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab.e3f71c56-b1db-4369-b9e2-6d315e733d05 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:50 devstack sudo[110326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab.e3f71c56-b1db-4369-b9e2-6d315e733d05 Aug 10 13:09:50 devstack sudo[110326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:50 devstack sudo[110322]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a049623f-e7b1-4ab3-b4ab-7c31379e9bae tempest-ProjectMemberTests-1235695716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820" returned: 0 in 0.365s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a049623f-e7b1-4ab3-b4ab-7c31379e9bae tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820.2d7f75ff-4633-4ac0-af04-ab6416027a2e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:50 devstack sudo[110331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820.2d7f75ff-4633-4ac0-af04-ab6416027a2e Aug 10 13:09:50 devstack sudo[110331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:50 devstack sudo[110326]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dec3805c-fc67-4d3d-9613-b30f17230c9c tempest-SnapshotDependencyTests-1802238765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab.e3f71c56-b1db-4369-b9e2-6d315e733d05" returned: 0 in 0.300s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:50 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-dec3805c-fc67-4d3d-9613-b30f17230c9c tempest-SnapshotDependencyTests-1802238765 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab.e3f71c56-b1db-4369-b9e2-6d315e733d05 is being set with open permissions: ugo+rw Aug 10 13:09:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dec3805c-fc67-4d3d-9613-b30f17230c9c tempest-SnapshotDependencyTests-1802238765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab.e3f71c56-b1db-4369-b9e2-6d315e733d05 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:50 devstack sudo[110336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab.e3f71c56-b1db-4369-b9e2-6d315e733d05 Aug 10 13:09:50 devstack sudo[110336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:50 devstack sudo[110331]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a049623f-e7b1-4ab3-b4ab-7c31379e9bae tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820.2d7f75ff-4633-4ac0-af04-ab6416027a2e" returned: 0 in 0.358s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a049623f-e7b1-4ab3-b4ab-7c31379e9bae tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820.2d7f75ff-4633-4ac0-af04-ab6416027a2e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:50 devstack sudo[110342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820.2d7f75ff-4633-4ac0-af04-ab6416027a2e Aug 10 13:09:50 devstack sudo[110342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:50 devstack sudo[110336]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dec3805c-fc67-4d3d-9613-b30f17230c9c tempest-SnapshotDependencyTests-1802238765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab.e3f71c56-b1db-4369-b9e2-6d315e733d05" returned: 0 in 0.285s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dec3805c-fc67-4d3d-9613-b30f17230c9c tempest-SnapshotDependencyTests-1802238765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:50 devstack sudo[110344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab.info Aug 10 13:09:50 devstack sudo[110344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:50 devstack sudo[110342]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-a049623f-e7b1-4ab3-b4ab-7c31379e9bae tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820.2d7f75ff-4633-4ac0-af04-ab6416027a2e" returned: 0 in 0.271s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:50 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a049623f-e7b1-4ab3-b4ab-7c31379e9bae tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-2d7f75ff-4633-4ac0-af04-ab6416027a2e" released by "_delete_snapshot" :: held 1.462s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:50 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a049623f-e7b1-4ab3-b4ab-7c31379e9bae tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-4dd0bd86-0586-40ae-846b-88178aec9820" released by "delete_snapshot" :: held 1.481s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:50 devstack sudo[110344]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dec3805c-fc67-4d3d-9613-b30f17230c9c tempest-SnapshotDependencyTests-1802238765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab.info" returned: 0 in 0.283s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:50 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-dec3805c-fc67-4d3d-9613-b30f17230c9c tempest-SnapshotDependencyTests-1802238765 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab.info is being set with open permissions: ugo+rw Aug 10 13:09:50 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dec3805c-fc67-4d3d-9613-b30f17230c9c tempest-SnapshotDependencyTests-1802238765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:50 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-a049623f-e7b1-4ab3-b4ab-7c31379e9bae tempest-ProjectMemberTests-1235695716 None] Created reservations ['b9d957a9-208f-4cdc-a2b2-6c01ce9f3117', 'c19a0199-f2f9-45e0-b85e-50b3ab566500', '68b90470-7378-48bd-8c16-cff927ffdba5', 'dbc824c7-6bf1-4a9e-a90f-ffca0a728132'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:09:50 devstack sudo[110348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab.info Aug 10 13:09:50 devstack sudo[110348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:51 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-a049623f-e7b1-4ab3-b4ab-7c31379e9bae tempest-ProjectMemberTests-1235695716 None] Delete snapshot completed successfully. Aug 10 13:09:51 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-a049623f-e7b1-4ab3-b4ab-7c31379e9bae tempest-ProjectMemberTests-1235695716 None] Lock "cinder-2d7f75ff-4633-4ac0-af04-ab6416027a2e-delete_snapshot" released by "delete_snapshot" :: held 1.633s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:51 devstack sudo[110348]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-dec3805c-fc67-4d3d-9613-b30f17230c9c tempest-SnapshotDependencyTests-1802238765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab.info" returned: 0 in 0.269s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-dec3805c-fc67-4d3d-9613-b30f17230c9c tempest-SnapshotDependencyTests-1802238765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.041s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:09:51 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-dec3805c-fc67-4d3d-9613-b30f17230c9c tempest-SnapshotDependencyTests-1802238765 None] Create snapshot completed successfully Aug 10 13:09:51 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2ca6cdff-9c87-4bfa-a07f-2349a8c50c4a tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-4dd0bd86-0586-40ae-846b-88178aec9820-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:51 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2ca6cdff-9c87-4bfa-a07f-2349a8c50c4a tempest-ProjectMemberTests-1235695716 None] Lock "cinder-4dd0bd86-0586-40ae-846b-88178aec9820-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:51 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2ca6cdff-9c87-4bfa-a07f-2349a8c50c4a tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-quobyte-4dd0bd86-0586-40ae-846b-88178aec9820" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:51 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2ca6cdff-9c87-4bfa-a07f-2349a8c50c4a tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-4dd0bd86-0586-40ae-846b-88178aec9820" acquired by "delete_volume" :: waited 0.016s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:51 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe3a11a-e983-4460-bdc5-af5b906ab138]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:09:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2ca6cdff-9c87-4bfa-a07f-2349a8c50c4a tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:51 devstack sudo[110351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820 Aug 10 13:09:51 devstack sudo[110351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:51 devstack sudo[110351]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2ca6cdff-9c87-4bfa-a07f-2349a8c50c4a tempest-ProjectMemberTests-1235695716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820" returned: 0 in 0.369s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:51 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2ca6cdff-9c87-4bfa-a07f-2349a8c50c4a tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:52 devstack sudo[110356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820 Aug 10 13:09:52 devstack sudo[110356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:52 devstack sudo[110356]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2ca6cdff-9c87-4bfa-a07f-2349a8c50c4a tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-4dd0bd86-0586-40ae-846b-88178aec9820" returned: 0 in 0.252s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2ca6cdff-9c87-4bfa-a07f-2349a8c50c4a tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-4dd0bd86-0586-40ae-846b-88178aec9820" released by "delete_volume" :: held 0.684s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-2ca6cdff-9c87-4bfa-a07f-2349a8c50c4a tempest-ProjectMemberTests-1235695716 None] Created reservations ['73fdf917-6dbb-4d98-a0ea-c74806fe4928', '72e3b56d-4f5e-473e-8232-6f24453afd98', 'eac894cc-7d3c-400b-bbb6-49d595a99fe0', '4403e4e9-5b2e-4b6c-8e1a-4a04c32e3f3e'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2ca6cdff-9c87-4bfa-a07f-2349a8c50c4a tempest-ProjectMemberTests-1235695716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2ca6cdff-9c87-4bfa-a07f-2349a8c50c4a tempest-ProjectMemberTests-1235695716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-2ca6cdff-9c87-4bfa-a07f-2349a8c50c4a tempest-ProjectMemberTests-1235695716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-2ca6cdff-9c87-4bfa-a07f-2349a8c50c4a tempest-ProjectMemberTests-1235695716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-2ca6cdff-9c87-4bfa-a07f-2349a8c50c4a tempest-ProjectMemberTests-1235695716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2ca6cdff-9c87-4bfa-a07f-2349a8c50c4a tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:52 devstack sudo[110359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:09:52 devstack sudo[110359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Flow 'volume_create_manager' (bce2137e-0dd8-4088-872f-6080b6066b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e12f3c94-a4fd-48f6-bac8-3358b01a7d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e12f3c94-a4fd-48f6-bac8-3358b01a7d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac7c4684-5bb8-468f-a88c-d673f0a49370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45580377ddf54a22afc1d0e3e2f4bb50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e3f71c56-b1db-4369-b9e2-6d315e733d05,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:09:52Z,use_quota=True,user_id='23a6c216e1a7453fbfd1f043383832d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ea8725d-4a53-4ff0-8020-cecbf23bf026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ea8725d-4a53-4ff0-8020-cecbf23bf026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9564b0a5-806c-4231-922c-52dca4119b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9564b0a5-806c-4231-922c-52dca4119b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ac7c4684-5bb8-468f-a88c-d673f0a49370', 'volume_name': 'volume-ac7c4684-5bb8-468f-a88c-d673f0a49370', 'volume_size': 1, 'snapshot_id': 'e3f71c56-b1db-4369-b9e2-6d315e733d05'}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5bef08e-4b86-4032-89f3-f9619aa8928c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5bef08e-4b86-4032-89f3-f9619aa8928c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a674bb5-2616-4312-963c-fd6265f5f519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:52 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Volume ac7c4684-5bb8-468f-a88c-d673f0a49370: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ac7c4684-5bb8-468f-a88c-d673f0a49370', 'volume_size': 1, 'snapshot_id': 'e3f71c56-b1db-4369-b9e2-6d315e733d05'} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Acquiring lock "cinder-quobyte-e3f71c56-b1db-4369-b9e2-6d315e733d05-ac7c4684-5bb8-468f-a88c-d673f0a49370" by "_create_volume_from_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Lock "cinder-quobyte-e3f71c56-b1db-4369-b9e2-6d315e733d05-ac7c4684-5bb8-468f-a88c-d673f0a49370" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Creating volume ac7c4684-5bb8-468f-a88c-d673f0a49370 from snapshot e3f71c56-b1db-4369-b9e2-6d315e733d05 {{(pid=89096) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Acquiring lock "cinder-quobyte-ac7c4684-5bb8-468f-a88c-d673f0a49370" by "_copy_volume_from_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Lock "cinder-quobyte-ac7c4684-5bb8-468f-a88c-d673f0a49370" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] snapshot: e3f71c56-b1db-4369-b9e2-6d315e733d05, volume: ac7c4684-5bb8-468f-a88c-d673f0a49370, {{(pid=89096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:09:52 devstack sudo[110359]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41f30e0-ae37-487f-81c7-25cfedb00ddd]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-2ca6cdff-9c87-4bfa-a07f-2349a8c50c4a tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.274s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab.e3f71c56-b1db-4369-b9e2-6d315e733d05 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-2ca6cdff-9c87-4bfa-a07f-2349a8c50c4a tempest-ProjectMemberTests-1235695716 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:09:52 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-2ca6cdff-9c87-4bfa-a07f-2349a8c50c4a tempest-ProjectMemberTests-1235695716 None] Deleted volume successfully. Aug 10 13:09:52 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-2ca6cdff-9c87-4bfa-a07f-2349a8c50c4a tempest-ProjectMemberTests-1235695716 None] Lock "cinder-4dd0bd86-0586-40ae-846b-88178aec9820-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:52 devstack sudo[110362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab.e3f71c56-b1db-4369-b9e2-6d315e733d05 Aug 10 13:09:52 devstack sudo[110362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:53 devstack sudo[110362]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab.e3f71c56-b1db-4369-b9e2-6d315e733d05" returned: 0 in 0.404s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:53 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 13:09:53 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[43465925-6964-47b9-9ed4-b52da64ae956]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:09:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:53 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1bf8e63-21c9-49f5-98d0-0b03a642d6a5 tempest-ProjectMemberTests-1235695716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:09:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f1bf8e63-21c9-49f5-98d0-0b03a642d6a5 tempest-ProjectMemberTests-1235695716 None] Flow 'volume_create_manager' (280eb567-b024-4274-9982-b3aa77305552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:09:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f1bf8e63-21c9-49f5-98d0-0b03a642d6a5 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ab6dfcd-e306-4609-9598-d421f5abbc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f1bf8e63-21c9-49f5-98d0-0b03a642d6a5 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ab6dfcd-e306-4609-9598-d421f5abbc39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-849556457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e127e9cb-09d5-42f2-931a-e9be11d5594d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d23cdd2ebbe54bcca19b58803c9db992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:09:53Z,use_quota=True,user_id='ecda3994ec61480e95cadb77fda1aac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f1bf8e63-21c9-49f5-98d0-0b03a642d6a5 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9bee0da-6bd2-4cc1-b52b-c635886ee651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f1bf8e63-21c9-49f5-98d0-0b03a642d6a5 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9bee0da-6bd2-4cc1-b52b-c635886ee651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:53 devstack sudo[110368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab Aug 10 13:09:53 devstack sudo[110368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f1bf8e63-21c9-49f5-98d0-0b03a642d6a5 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad569f58-a23e-4981-bde7-bed35c37b0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f1bf8e63-21c9-49f5-98d0-0b03a642d6a5 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad569f58-a23e-4981-bde7-bed35c37b0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e127e9cb-09d5-42f2-931a-e9be11d5594d', 'volume_name': 'volume-e127e9cb-09d5-42f2-931a-e9be11d5594d', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f1bf8e63-21c9-49f5-98d0-0b03a642d6a5 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07836af9-68dc-4545-ae49-048d461e1aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f1bf8e63-21c9-49f5-98d0-0b03a642d6a5 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07836af9-68dc-4545-ae49-048d461e1aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:53 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f1bf8e63-21c9-49f5-98d0-0b03a642d6a5 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d4fef51-b3f1-40c6-9c0c-c814caf6eace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:53 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-f1bf8e63-21c9-49f5-98d0-0b03a642d6a5 tempest-ProjectMemberTests-1235695716 None] Volume e127e9cb-09d5-42f2-931a-e9be11d5594d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e127e9cb-09d5-42f2-931a-e9be11d5594d', 'volume_size': 1} Aug 10 13:09:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f1bf8e63-21c9-49f5-98d0-0b03a642d6a5 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:09:53 devstack sudo[110368]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab" returned: 0 in 0.359s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:53 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab {{(pid=89096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 10 13:09:53 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Creating direct copy from snapshot {{(pid=89096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 10 13:09:53 devstack cinder-volume[89096]: DEBUG cinder.utils [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Path /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ac7c4684-5bb8-468f-a88c-d673f0a49370 not found in is_blk_device check {{(pid=89096) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 10 13:09:53 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ac7c4684-5bb8-468f-a88c-d673f0a49370 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:53 devstack sudo[110373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ac7c4684-5bb8-468f-a88c-d673f0a49370 Aug 10 13:09:53 devstack sudo[110373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:57 devstack sudo[110373]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ac7c4684-5bb8-468f-a88c-d673f0a49370" returned: 0 in 4.091s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:57 devstack cinder-volume[89096]: DEBUG cinder.image.image_utils [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Image conversion details: src /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab, size 1024.00 MB, duration 4.09 sec, destination /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ac7c4684-5bb8-468f-a88c-d673f0a49370 {{(pid=89096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 13:09:57 devstack cinder-volume[89096]: INFO cinder.image.image_utils [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Converted 1024.00 MB image at 250.24 MB/s Aug 10 13:09:57 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ac7c4684-5bb8-468f-a88c-d673f0a49370 is being set with open permissions: ugo+rw Aug 10 13:09:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ac7c4684-5bb8-468f-a88c-d673f0a49370 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:57 devstack sudo[110386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ac7c4684-5bb8-468f-a88c-d673f0a49370 Aug 10 13:09:57 devstack sudo[110386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:57 devstack sudo[110386]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ac7c4684-5bb8-468f-a88c-d673f0a49370" returned: 0 in 0.249s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:57 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Lock "cinder-quobyte-ac7c4684-5bb8-468f-a88c-d673f0a49370" released by "_copy_volume_from_snapshot" :: held 5.205s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:57 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Lock "cinder-quobyte-e3f71c56-b1db-4369-b9e2-6d315e733d05-ac7c4684-5bb8-468f-a88c-d673f0a49370" released by "_create_volume_from_snapshot" :: held 5.269s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:09:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.286s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:09:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f1bf8e63-21c9-49f5-98d0-0b03a642d6a5 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.626s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:09:57 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f1bf8e63-21c9-49f5-98d0-0b03a642d6a5 tempest-ProjectMemberTests-1235695716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-849556457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e127e9cb-09d5-42f2-931a-e9be11d5594d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d23cdd2ebbe54bcca19b58803c9db992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:09:53Z,use_quota=True,user_id='ecda3994ec61480e95cadb77fda1aac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:09:57 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-f1bf8e63-21c9-49f5-98d0-0b03a642d6a5 tempest-ProjectMemberTests-1235695716 None] Creating volume e127e9cb-09d5-42f2-931a-e9be11d5594d {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:09:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f1bf8e63-21c9-49f5-98d0-0b03a642d6a5 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:09:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f1bf8e63-21c9-49f5-98d0-0b03a642d6a5 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:09:57 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f1bf8e63-21c9-49f5-98d0-0b03a642d6a5 tempest-ProjectMemberTests-1235695716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:09:57 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f1bf8e63-21c9-49f5-98d0-0b03a642d6a5 tempest-ProjectMemberTests-1235695716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:09:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f1bf8e63-21c9-49f5-98d0-0b03a642d6a5 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:09:57 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f1bf8e63-21c9-49f5-98d0-0b03a642d6a5 tempest-ProjectMemberTests-1235695716 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:09:57 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-f1bf8e63-21c9-49f5-98d0-0b03a642d6a5 tempest-ProjectMemberTests-1235695716 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:09:57 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f1bf8e63-21c9-49f5-98d0-0b03a642d6a5 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:57 devstack sudo[110389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d 1073741824 Aug 10 13:09:57 devstack sudo[110389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:57 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a674bb5-2616-4312-963c-fd6265f5f519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac7c4684-5bb8-468f-a88c-d673f0a49370', 'volume_size': 1, 'snapshot_id': 'e3f71c56-b1db-4369-b9e2-6d315e733d05'}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:57 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da268c39-5309-4b6a-bd18-dbd6c5d2c4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:57 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Volume volume-ac7c4684-5bb8-468f-a88c-d673f0a49370 (ac7c4684-5bb8-468f-a88c-d673f0a49370): created successfully Aug 10 13:09:57 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da268c39-5309-4b6a-bd18-dbd6c5d2c4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:57 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Flow 'volume_create_manager' (bce2137e-0dd8-4088-872f-6080b6066b22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:09:57 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-0262db9c-45b4-44fb-88f8-2f73aae7604a tempest-SnapshotDependencyTests-1802238765 None] Created volume successfully. Aug 10 13:09:58 devstack sudo[110389]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f1bf8e63-21c9-49f5-98d0-0b03a642d6a5 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d 1073741824" returned: 0 in 0.399s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f1bf8e63-21c9-49f5-98d0-0b03a642d6a5 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:58 devstack sudo[110395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d Aug 10 13:09:58 devstack sudo[110395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:58 devstack sudo[110395]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f1bf8e63-21c9-49f5-98d0-0b03a642d6a5 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d" returned: 0 in 0.235s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:58 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f1bf8e63-21c9-49f5-98d0-0b03a642d6a5 tempest-ProjectMemberTests-1235695716 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:09:58 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f1bf8e63-21c9-49f5-98d0-0b03a642d6a5 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:09:58 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f1bf8e63-21c9-49f5-98d0-0b03a642d6a5 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d4fef51-b3f1-40c6-9c0c-c814caf6eace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e127e9cb-09d5-42f2-931a-e9be11d5594d', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:58 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f1bf8e63-21c9-49f5-98d0-0b03a642d6a5 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22de4308-8ed7-4c1e-83a7-d16ede62a954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:09:58 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-f1bf8e63-21c9-49f5-98d0-0b03a642d6a5 tempest-ProjectMemberTests-1235695716 None] Volume volume-e127e9cb-09d5-42f2-931a-e9be11d5594d (e127e9cb-09d5-42f2-931a-e9be11d5594d): created successfully Aug 10 13:09:58 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f1bf8e63-21c9-49f5-98d0-0b03a642d6a5 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22de4308-8ed7-4c1e-83a7-d16ede62a954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:09:58 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f1bf8e63-21c9-49f5-98d0-0b03a642d6a5 tempest-ProjectMemberTests-1235695716 None] Flow 'volume_create_manager' (280eb567-b024-4274-9982-b3aa77305552) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:09:58 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-f1bf8e63-21c9-49f5-98d0-0b03a642d6a5 tempest-ProjectMemberTests-1235695716 None] Created volume successfully. Aug 10 13:09:58 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ee8cea61-486a-4532-aa1a-d888e633ba41 tempest-SnapshotDependencyTests-1802238765 None] Acquiring lock "cinder-e3f71c56-b1db-4369-b9e2-6d315e733d05-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:59 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ee8cea61-486a-4532-aa1a-d888e633ba41 tempest-SnapshotDependencyTests-1802238765 None] Lock "cinder-e3f71c56-b1db-4369-b9e2-6d315e733d05-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:59 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ee8cea61-486a-4532-aa1a-d888e633ba41 tempest-SnapshotDependencyTests-1802238765 None] Acquiring lock "cinder-quobyte-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:59 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ee8cea61-486a-4532-aa1a-d888e633ba41 tempest-SnapshotDependencyTests-1802238765 None] Lock "cinder-quobyte-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab" acquired by "delete_snapshot" :: waited 0.013s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:59 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ee8cea61-486a-4532-aa1a-d888e633ba41 tempest-SnapshotDependencyTests-1802238765 None] Acquiring lock "cinder-quobyte-e3f71c56-b1db-4369-b9e2-6d315e733d05" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:09:59 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ee8cea61-486a-4532-aa1a-d888e633ba41 tempest-SnapshotDependencyTests-1802238765 None] Lock "cinder-quobyte-e3f71c56-b1db-4369-b9e2-6d315e733d05" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:09:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-ee8cea61-486a-4532-aa1a-d888e633ba41 tempest-SnapshotDependencyTests-1802238765 None] Deleting offline snapshot e3f71c56-b1db-4369-b9e2-6d315e733d05 of volume 55ac6633-ed69-4bf1-9566-d9d7c9ca2cab {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 13:09:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-ee8cea61-486a-4532-aa1a-d888e633ba41 tempest-SnapshotDependencyTests-1802238765 None] snapshot_file for this snap is: volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab.e3f71c56-b1db-4369-b9e2-6d315e733d05 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 13:09:59 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa64cf8-c67e-4ba7-b60f-4d5505ef9952]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:09:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ee8cea61-486a-4532-aa1a-d888e633ba41 tempest-SnapshotDependencyTests-1802238765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab.e3f71c56-b1db-4369-b9e2-6d315e733d05 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:59 devstack sudo[110400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab.e3f71c56-b1db-4369-b9e2-6d315e733d05 Aug 10 13:09:59 devstack sudo[110400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:59 devstack sudo[110400]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ee8cea61-486a-4532-aa1a-d888e633ba41 tempest-SnapshotDependencyTests-1802238765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab.e3f71c56-b1db-4369-b9e2-6d315e733d05" returned: 0 in 0.351s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:09:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-ee8cea61-486a-4532-aa1a-d888e633ba41 tempest-SnapshotDependencyTests-1802238765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 13:09:59 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28ebae8-791e-4f10-9fdb-f89d05f231f7]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:09:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ee8cea61-486a-4532-aa1a-d888e633ba41 tempest-SnapshotDependencyTests-1802238765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:59 devstack sudo[110405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab Aug 10 13:09:59 devstack sudo[110405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:09:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7c8c74a9-f67c-49b3-9659-1734d837c7bb tempest-ProjectMemberTests-1235695716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:09:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7c8c74a9-f67c-49b3-9659-1734d837c7bb tempest-ProjectMemberTests-1235695716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:09:59 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-7c8c74a9-f67c-49b3-9659-1734d837c7bb tempest-ProjectMemberTests-1235695716 None] Creating offline snapshot 9424cddd-e337-4179-a722-d603a59cbdfb of volume e127e9cb-09d5-42f2-931a-e9be11d5594d {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 13:09:59 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29500f3-c7ed-4152-a2d8-822a0992de50]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:09:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7c8c74a9-f67c-49b3-9659-1734d837c7bb tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:09:59 devstack sudo[110405]: pam_unix(sudo:session): session closed for user root Aug 10 13:09:59 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ee8cea61-486a-4532-aa1a-d888e633ba41 tempest-SnapshotDependencyTests-1802238765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab" returned: 0 in 0.552s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ee8cea61-486a-4532-aa1a-d888e633ba41 tempest-SnapshotDependencyTests-1802238765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab.e3f71c56-b1db-4369-b9e2-6d315e733d05 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:00 devstack sudo[110411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab.e3f71c56-b1db-4369-b9e2-6d315e733d05 Aug 10 13:10:00 devstack sudo[110411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:00 devstack sudo[110409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d Aug 10 13:10:00 devstack sudo[110409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:00 devstack sudo[110409]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7c8c74a9-f67c-49b3-9659-1734d837c7bb tempest-ProjectMemberTests-1235695716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d" returned: 0 in 0.361s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7c8c74a9-f67c-49b3-9659-1734d837c7bb tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d.9424cddd-e337-4179-a722-d603a59cbdfb 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:00 devstack sudo[110421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d.9424cddd-e337-4179-a722-d603a59cbdfb 1G Aug 10 13:10:00 devstack sudo[110421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:00 devstack sudo[110411]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ee8cea61-486a-4532-aa1a-d888e633ba41 tempest-SnapshotDependencyTests-1802238765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab.e3f71c56-b1db-4369-b9e2-6d315e733d05" returned: 0 in 0.350s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ee8cea61-486a-4532-aa1a-d888e633ba41 tempest-SnapshotDependencyTests-1802238765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab.e3f71c56-b1db-4369-b9e2-6d315e733d05 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:00 devstack sudo[110423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab.e3f71c56-b1db-4369-b9e2-6d315e733d05 Aug 10 13:10:00 devstack sudo[110423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:00 devstack sudo[110423]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-ee8cea61-486a-4532-aa1a-d888e633ba41 tempest-SnapshotDependencyTests-1802238765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab.e3f71c56-b1db-4369-b9e2-6d315e733d05" returned: 0 in 0.246s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:00 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ee8cea61-486a-4532-aa1a-d888e633ba41 tempest-SnapshotDependencyTests-1802238765 None] Lock "cinder-quobyte-e3f71c56-b1db-4369-b9e2-6d315e733d05" released by "_delete_snapshot" :: held 1.600s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:10:00 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ee8cea61-486a-4532-aa1a-d888e633ba41 tempest-SnapshotDependencyTests-1802238765 None] Lock "cinder-quobyte-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab" released by "delete_snapshot" :: held 1.623s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:10:00 devstack sudo[110421]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7c8c74a9-f67c-49b3-9659-1734d837c7bb tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d.9424cddd-e337-4179-a722-d603a59cbdfb 1G" returned: 0 in 0.411s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7c8c74a9-f67c-49b3-9659-1734d837c7bb tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e127e9cb-09d5-42f2-931a-e9be11d5594d -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d.9424cddd-e337-4179-a722-d603a59cbdfb {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:00 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-ee8cea61-486a-4532-aa1a-d888e633ba41 tempest-SnapshotDependencyTests-1802238765 None] Created reservations ['fbcd1744-c153-47a8-866c-d71ffad9a78c', '53738e19-87e0-4a25-9af5-d65c24b0c440', '8b245354-509a-4926-b6e4-dc278084478c', '76c46a67-2cac-4f7e-bf31-83a8e7f69fb3'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:10:00 devstack sudo[110430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e127e9cb-09d5-42f2-931a-e9be11d5594d -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d.9424cddd-e337-4179-a722-d603a59cbdfb Aug 10 13:10:00 devstack sudo[110430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:00 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-ee8cea61-486a-4532-aa1a-d888e633ba41 tempest-SnapshotDependencyTests-1802238765 None] Delete snapshot completed successfully. Aug 10 13:10:00 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-ee8cea61-486a-4532-aa1a-d888e633ba41 tempest-SnapshotDependencyTests-1802238765 None] Lock "cinder-e3f71c56-b1db-4369-b9e2-6d315e733d05-delete_snapshot" released by "delete_snapshot" :: held 1.767s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:10:00 devstack sudo[110430]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7c8c74a9-f67c-49b3-9659-1734d837c7bb tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e127e9cb-09d5-42f2-931a-e9be11d5594d -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d.9424cddd-e337-4179-a722-d603a59cbdfb" returned: 0 in 0.294s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:00 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-7c8c74a9-f67c-49b3-9659-1734d837c7bb tempest-ProjectMemberTests-1235695716 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d.9424cddd-e337-4179-a722-d603a59cbdfb is being set with open permissions: ugo+rw Aug 10 13:10:00 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7c8c74a9-f67c-49b3-9659-1734d837c7bb tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d.9424cddd-e337-4179-a722-d603a59cbdfb {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:01 devstack sudo[110436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d.9424cddd-e337-4179-a722-d603a59cbdfb Aug 10 13:10:01 devstack sudo[110436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:01 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0f1f0941-2852-44e9-9deb-09f5aa3dec4f tempest-SnapshotDependencyTests-1802238765 None] Acquiring lock "cinder-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:10:01 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0f1f0941-2852-44e9-9deb-09f5aa3dec4f tempest-SnapshotDependencyTests-1802238765 None] Lock "cinder-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:10:01 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0f1f0941-2852-44e9-9deb-09f5aa3dec4f tempest-SnapshotDependencyTests-1802238765 None] Acquiring lock "cinder-quobyte-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:10:01 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0f1f0941-2852-44e9-9deb-09f5aa3dec4f tempest-SnapshotDependencyTests-1802238765 None] Lock "cinder-quobyte-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab" acquired by "delete_volume" :: waited 0.014s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:10:01 devstack sudo[110436]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7c8c74a9-f67c-49b3-9659-1734d837c7bb tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d.9424cddd-e337-4179-a722-d603a59cbdfb" returned: 0 in 0.266s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:01 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4dbc370-7ffa-4576-a467-6afef2016af4]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:10:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0f1f0941-2852-44e9-9deb-09f5aa3dec4f tempest-SnapshotDependencyTests-1802238765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7c8c74a9-f67c-49b3-9659-1734d837c7bb tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:01 devstack sudo[110441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d.info Aug 10 13:10:01 devstack sudo[110441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:01 devstack sudo[110440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab Aug 10 13:10:01 devstack sudo[110440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:01 devstack sudo[110441]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7c8c74a9-f67c-49b3-9659-1734d837c7bb tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d.info" returned: 0 in 0.261s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:01 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-7c8c74a9-f67c-49b3-9659-1734d837c7bb tempest-ProjectMemberTests-1235695716 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d.info is being set with open permissions: ugo+rw Aug 10 13:10:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7c8c74a9-f67c-49b3-9659-1734d837c7bb tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:01 devstack sudo[110445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d.info Aug 10 13:10:01 devstack sudo[110445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:01 devstack sudo[110440]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0f1f0941-2852-44e9-9deb-09f5aa3dec4f tempest-SnapshotDependencyTests-1802238765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab" returned: 0 in 0.371s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0f1f0941-2852-44e9-9deb-09f5aa3dec4f tempest-SnapshotDependencyTests-1802238765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:01 devstack sudo[110452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab Aug 10 13:10:01 devstack sudo[110452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:01 devstack sudo[110445]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7c8c74a9-f67c-49b3-9659-1734d837c7bb tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d.info" returned: 0 in 0.260s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-7c8c74a9-f67c-49b3-9659-1734d837c7bb tempest-ProjectMemberTests-1235695716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.942s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:10:01 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-7c8c74a9-f67c-49b3-9659-1734d837c7bb tempest-ProjectMemberTests-1235695716 None] Create snapshot completed successfully Aug 10 13:10:01 devstack sudo[110452]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:01 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0f1f0941-2852-44e9-9deb-09f5aa3dec4f tempest-SnapshotDependencyTests-1802238765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab" returned: 0 in 0.271s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:01 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0f1f0941-2852-44e9-9deb-09f5aa3dec4f tempest-SnapshotDependencyTests-1802238765 None] Lock "cinder-quobyte-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab" released by "delete_volume" :: held 0.709s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:10:01 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-0f1f0941-2852-44e9-9deb-09f5aa3dec4f tempest-SnapshotDependencyTests-1802238765 None] Created reservations ['ca100331-9a8e-470b-bb02-7fa263d6bc51', '6f61e87a-52e8-4dbb-a0b2-675a8e35d4e0', '68bd944d-2908-427f-a8c7-f753308e9449', '974e52c5-bee1-46a3-9bb4-d6329879361f'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:10:02 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-72ceb817-10d4-42fe-9e12-48cb41abbf8d tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-9424cddd-e337-4179-a722-d603a59cbdfb-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:10:02 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-72ceb817-10d4-42fe-9e12-48cb41abbf8d tempest-ProjectMemberTests-1235695716 None] Lock "cinder-9424cddd-e337-4179-a722-d603a59cbdfb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:10:02 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-72ceb817-10d4-42fe-9e12-48cb41abbf8d tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-quobyte-e127e9cb-09d5-42f2-931a-e9be11d5594d" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:10:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0f1f0941-2852-44e9-9deb-09f5aa3dec4f tempest-SnapshotDependencyTests-1802238765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:10:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0f1f0941-2852-44e9-9deb-09f5aa3dec4f tempest-SnapshotDependencyTests-1802238765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:10:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0f1f0941-2852-44e9-9deb-09f5aa3dec4f tempest-SnapshotDependencyTests-1802238765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:10:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-0f1f0941-2852-44e9-9deb-09f5aa3dec4f tempest-SnapshotDependencyTests-1802238765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:10:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-0f1f0941-2852-44e9-9deb-09f5aa3dec4f tempest-SnapshotDependencyTests-1802238765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:10:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0f1f0941-2852-44e9-9deb-09f5aa3dec4f tempest-SnapshotDependencyTests-1802238765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:02 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-72ceb817-10d4-42fe-9e12-48cb41abbf8d tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-e127e9cb-09d5-42f2-931a-e9be11d5594d" acquired by "delete_snapshot" :: waited 0.037s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:10:02 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-72ceb817-10d4-42fe-9e12-48cb41abbf8d tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-quobyte-9424cddd-e337-4179-a722-d603a59cbdfb" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:10:02 devstack sudo[110456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:10:02 devstack sudo[110456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:02 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-72ceb817-10d4-42fe-9e12-48cb41abbf8d tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-9424cddd-e337-4179-a722-d603a59cbdfb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:10:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-72ceb817-10d4-42fe-9e12-48cb41abbf8d tempest-ProjectMemberTests-1235695716 None] Deleting offline snapshot 9424cddd-e337-4179-a722-d603a59cbdfb of volume e127e9cb-09d5-42f2-931a-e9be11d5594d {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 13:10:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-72ceb817-10d4-42fe-9e12-48cb41abbf8d tempest-ProjectMemberTests-1235695716 None] snapshot_file for this snap is: volume-e127e9cb-09d5-42f2-931a-e9be11d5594d.9424cddd-e337-4179-a722-d603a59cbdfb {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 13:10:02 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[016c1bc9-bc86-4c7b-a001-c8f38dd03a65]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:10:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-72ceb817-10d4-42fe-9e12-48cb41abbf8d tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d.9424cddd-e337-4179-a722-d603a59cbdfb {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:02 devstack sudo[110458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d.9424cddd-e337-4179-a722-d603a59cbdfb Aug 10 13:10:02 devstack sudo[110458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:02 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-9a5cc190-be95-440d-b9ae-81663e806562 tempest-SnapshotDependencyTests-1802238765 None] Acquiring lock "cinder-ac7c4684-5bb8-468f-a88c-d673f0a49370-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:10:02 devstack sudo[110456]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-0f1f0941-2852-44e9-9deb-09f5aa3dec4f tempest-SnapshotDependencyTests-1802238765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.277s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:02 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-0f1f0941-2852-44e9-9deb-09f5aa3dec4f tempest-SnapshotDependencyTests-1802238765 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:10:02 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-9a5cc190-be95-440d-b9ae-81663e806562 tempest-SnapshotDependencyTests-1802238765 None] Lock "cinder-ac7c4684-5bb8-468f-a88c-d673f0a49370-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:10:02 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-0f1f0941-2852-44e9-9deb-09f5aa3dec4f tempest-SnapshotDependencyTests-1802238765 None] Deleted volume successfully. Aug 10 13:10:02 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-0f1f0941-2852-44e9-9deb-09f5aa3dec4f tempest-SnapshotDependencyTests-1802238765 None] Lock "cinder-55ac6633-ed69-4bf1-9566-d9d7c9ca2cab-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:10:02 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-9a5cc190-be95-440d-b9ae-81663e806562 tempest-SnapshotDependencyTests-1802238765 None] Acquiring lock "cinder-quobyte-ac7c4684-5bb8-468f-a88c-d673f0a49370" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:10:02 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-9a5cc190-be95-440d-b9ae-81663e806562 tempest-SnapshotDependencyTests-1802238765 None] Lock "cinder-quobyte-ac7c4684-5bb8-468f-a88c-d673f0a49370" acquired by "delete_volume" :: waited 0.016s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:10:02 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb3d300-70a0-40cd-890a-9e2d036142af]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:10:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9a5cc190-be95-440d-b9ae-81663e806562 tempest-SnapshotDependencyTests-1802238765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ac7c4684-5bb8-468f-a88c-d673f0a49370 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:02 devstack sudo[110461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ac7c4684-5bb8-468f-a88c-d673f0a49370 Aug 10 13:10:02 devstack sudo[110461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:02 devstack sudo[110458]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-72ceb817-10d4-42fe-9e12-48cb41abbf8d tempest-ProjectMemberTests-1235695716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d.9424cddd-e337-4179-a722-d603a59cbdfb" returned: 0 in 0.414s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:02 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-72ceb817-10d4-42fe-9e12-48cb41abbf8d tempest-ProjectMemberTests-1235695716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e127e9cb-09d5-42f2-931a-e9be11d5594d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 13:10:02 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5cb4d5f-df9a-4ef9-911c-665904b0a286]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:10:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-72ceb817-10d4-42fe-9e12-48cb41abbf8d tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:02 devstack sudo[110466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d Aug 10 13:10:02 devstack sudo[110466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:02 devstack sudo[110461]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9a5cc190-be95-440d-b9ae-81663e806562 tempest-SnapshotDependencyTests-1802238765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ac7c4684-5bb8-468f-a88c-d673f0a49370" returned: 0 in 0.369s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9a5cc190-be95-440d-b9ae-81663e806562 tempest-SnapshotDependencyTests-1802238765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ac7c4684-5bb8-468f-a88c-d673f0a49370 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:02 devstack sudo[110471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ac7c4684-5bb8-468f-a88c-d673f0a49370 Aug 10 13:10:02 devstack sudo[110471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:02 devstack sudo[110466]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-72ceb817-10d4-42fe-9e12-48cb41abbf8d tempest-ProjectMemberTests-1235695716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d" returned: 0 in 0.370s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:02 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-72ceb817-10d4-42fe-9e12-48cb41abbf8d tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d.9424cddd-e337-4179-a722-d603a59cbdfb {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:03 devstack sudo[110476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d.9424cddd-e337-4179-a722-d603a59cbdfb Aug 10 13:10:03 devstack sudo[110476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:03 devstack sudo[110471]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9a5cc190-be95-440d-b9ae-81663e806562 tempest-SnapshotDependencyTests-1802238765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-ac7c4684-5bb8-468f-a88c-d673f0a49370" returned: 0 in 0.283s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:03 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-9a5cc190-be95-440d-b9ae-81663e806562 tempest-SnapshotDependencyTests-1802238765 None] Lock "cinder-quobyte-ac7c4684-5bb8-468f-a88c-d673f0a49370" released by "delete_volume" :: held 0.696s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:10:03 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-9a5cc190-be95-440d-b9ae-81663e806562 tempest-SnapshotDependencyTests-1802238765 None] Created reservations ['49c25191-e886-42c0-a4fb-42dfe1dbe7bf', 'edea3580-2c8d-473b-986b-006db3957ec8', '445f3c06-1e5e-4554-ba43-6cc35575b704', 'a4d2517c-3f39-4c80-a1ee-421be7db0827'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:10:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9a5cc190-be95-440d-b9ae-81663e806562 tempest-SnapshotDependencyTests-1802238765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:10:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9a5cc190-be95-440d-b9ae-81663e806562 tempest-SnapshotDependencyTests-1802238765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:10:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9a5cc190-be95-440d-b9ae-81663e806562 tempest-SnapshotDependencyTests-1802238765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:10:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9a5cc190-be95-440d-b9ae-81663e806562 tempest-SnapshotDependencyTests-1802238765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:10:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9a5cc190-be95-440d-b9ae-81663e806562 tempest-SnapshotDependencyTests-1802238765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:10:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9a5cc190-be95-440d-b9ae-81663e806562 tempest-SnapshotDependencyTests-1802238765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:03 devstack sudo[110483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:10:03 devstack sudo[110483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:03 devstack sudo[110476]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-72ceb817-10d4-42fe-9e12-48cb41abbf8d tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d.9424cddd-e337-4179-a722-d603a59cbdfb" returned: 0 in 0.360s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-72ceb817-10d4-42fe-9e12-48cb41abbf8d tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d.9424cddd-e337-4179-a722-d603a59cbdfb {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:03 devstack sudo[110485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d.9424cddd-e337-4179-a722-d603a59cbdfb Aug 10 13:10:03 devstack sudo[110485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:03 devstack sudo[110483]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9a5cc190-be95-440d-b9ae-81663e806562 tempest-SnapshotDependencyTests-1802238765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.260s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:03 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-9a5cc190-be95-440d-b9ae-81663e806562 tempest-SnapshotDependencyTests-1802238765 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:10:03 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-9a5cc190-be95-440d-b9ae-81663e806562 tempest-SnapshotDependencyTests-1802238765 None] Deleted volume successfully. Aug 10 13:10:03 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-9a5cc190-be95-440d-b9ae-81663e806562 tempest-SnapshotDependencyTests-1802238765 None] Lock "cinder-ac7c4684-5bb8-468f-a88c-d673f0a49370-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:10:03 devstack sudo[110485]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-72ceb817-10d4-42fe-9e12-48cb41abbf8d tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d.9424cddd-e337-4179-a722-d603a59cbdfb" returned: 0 in 0.281s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:03 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-72ceb817-10d4-42fe-9e12-48cb41abbf8d tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-9424cddd-e337-4179-a722-d603a59cbdfb" released by "_delete_snapshot" :: held 1.532s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:10:03 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-72ceb817-10d4-42fe-9e12-48cb41abbf8d tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-e127e9cb-09d5-42f2-931a-e9be11d5594d" released by "delete_snapshot" :: held 1.564s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:10:03 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-72ceb817-10d4-42fe-9e12-48cb41abbf8d tempest-ProjectMemberTests-1235695716 None] Created reservations ['f60ffda2-cbb3-481b-a4e2-b7c2d629a7a9', 'd79ad538-06e9-41d2-9f06-86d83b2ca19b', '48259d19-d74c-46ba-bab8-20051c149cd7', 'dc36e0ab-6f01-4c6b-bada-c0d697b9097d'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:10:03 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-72ceb817-10d4-42fe-9e12-48cb41abbf8d tempest-ProjectMemberTests-1235695716 None] Delete snapshot completed successfully. Aug 10 13:10:03 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-72ceb817-10d4-42fe-9e12-48cb41abbf8d tempest-ProjectMemberTests-1235695716 None] Lock "cinder-9424cddd-e337-4179-a722-d603a59cbdfb-delete_snapshot" released by "delete_snapshot" :: held 1.724s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:10:03 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 13:10:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:10:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:10:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:10:03 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:10:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:10:03 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:03 devstack sudo[110489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:10:03 devstack sudo[110489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:04 devstack sudo[110489]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.254s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:04 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:10:04 devstack cinder-volume[89096]: DEBUG oslo_service.periodic_task [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] Running periodic task VolumeManager._thread_info {{(pid=89096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 13:10:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread count: 28 {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 13:10:04 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-9e78c35d-fd9a-4be5-a314-950e5d4bd044 None None] thread info: [<_MainThread(MainThread, started 130607683133568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Aug 10 13:10:04 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-35f828e0-d40c-4515-8dad-01eddbd4a060 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-e127e9cb-09d5-42f2-931a-e9be11d5594d-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:10:04 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-35f828e0-d40c-4515-8dad-01eddbd4a060 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-e127e9cb-09d5-42f2-931a-e9be11d5594d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:10:04 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-35f828e0-d40c-4515-8dad-01eddbd4a060 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-quobyte-e127e9cb-09d5-42f2-931a-e9be11d5594d" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:10:04 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-35f828e0-d40c-4515-8dad-01eddbd4a060 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-e127e9cb-09d5-42f2-931a-e9be11d5594d" acquired by "delete_volume" :: waited 0.022s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:10:04 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27c1d0d-afbd-40a3-ba5d-1acf1ec9a8b1]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:10:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-35f828e0-d40c-4515-8dad-01eddbd4a060 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:04 devstack sudo[110492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d Aug 10 13:10:04 devstack sudo[110492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:04 devstack sudo[110492]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-35f828e0-d40c-4515-8dad-01eddbd4a060 tempest-ProjectMemberTests-1235695716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d" returned: 0 in 0.379s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:04 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-35f828e0-d40c-4515-8dad-01eddbd4a060 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:04 devstack sudo[110497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d Aug 10 13:10:04 devstack sudo[110497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:05 devstack sudo[110497]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-35f828e0-d40c-4515-8dad-01eddbd4a060 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-e127e9cb-09d5-42f2-931a-e9be11d5594d" returned: 0 in 0.294s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:05 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-35f828e0-d40c-4515-8dad-01eddbd4a060 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-e127e9cb-09d5-42f2-931a-e9be11d5594d" released by "delete_volume" :: held 0.734s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:10:05 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-35f828e0-d40c-4515-8dad-01eddbd4a060 tempest-ProjectMemberTests-1235695716 None] Created reservations ['7123b73e-dc2a-488c-bb97-cbee3e24edb6', '2750fe45-085f-4463-8578-fdec07eb6d21', '8db5b8e4-3c0c-47a1-86ae-228b623946c1', '87c4a580-957f-4f4e-9d29-870afa206813'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:10:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-35f828e0-d40c-4515-8dad-01eddbd4a060 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:10:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-35f828e0-d40c-4515-8dad-01eddbd4a060 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:10:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-35f828e0-d40c-4515-8dad-01eddbd4a060 tempest-ProjectMemberTests-1235695716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:10:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-35f828e0-d40c-4515-8dad-01eddbd4a060 tempest-ProjectMemberTests-1235695716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:10:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-35f828e0-d40c-4515-8dad-01eddbd4a060 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:10:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-35f828e0-d40c-4515-8dad-01eddbd4a060 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:05 devstack sudo[110501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:10:05 devstack sudo[110501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:05 devstack sudo[110501]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-35f828e0-d40c-4515-8dad-01eddbd4a060 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.266s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:05 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-35f828e0-d40c-4515-8dad-01eddbd4a060 tempest-ProjectMemberTests-1235695716 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:10:05 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-35f828e0-d40c-4515-8dad-01eddbd4a060 tempest-ProjectMemberTests-1235695716 None] Deleted volume successfully. Aug 10 13:10:05 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-35f828e0-d40c-4515-8dad-01eddbd4a060 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-e127e9cb-09d5-42f2-931a-e9be11d5594d-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:10:05 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a19df0f-f6df-445b-96a9-b03f08c0dff1 tempest-ProjectMemberTests-1235695716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:10:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8a19df0f-f6df-445b-96a9-b03f08c0dff1 tempest-ProjectMemberTests-1235695716 None] Flow 'volume_create_manager' (b6678043-c854-4025-876c-e7957d9073d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:10:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8a19df0f-f6df-445b-96a9-b03f08c0dff1 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e1d82f5-b8ce-4a99-93ff-7d417f3cbb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:10:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8a19df0f-f6df-445b-96a9-b03f08c0dff1 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e1d82f5-b8ce-4a99-93ff-7d417f3cbb36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1860437031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aed4a03d-8731-47ab-99db-e1e9929bd371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d23cdd2ebbe54bcca19b58803c9db992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:10:06Z,use_quota=True,user_id='ecda3994ec61480e95cadb77fda1aac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:10:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8a19df0f-f6df-445b-96a9-b03f08c0dff1 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d1038a-f0b2-41e8-a364-f4398496854a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:10:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8a19df0f-f6df-445b-96a9-b03f08c0dff1 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d1038a-f0b2-41e8-a364-f4398496854a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:10:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8a19df0f-f6df-445b-96a9-b03f08c0dff1 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (875824b3-4a1b-4d44-9f88-36f44dfbedba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:10:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8a19df0f-f6df-445b-96a9-b03f08c0dff1 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (875824b3-4a1b-4d44-9f88-36f44dfbedba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aed4a03d-8731-47ab-99db-e1e9929bd371', 'volume_name': 'volume-aed4a03d-8731-47ab-99db-e1e9929bd371', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:10:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8a19df0f-f6df-445b-96a9-b03f08c0dff1 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa31dcf7-97ea-4328-8aa0-913ef3649cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:10:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8a19df0f-f6df-445b-96a9-b03f08c0dff1 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa31dcf7-97ea-4328-8aa0-913ef3649cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:10:05 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8a19df0f-f6df-445b-96a9-b03f08c0dff1 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8979bdd-e3c9-4dad-b6ca-71941c5df8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:10:05 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-8a19df0f-f6df-445b-96a9-b03f08c0dff1 tempest-ProjectMemberTests-1235695716 None] Volume aed4a03d-8731-47ab-99db-e1e9929bd371: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aed4a03d-8731-47ab-99db-e1e9929bd371', 'volume_size': 1} Aug 10 13:10:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8a19df0f-f6df-445b-96a9-b03f08c0dff1 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:10:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8a19df0f-f6df-445b-96a9-b03f08c0dff1 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:10:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8a19df0f-f6df-445b-96a9-b03f08c0dff1 tempest-ProjectMemberTests-1235695716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1860437031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aed4a03d-8731-47ab-99db-e1e9929bd371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d23cdd2ebbe54bcca19b58803c9db992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:10:06Z,use_quota=True,user_id='ecda3994ec61480e95cadb77fda1aac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:10:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-8a19df0f-f6df-445b-96a9-b03f08c0dff1 tempest-ProjectMemberTests-1235695716 None] Creating volume aed4a03d-8731-47ab-99db-e1e9929bd371 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:10:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8a19df0f-f6df-445b-96a9-b03f08c0dff1 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:10:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8a19df0f-f6df-445b-96a9-b03f08c0dff1 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:10:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8a19df0f-f6df-445b-96a9-b03f08c0dff1 tempest-ProjectMemberTests-1235695716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:10:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8a19df0f-f6df-445b-96a9-b03f08c0dff1 tempest-ProjectMemberTests-1235695716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:10:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8a19df0f-f6df-445b-96a9-b03f08c0dff1 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:10:05 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8a19df0f-f6df-445b-96a9-b03f08c0dff1 tempest-ProjectMemberTests-1235695716 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:10:05 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-8a19df0f-f6df-445b-96a9-b03f08c0dff1 tempest-ProjectMemberTests-1235695716 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:10:05 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8a19df0f-f6df-445b-96a9-b03f08c0dff1 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:06 devstack sudo[110504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371 1073741824 Aug 10 13:10:06 devstack sudo[110504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:06 devstack sudo[110504]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8a19df0f-f6df-445b-96a9-b03f08c0dff1 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371 1073741824" returned: 0 in 0.429s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8a19df0f-f6df-445b-96a9-b03f08c0dff1 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:06 devstack sudo[110509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371 Aug 10 13:10:06 devstack sudo[110509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:06 devstack sudo[110509]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-8a19df0f-f6df-445b-96a9-b03f08c0dff1 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371" returned: 0 in 0.239s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:06 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-8a19df0f-f6df-445b-96a9-b03f08c0dff1 tempest-ProjectMemberTests-1235695716 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:10:06 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-8a19df0f-f6df-445b-96a9-b03f08c0dff1 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:10:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8a19df0f-f6df-445b-96a9-b03f08c0dff1 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8979bdd-e3c9-4dad-b6ca-71941c5df8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aed4a03d-8731-47ab-99db-e1e9929bd371', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:10:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8a19df0f-f6df-445b-96a9-b03f08c0dff1 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4687a613-cff2-4cc6-9d0c-bc66eb69ee6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:10:06 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-8a19df0f-f6df-445b-96a9-b03f08c0dff1 tempest-ProjectMemberTests-1235695716 None] Volume volume-aed4a03d-8731-47ab-99db-e1e9929bd371 (aed4a03d-8731-47ab-99db-e1e9929bd371): created successfully Aug 10 13:10:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8a19df0f-f6df-445b-96a9-b03f08c0dff1 tempest-ProjectMemberTests-1235695716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4687a613-cff2-4cc6-9d0c-bc66eb69ee6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:10:06 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-8a19df0f-f6df-445b-96a9-b03f08c0dff1 tempest-ProjectMemberTests-1235695716 None] Flow 'volume_create_manager' (b6678043-c854-4025-876c-e7957d9073d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:10:06 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-8a19df0f-f6df-445b-96a9-b03f08c0dff1 tempest-ProjectMemberTests-1235695716 None] Created volume successfully. Aug 10 13:10:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-57cfcbd1-5e5c-4101-8cd4-76a3fe6e5467 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:10:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-57cfcbd1-5e5c-4101-8cd4-76a3fe6e5467 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:10:07 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-57cfcbd1-5e5c-4101-8cd4-76a3fe6e5467 tempest-ProjectMemberTests-1235695716 None] Creating offline snapshot 82fb243f-7265-45d3-afe7-5671e28012c0 of volume aed4a03d-8731-47ab-99db-e1e9929bd371 {{(pid=89096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 13:10:07 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e9c5bd-639b-4018-bf20-7005813da51d]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:10:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-57cfcbd1-5e5c-4101-8cd4-76a3fe6e5467 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:07 devstack sudo[110512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371 Aug 10 13:10:07 devstack sudo[110512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:07 devstack sudo[110512]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-57cfcbd1-5e5c-4101-8cd4-76a3fe6e5467 tempest-ProjectMemberTests-1235695716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371" returned: 0 in 0.379s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:07 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-57cfcbd1-5e5c-4101-8cd4-76a3fe6e5467 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371.82fb243f-7265-45d3-afe7-5671e28012c0 1G {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:07 devstack sudo[110517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371.82fb243f-7265-45d3-afe7-5671e28012c0 1G Aug 10 13:10:07 devstack sudo[110517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:08 devstack sudo[110517]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-57cfcbd1-5e5c-4101-8cd4-76a3fe6e5467 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371.82fb243f-7265-45d3-afe7-5671e28012c0 1G" returned: 0 in 0.500s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-57cfcbd1-5e5c-4101-8cd4-76a3fe6e5467 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aed4a03d-8731-47ab-99db-e1e9929bd371 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371.82fb243f-7265-45d3-afe7-5671e28012c0 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:08 devstack sudo[110523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aed4a03d-8731-47ab-99db-e1e9929bd371 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371.82fb243f-7265-45d3-afe7-5671e28012c0 Aug 10 13:10:08 devstack sudo[110523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:08 devstack sudo[110523]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-57cfcbd1-5e5c-4101-8cd4-76a3fe6e5467 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aed4a03d-8731-47ab-99db-e1e9929bd371 -F qcow2 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371.82fb243f-7265-45d3-afe7-5671e28012c0" returned: 0 in 0.301s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:08 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-57cfcbd1-5e5c-4101-8cd4-76a3fe6e5467 tempest-ProjectMemberTests-1235695716 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371.82fb243f-7265-45d3-afe7-5671e28012c0 is being set with open permissions: ugo+rw Aug 10 13:10:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-57cfcbd1-5e5c-4101-8cd4-76a3fe6e5467 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371.82fb243f-7265-45d3-afe7-5671e28012c0 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:08 devstack sudo[110528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371.82fb243f-7265-45d3-afe7-5671e28012c0 Aug 10 13:10:08 devstack sudo[110528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:08 devstack sudo[110528]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-57cfcbd1-5e5c-4101-8cd4-76a3fe6e5467 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371.82fb243f-7265-45d3-afe7-5671e28012c0" returned: 0 in 0.265s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-57cfcbd1-5e5c-4101-8cd4-76a3fe6e5467 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:08 devstack sudo[110533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371.info Aug 10 13:10:08 devstack sudo[110533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:08 devstack sudo[110533]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-57cfcbd1-5e5c-4101-8cd4-76a3fe6e5467 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371.info" returned: 0 in 0.309s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:08 devstack cinder-volume[89096]: WARNING cinder.volume.drivers.remotefs [None req-57cfcbd1-5e5c-4101-8cd4-76a3fe6e5467 tempest-ProjectMemberTests-1235695716 None] /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371.info is being set with open permissions: ugo+rw Aug 10 13:10:08 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-57cfcbd1-5e5c-4101-8cd4-76a3fe6e5467 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371.info {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:08 devstack sudo[110537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371.info Aug 10 13:10:08 devstack sudo[110537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:09 devstack sudo[110537]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-57cfcbd1-5e5c-4101-8cd4-76a3fe6e5467 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371.info" returned: 0 in 0.255s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:09 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-57cfcbd1-5e5c-4101-8cd4-76a3fe6e5467 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.096s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:10:09 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-57cfcbd1-5e5c-4101-8cd4-76a3fe6e5467 tempest-ProjectMemberTests-1235695716 None] Create snapshot completed successfully Aug 10 13:10:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7477977e-ffee-4a98-8833-31f964616ada tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-82fb243f-7265-45d3-afe7-5671e28012c0-delete_snapshot" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:10:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7477977e-ffee-4a98-8833-31f964616ada tempest-ProjectMemberTests-1235695716 None] Lock "cinder-82fb243f-7265-45d3-afe7-5671e28012c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:10:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7477977e-ffee-4a98-8833-31f964616ada tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-quobyte-aed4a03d-8731-47ab-99db-e1e9929bd371" by "delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:10:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7477977e-ffee-4a98-8833-31f964616ada tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-aed4a03d-8731-47ab-99db-e1e9929bd371" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:10:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7477977e-ffee-4a98-8833-31f964616ada tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-quobyte-82fb243f-7265-45d3-afe7-5671e28012c0" by "_delete_snapshot" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:10:10 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7477977e-ffee-4a98-8833-31f964616ada tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-82fb243f-7265-45d3-afe7-5671e28012c0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:10:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-7477977e-ffee-4a98-8833-31f964616ada tempest-ProjectMemberTests-1235695716 None] Deleting offline snapshot 82fb243f-7265-45d3-afe7-5671e28012c0 of volume aed4a03d-8731-47ab-99db-e1e9929bd371 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 13:10:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-7477977e-ffee-4a98-8833-31f964616ada tempest-ProjectMemberTests-1235695716 None] snapshot_file for this snap is: volume-aed4a03d-8731-47ab-99db-e1e9929bd371.82fb243f-7265-45d3-afe7-5671e28012c0 {{(pid=89096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 13:10:10 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[e246f64e-1965-45e7-b71a-f2cebd166f2d]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:10:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7477977e-ffee-4a98-8833-31f964616ada tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371.82fb243f-7265-45d3-afe7-5671e28012c0 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:10 devstack sudo[110542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371.82fb243f-7265-45d3-afe7-5671e28012c0 Aug 10 13:10:10 devstack sudo[110542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:10 devstack sudo[110542]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7477977e-ffee-4a98-8833-31f964616ada tempest-ProjectMemberTests-1235695716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371.82fb243f-7265-45d3-afe7-5671e28012c0" returned: 0 in 0.356s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:10 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-7477977e-ffee-4a98-8833-31f964616ada tempest-ProjectMemberTests-1235695716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aed4a03d-8731-47ab-99db-e1e9929bd371(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 13:10:10 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7aadd3-4e59-4148-8f54-7703b5c0eaeb]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:10:10 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7477977e-ffee-4a98-8833-31f964616ada tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:10 devstack sudo[110547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371 Aug 10 13:10:10 devstack sudo[110547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:11 devstack sudo[110547]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7477977e-ffee-4a98-8833-31f964616ada tempest-ProjectMemberTests-1235695716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371" returned: 0 in 0.372s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7477977e-ffee-4a98-8833-31f964616ada tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371.82fb243f-7265-45d3-afe7-5671e28012c0 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:11 devstack sudo[110552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371.82fb243f-7265-45d3-afe7-5671e28012c0 Aug 10 13:10:11 devstack sudo[110552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:11 devstack sudo[110552]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7477977e-ffee-4a98-8833-31f964616ada tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371.82fb243f-7265-45d3-afe7-5671e28012c0" returned: 0 in 0.378s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7477977e-ffee-4a98-8833-31f964616ada tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371.82fb243f-7265-45d3-afe7-5671e28012c0 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:11 devstack sudo[110557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371.82fb243f-7265-45d3-afe7-5671e28012c0 Aug 10 13:10:11 devstack sudo[110557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:11 devstack sudo[110557]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:11 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-7477977e-ffee-4a98-8833-31f964616ada tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371.82fb243f-7265-45d3-afe7-5671e28012c0" returned: 0 in 0.271s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:11 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7477977e-ffee-4a98-8833-31f964616ada tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-82fb243f-7265-45d3-afe7-5671e28012c0" released by "_delete_snapshot" :: held 1.475s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:10:11 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7477977e-ffee-4a98-8833-31f964616ada tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-aed4a03d-8731-47ab-99db-e1e9929bd371" released by "delete_snapshot" :: held 1.502s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:10:12 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-7477977e-ffee-4a98-8833-31f964616ada tempest-ProjectMemberTests-1235695716 None] Created reservations ['6798b2bf-12d5-48ca-ae86-199644b0039f', '2209ef35-10da-4206-8a95-f70cb3a25880', '952c7f0f-2f6b-4894-8d78-43669febd8f7', '96d2d218-4ca9-4001-bd8a-7f77890ad42d'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:10:12 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-7477977e-ffee-4a98-8833-31f964616ada tempest-ProjectMemberTests-1235695716 None] Delete snapshot completed successfully. Aug 10 13:10:12 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-7477977e-ffee-4a98-8833-31f964616ada tempest-ProjectMemberTests-1235695716 None] Lock "cinder-82fb243f-7265-45d3-afe7-5671e28012c0-delete_snapshot" released by "delete_snapshot" :: held 1.660s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:10:12 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c8798501-3e99-428f-bd80-723466f53102 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-aed4a03d-8731-47ab-99db-e1e9929bd371-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:10:12 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c8798501-3e99-428f-bd80-723466f53102 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-aed4a03d-8731-47ab-99db-e1e9929bd371-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:10:12 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c8798501-3e99-428f-bd80-723466f53102 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "cinder-quobyte-aed4a03d-8731-47ab-99db-e1e9929bd371" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:10:12 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c8798501-3e99-428f-bd80-723466f53102 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-aed4a03d-8731-47ab-99db-e1e9929bd371" acquired by "delete_volume" :: waited 0.013s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:10:12 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[4238382a-ce40-44c0-bf1d-8a7e460fd80d]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:10:12 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c8798501-3e99-428f-bd80-723466f53102 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:12 devstack sudo[110561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371 Aug 10 13:10:12 devstack sudo[110561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:13 devstack sudo[110561]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c8798501-3e99-428f-bd80-723466f53102 tempest-ProjectMemberTests-1235695716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371" returned: 0 in 0.413s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c8798501-3e99-428f-bd80-723466f53102 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:13 devstack sudo[110566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371 Aug 10 13:10:13 devstack sudo[110566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:13 devstack sudo[110566]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c8798501-3e99-428f-bd80-723466f53102 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-aed4a03d-8731-47ab-99db-e1e9929bd371" returned: 0 in 0.260s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:13 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c8798501-3e99-428f-bd80-723466f53102 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-quobyte-aed4a03d-8731-47ab-99db-e1e9929bd371" released by "delete_volume" :: held 0.756s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:10:13 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-c8798501-3e99-428f-bd80-723466f53102 tempest-ProjectMemberTests-1235695716 None] Created reservations ['545ca1df-d97e-4380-8d2f-664c1865fff8', '7304eca6-a50f-4f6d-858c-9d45ead3354a', '2128b083-48cc-4af3-9ca4-59473a30ad19', '292598da-4460-4d54-8600-d77d8392c846'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:10:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c8798501-3e99-428f-bd80-723466f53102 tempest-ProjectMemberTests-1235695716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:10:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c8798501-3e99-428f-bd80-723466f53102 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:10:13 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c8798501-3e99-428f-bd80-723466f53102 tempest-ProjectMemberTests-1235695716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:10:13 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-c8798501-3e99-428f-bd80-723466f53102 tempest-ProjectMemberTests-1235695716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:10:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-c8798501-3e99-428f-bd80-723466f53102 tempest-ProjectMemberTests-1235695716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:10:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c8798501-3e99-428f-bd80-723466f53102 tempest-ProjectMemberTests-1235695716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:13 devstack sudo[110569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:10:13 devstack sudo[110569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:13 devstack sudo[110569]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:13 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-c8798501-3e99-428f-bd80-723466f53102 tempest-ProjectMemberTests-1235695716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.288s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:13 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-c8798501-3e99-428f-bd80-723466f53102 tempest-ProjectMemberTests-1235695716 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:10:13 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-c8798501-3e99-428f-bd80-723466f53102 tempest-ProjectMemberTests-1235695716 None] Deleted volume successfully. Aug 10 13:10:13 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-c8798501-3e99-428f-bd80-723466f53102 tempest-ProjectMemberTests-1235695716 None] Lock "cinder-aed4a03d-8731-47ab-99db-e1e9929bd371-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:10:23 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:UPDATE=94,cinder:SELECT=79,cinder:INSERT=23,cinder:DELETE=8 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 13:10:23 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=69,cinder:INSERT=30,cinder:UPDATE=99,cinder:DELETE=7 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 13:10:25 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4e12098-521b-48bd-9f8c-ac4597ca3efa tempest-ProjectReaderTests-1033063197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:10:25 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4e12098-521b-48bd-9f8c-ac4597ca3efa tempest-ProjectReaderTests-1033063197 None] Flow 'volume_create_manager' (069fcde7-105c-4766-aff1-875a9f2d2ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:10:25 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4e12098-521b-48bd-9f8c-ac4597ca3efa tempest-ProjectReaderTests-1033063197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a1b761c-709c-46a4-82c6-2f74923b9add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:10:25 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4e12098-521b-48bd-9f8c-ac4597ca3efa tempest-ProjectReaderTests-1033063197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a1b761c-709c-46a4-82c6-2f74923b9add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-546683457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0006a24e-4230-4c3f-b2b4-bf5d28d940c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f17a92dad864e66a1f2b7fd56405e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:10:26Z,use_quota=True,user_id='96bbdbb912b143dcb5a016c5dde4920f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:10:25 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4e12098-521b-48bd-9f8c-ac4597ca3efa tempest-ProjectReaderTests-1033063197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30546eca-a6c9-4a69-bbe0-ba2f8275c4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:10:25 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4e12098-521b-48bd-9f8c-ac4597ca3efa tempest-ProjectReaderTests-1033063197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30546eca-a6c9-4a69-bbe0-ba2f8275c4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:10:25 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4e12098-521b-48bd-9f8c-ac4597ca3efa tempest-ProjectReaderTests-1033063197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a721a62-df06-4b25-97a5-8e667755887d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:10:25 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4e12098-521b-48bd-9f8c-ac4597ca3efa tempest-ProjectReaderTests-1033063197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a721a62-df06-4b25-97a5-8e667755887d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0006a24e-4230-4c3f-b2b4-bf5d28d940c4', 'volume_name': 'volume-0006a24e-4230-4c3f-b2b4-bf5d28d940c4', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:10:25 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4e12098-521b-48bd-9f8c-ac4597ca3efa tempest-ProjectReaderTests-1033063197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a477ed84-7e31-48d6-862c-2a83fee1e166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:10:25 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4e12098-521b-48bd-9f8c-ac4597ca3efa tempest-ProjectReaderTests-1033063197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a477ed84-7e31-48d6-862c-2a83fee1e166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:10:25 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4e12098-521b-48bd-9f8c-ac4597ca3efa tempest-ProjectReaderTests-1033063197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b429726-66f5-404f-b8ba-de13ef65aa69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:10:25 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-f4e12098-521b-48bd-9f8c-ac4597ca3efa tempest-ProjectReaderTests-1033063197 None] Volume 0006a24e-4230-4c3f-b2b4-bf5d28d940c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0006a24e-4230-4c3f-b2b4-bf5d28d940c4', 'volume_size': 1} Aug 10 13:10:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f4e12098-521b-48bd-9f8c-ac4597ca3efa tempest-ProjectReaderTests-1033063197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:10:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f4e12098-521b-48bd-9f8c-ac4597ca3efa tempest-ProjectReaderTests-1033063197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:10:25 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f4e12098-521b-48bd-9f8c-ac4597ca3efa tempest-ProjectReaderTests-1033063197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-546683457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0006a24e-4230-4c3f-b2b4-bf5d28d940c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f17a92dad864e66a1f2b7fd56405e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:10:26Z,use_quota=True,user_id='96bbdbb912b143dcb5a016c5dde4920f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:10:25 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-f4e12098-521b-48bd-9f8c-ac4597ca3efa tempest-ProjectReaderTests-1033063197 None] Creating volume 0006a24e-4230-4c3f-b2b4-bf5d28d940c4 {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:10:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f4e12098-521b-48bd-9f8c-ac4597ca3efa tempest-ProjectReaderTests-1033063197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:10:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f4e12098-521b-48bd-9f8c-ac4597ca3efa tempest-ProjectReaderTests-1033063197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:10:25 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f4e12098-521b-48bd-9f8c-ac4597ca3efa tempest-ProjectReaderTests-1033063197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:10:25 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f4e12098-521b-48bd-9f8c-ac4597ca3efa tempest-ProjectReaderTests-1033063197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:10:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f4e12098-521b-48bd-9f8c-ac4597ca3efa tempest-ProjectReaderTests-1033063197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:10:25 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f4e12098-521b-48bd-9f8c-ac4597ca3efa tempest-ProjectReaderTests-1033063197 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:10:25 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-f4e12098-521b-48bd-9f8c-ac4597ca3efa tempest-ProjectReaderTests-1033063197 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:10:25 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f4e12098-521b-48bd-9f8c-ac4597ca3efa tempest-ProjectReaderTests-1033063197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0006a24e-4230-4c3f-b2b4-bf5d28d940c4 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:25 devstack sudo[110574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0006a24e-4230-4c3f-b2b4-bf5d28d940c4 1073741824 Aug 10 13:10:25 devstack sudo[110574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:26 devstack sudo[110574]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f4e12098-521b-48bd-9f8c-ac4597ca3efa tempest-ProjectReaderTests-1033063197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0006a24e-4230-4c3f-b2b4-bf5d28d940c4 1073741824" returned: 0 in 0.391s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f4e12098-521b-48bd-9f8c-ac4597ca3efa tempest-ProjectReaderTests-1033063197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0006a24e-4230-4c3f-b2b4-bf5d28d940c4 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:26 devstack sudo[110580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0006a24e-4230-4c3f-b2b4-bf5d28d940c4 Aug 10 13:10:26 devstack sudo[110580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:26 devstack sudo[110580]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-f4e12098-521b-48bd-9f8c-ac4597ca3efa tempest-ProjectReaderTests-1033063197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0006a24e-4230-4c3f-b2b4-bf5d28d940c4" returned: 0 in 0.242s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:26 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-f4e12098-521b-48bd-9f8c-ac4597ca3efa tempest-ProjectReaderTests-1033063197 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:10:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-f4e12098-521b-48bd-9f8c-ac4597ca3efa tempest-ProjectReaderTests-1033063197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:10:26 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4e12098-521b-48bd-9f8c-ac4597ca3efa tempest-ProjectReaderTests-1033063197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b429726-66f5-404f-b8ba-de13ef65aa69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0006a24e-4230-4c3f-b2b4-bf5d28d940c4', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:10:26 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4e12098-521b-48bd-9f8c-ac4597ca3efa tempest-ProjectReaderTests-1033063197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e74d82c0-0286-44d2-9f79-e6876fb4661d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:10:26 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-f4e12098-521b-48bd-9f8c-ac4597ca3efa tempest-ProjectReaderTests-1033063197 None] Volume volume-0006a24e-4230-4c3f-b2b4-bf5d28d940c4 (0006a24e-4230-4c3f-b2b4-bf5d28d940c4): created successfully Aug 10 13:10:26 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4e12098-521b-48bd-9f8c-ac4597ca3efa tempest-ProjectReaderTests-1033063197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e74d82c0-0286-44d2-9f79-e6876fb4661d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:10:26 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-f4e12098-521b-48bd-9f8c-ac4597ca3efa tempest-ProjectReaderTests-1033063197 None] Flow 'volume_create_manager' (069fcde7-105c-4766-aff1-875a9f2d2ee8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:10:26 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-f4e12098-521b-48bd-9f8c-ac4597ca3efa tempest-ProjectReaderTests-1033063197 None] Created volume successfully. Aug 10 13:10:26 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-569d0e5a-24de-4597-909c-0d65b815fb1a tempest-ProjectReaderTests-1033063197 None] Acquiring lock "cinder-0006a24e-4230-4c3f-b2b4-bf5d28d940c4-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:10:26 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-569d0e5a-24de-4597-909c-0d65b815fb1a tempest-ProjectReaderTests-1033063197 None] Lock "cinder-0006a24e-4230-4c3f-b2b4-bf5d28d940c4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:10:26 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-569d0e5a-24de-4597-909c-0d65b815fb1a tempest-ProjectReaderTests-1033063197 None] Acquiring lock "cinder-quobyte-0006a24e-4230-4c3f-b2b4-bf5d28d940c4" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:10:26 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-569d0e5a-24de-4597-909c-0d65b815fb1a tempest-ProjectReaderTests-1033063197 None] Lock "cinder-quobyte-0006a24e-4230-4c3f-b2b4-bf5d28d940c4" acquired by "delete_volume" :: waited 0.017s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:10:26 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3a4505-5d9c-4f0e-811e-4ee3347d7faf]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:10:26 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-569d0e5a-24de-4597-909c-0d65b815fb1a tempest-ProjectReaderTests-1033063197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0006a24e-4230-4c3f-b2b4-bf5d28d940c4 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:26 devstack sudo[110583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0006a24e-4230-4c3f-b2b4-bf5d28d940c4 Aug 10 13:10:26 devstack sudo[110583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:27 devstack sudo[110583]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-569d0e5a-24de-4597-909c-0d65b815fb1a tempest-ProjectReaderTests-1033063197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0006a24e-4230-4c3f-b2b4-bf5d28d940c4" returned: 0 in 0.348s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-569d0e5a-24de-4597-909c-0d65b815fb1a tempest-ProjectReaderTests-1033063197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0006a24e-4230-4c3f-b2b4-bf5d28d940c4 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:27 devstack sudo[110588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0006a24e-4230-4c3f-b2b4-bf5d28d940c4 Aug 10 13:10:27 devstack sudo[110588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:27 devstack sudo[110588]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-569d0e5a-24de-4597-909c-0d65b815fb1a tempest-ProjectReaderTests-1033063197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-0006a24e-4230-4c3f-b2b4-bf5d28d940c4" returned: 0 in 0.248s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:27 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-569d0e5a-24de-4597-909c-0d65b815fb1a tempest-ProjectReaderTests-1033063197 None] Lock "cinder-quobyte-0006a24e-4230-4c3f-b2b4-bf5d28d940c4" released by "delete_volume" :: held 0.634s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:10:27 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-569d0e5a-24de-4597-909c-0d65b815fb1a tempest-ProjectReaderTests-1033063197 None] Created reservations ['25e34ba2-5967-4dde-b798-c85e0dfa3dfc', 'ba116024-455e-4720-9d09-abf1cc7a54f9', '69f63902-0618-46f2-bc39-202394d26475', '6718a904-0ed5-4c89-a74b-23ad036319bf'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:10:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-569d0e5a-24de-4597-909c-0d65b815fb1a tempest-ProjectReaderTests-1033063197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:10:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-569d0e5a-24de-4597-909c-0d65b815fb1a tempest-ProjectReaderTests-1033063197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:10:27 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-569d0e5a-24de-4597-909c-0d65b815fb1a tempest-ProjectReaderTests-1033063197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:10:27 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-569d0e5a-24de-4597-909c-0d65b815fb1a tempest-ProjectReaderTests-1033063197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:10:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-569d0e5a-24de-4597-909c-0d65b815fb1a tempest-ProjectReaderTests-1033063197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:10:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-569d0e5a-24de-4597-909c-0d65b815fb1a tempest-ProjectReaderTests-1033063197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:27 devstack sudo[110591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:10:27 devstack sudo[110591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:27 devstack sudo[110591]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:27 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-569d0e5a-24de-4597-909c-0d65b815fb1a tempest-ProjectReaderTests-1033063197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.243s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:27 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-569d0e5a-24de-4597-909c-0d65b815fb1a tempest-ProjectReaderTests-1033063197 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:10:27 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-569d0e5a-24de-4597-909c-0d65b815fb1a tempest-ProjectReaderTests-1033063197 None] Deleted volume successfully. Aug 10 13:10:27 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-569d0e5a-24de-4597-909c-0d65b815fb1a tempest-ProjectReaderTests-1033063197 None] Lock "cinder-0006a24e-4230-4c3f-b2b4-bf5d28d940c4-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:10:28 devstack cinder-volume[89096]: DEBUG cinder.volume.flows.manager.create_volume [None req-be934373-c963-4ff7-8ba6-78420599f256 tempest-ProjectReaderTests-1033063197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 13:10:28 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-be934373-c963-4ff7-8ba6-78420599f256 tempest-ProjectReaderTests-1033063197 None] Flow 'volume_create_manager' (8f8231b9-029a-42cd-83ca-66e33efc7e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:10:28 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-be934373-c963-4ff7-8ba6-78420599f256 tempest-ProjectReaderTests-1033063197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec011cae-99a1-4d0b-9566-51a188def2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:10:28 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-be934373-c963-4ff7-8ba6-78420599f256 tempest-ProjectReaderTests-1033063197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec011cae-99a1-4d0b-9566-51a188def2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1660718978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39235950-ca6e-498c-a178-ba90a022ec1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f17a92dad864e66a1f2b7fd56405e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:10:28Z,use_quota=True,user_id='96bbdbb912b143dcb5a016c5dde4920f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:10:28 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-be934373-c963-4ff7-8ba6-78420599f256 tempest-ProjectReaderTests-1033063197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a12283f-03bb-4940-ba19-d726943525f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:10:28 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-be934373-c963-4ff7-8ba6-78420599f256 tempest-ProjectReaderTests-1033063197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a12283f-03bb-4940-ba19-d726943525f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:10:28 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-be934373-c963-4ff7-8ba6-78420599f256 tempest-ProjectReaderTests-1033063197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e9ac8a-cbb8-49c8-ab1e-b09cf7eff72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:10:28 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-be934373-c963-4ff7-8ba6-78420599f256 tempest-ProjectReaderTests-1033063197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e9ac8a-cbb8-49c8-ab1e-b09cf7eff72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39235950-ca6e-498c-a178-ba90a022ec1a', 'volume_name': 'volume-39235950-ca6e-498c-a178-ba90a022ec1a', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:10:28 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-be934373-c963-4ff7-8ba6-78420599f256 tempest-ProjectReaderTests-1033063197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06e6593c-0da4-4909-947e-cb84f4be7bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:10:28 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-be934373-c963-4ff7-8ba6-78420599f256 tempest-ProjectReaderTests-1033063197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06e6593c-0da4-4909-947e-cb84f4be7bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:10:28 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-be934373-c963-4ff7-8ba6-78420599f256 tempest-ProjectReaderTests-1033063197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84565c0d-af3a-4ecd-bb1a-f7b5382b99e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:10:28 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-be934373-c963-4ff7-8ba6-78420599f256 tempest-ProjectReaderTests-1033063197 None] Volume 39235950-ca6e-498c-a178-ba90a022ec1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39235950-ca6e-498c-a178-ba90a022ec1a', 'volume_size': 1} Aug 10 13:10:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-be934373-c963-4ff7-8ba6-78420599f256 tempest-ProjectReaderTests-1033063197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:10:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-be934373-c963-4ff7-8ba6-78420599f256 tempest-ProjectReaderTests-1033063197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:10:28 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-be934373-c963-4ff7-8ba6-78420599f256 tempest-ProjectReaderTests-1033063197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T11:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1660718978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39235950-ca6e-498c-a178-ba90a022ec1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f17a92dad864e66a1f2b7fd56405e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T11:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T11:10:28Z,use_quota=True,user_id='96bbdbb912b143dcb5a016c5dde4920f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1a372b6-5e35-40ed-aae6-645f98b55d24),volume_type_id=b1a372b6-5e35-40ed-aae6-645f98b55d24)}" {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 13:10:28 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.remotefs [None req-be934373-c963-4ff7-8ba6-78420599f256 tempest-ProjectReaderTests-1033063197 None] Creating volume 39235950-ca6e-498c-a178-ba90a022ec1a {{(pid=89096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 13:10:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-be934373-c963-4ff7-8ba6-78420599f256 tempest-ProjectReaderTests-1033063197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:10:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-be934373-c963-4ff7-8ba6-78420599f256 tempest-ProjectReaderTests-1033063197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:10:28 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-be934373-c963-4ff7-8ba6-78420599f256 tempest-ProjectReaderTests-1033063197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:10:28 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-be934373-c963-4ff7-8ba6-78420599f256 tempest-ProjectReaderTests-1033063197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:10:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-be934373-c963-4ff7-8ba6-78420599f256 tempest-ProjectReaderTests-1033063197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:10:28 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-be934373-c963-4ff7-8ba6-78420599f256 tempest-ProjectReaderTests-1033063197 None] Selected osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d as target Quobyte volume. {{(pid=89096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 13:10:28 devstack cinder-volume[89096]: INFO cinder.volume.drivers.remotefs [None req-be934373-c963-4ff7-8ba6-78420599f256 tempest-ProjectReaderTests-1033063197 None] casted to osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d Aug 10 13:10:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-be934373-c963-4ff7-8ba6-78420599f256 tempest-ProjectReaderTests-1033063197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-39235950-ca6e-498c-a178-ba90a022ec1a 1073741824 {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:28 devstack sudo[110594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-39235950-ca6e-498c-a178-ba90a022ec1a 1073741824 Aug 10 13:10:28 devstack sudo[110594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:28 devstack sudo[110594]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-be934373-c963-4ff7-8ba6-78420599f256 tempest-ProjectReaderTests-1033063197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-39235950-ca6e-498c-a178-ba90a022ec1a 1073741824" returned: 0 in 0.416s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:28 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-be934373-c963-4ff7-8ba6-78420599f256 tempest-ProjectReaderTests-1033063197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-39235950-ca6e-498c-a178-ba90a022ec1a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:28 devstack sudo[110600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-39235950-ca6e-498c-a178-ba90a022ec1a Aug 10 13:10:28 devstack sudo[110600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:29 devstack sudo[110600]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-be934373-c963-4ff7-8ba6-78420599f256 tempest-ProjectReaderTests-1033063197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-39235950-ca6e-498c-a178-ba90a022ec1a" returned: 0 in 0.244s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:29 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-be934373-c963-4ff7-8ba6-78420599f256 tempest-ProjectReaderTests-1033063197 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'} {{(pid=89096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 13:10:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-be934373-c963-4ff7-8ba6-78420599f256 tempest-ProjectReaderTests-1033063197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:10:29 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-be934373-c963-4ff7-8ba6-78420599f256 tempest-ProjectReaderTests-1033063197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84565c0d-af3a-4ecd-bb1a-f7b5382b99e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39235950-ca6e-498c-a178-ba90a022ec1a', 'volume_size': 1}' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:10:29 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-be934373-c963-4ff7-8ba6-78420599f256 tempest-ProjectReaderTests-1033063197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c5ab837-3a0b-4c7b-958d-aca57696326d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 13:10:29 devstack cinder-volume[89096]: INFO cinder.volume.flows.manager.create_volume [None req-be934373-c963-4ff7-8ba6-78420599f256 tempest-ProjectReaderTests-1033063197 None] Volume volume-39235950-ca6e-498c-a178-ba90a022ec1a (39235950-ca6e-498c-a178-ba90a022ec1a): created successfully Aug 10 13:10:29 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-be934373-c963-4ff7-8ba6-78420599f256 tempest-ProjectReaderTests-1033063197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c5ab837-3a0b-4c7b-958d-aca57696326d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 13:10:29 devstack cinder-volume[89096]: DEBUG cinder.volume.manager [None req-be934373-c963-4ff7-8ba6-78420599f256 tempest-ProjectReaderTests-1033063197 None] Flow 'volume_create_manager' (8f8231b9-029a-42cd-83ca-66e33efc7e0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 13:10:29 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-be934373-c963-4ff7-8ba6-78420599f256 tempest-ProjectReaderTests-1033063197 None] Created volume successfully. Aug 10 13:10:29 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5446cc8c-1a73-478c-bf40-eb2265840e45 tempest-ProjectReaderTests-1033063197 None] Acquiring lock "cinder-39235950-ca6e-498c-a178-ba90a022ec1a-delete_volume" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:10:29 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5446cc8c-1a73-478c-bf40-eb2265840e45 tempest-ProjectReaderTests-1033063197 None] Lock "cinder-39235950-ca6e-498c-a178-ba90a022ec1a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:10:29 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5446cc8c-1a73-478c-bf40-eb2265840e45 tempest-ProjectReaderTests-1033063197 None] Acquiring lock "cinder-quobyte-39235950-ca6e-498c-a178-ba90a022ec1a" by "delete_volume" {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 13:10:29 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5446cc8c-1a73-478c-bf40-eb2265840e45 tempest-ProjectReaderTests-1033063197 None] Lock "cinder-quobyte-39235950-ca6e-498c-a178-ba90a022ec1a" acquired by "delete_volume" :: waited 0.014s {{(pid=89096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 13:10:29 devstack cinder-volume[89096]: DEBUG oslo.privsep.daemon [-] privsep: reply[effdb9b7-3118-404e-b2e1-3b718372c40b]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 13:10:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5446cc8c-1a73-478c-bf40-eb2265840e45 tempest-ProjectReaderTests-1033063197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-39235950-ca6e-498c-a178-ba90a022ec1a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:29 devstack sudo[110604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-39235950-ca6e-498c-a178-ba90a022ec1a Aug 10 13:10:29 devstack sudo[110604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:29 devstack sudo[110604]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5446cc8c-1a73-478c-bf40-eb2265840e45 tempest-ProjectReaderTests-1033063197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-39235950-ca6e-498c-a178-ba90a022ec1a" returned: 0 in 0.343s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5446cc8c-1a73-478c-bf40-eb2265840e45 tempest-ProjectReaderTests-1033063197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-39235950-ca6e-498c-a178-ba90a022ec1a {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:29 devstack sudo[110609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-39235950-ca6e-498c-a178-ba90a022ec1a Aug 10 13:10:29 devstack sudo[110609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:29 devstack sudo[110609]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:29 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5446cc8c-1a73-478c-bf40-eb2265840e45 tempest-ProjectReaderTests-1033063197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e/volume-39235950-ca6e-498c-a178-ba90a022ec1a" returned: 0 in 0.236s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:30 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5446cc8c-1a73-478c-bf40-eb2265840e45 tempest-ProjectReaderTests-1033063197 None] Lock "cinder-quobyte-39235950-ca6e-498c-a178-ba90a022ec1a" released by "delete_volume" :: held 0.615s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:10:30 devstack cinder-volume[89096]: DEBUG cinder.quota [None req-5446cc8c-1a73-478c-bf40-eb2265840e45 tempest-ProjectReaderTests-1033063197 None] Created reservations ['3a8c0b7b-f7ea-4b1b-aff4-4b82aaac5ec0', '328098d3-d353-42f8-9875-54dfb390e341', '70a488e4-c447-44eb-b98c-77f6194a421f', 'ffa9aa03-0065-4ba6-88dc-0d7ac66b6f40'] {{(pid=89096) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 13:10:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5446cc8c-1a73-478c-bf40-eb2265840e45 tempest-ProjectReaderTests-1033063197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 13:10:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5446cc8c-1a73-478c-bf40-eb2265840e45 tempest-ProjectReaderTests-1033063197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 13:10:30 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-5446cc8c-1a73-478c-bf40-eb2265840e45 tempest-ProjectReaderTests-1033063197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d': None} {{(pid=89096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 13:10:30 devstack cinder-volume[89096]: DEBUG cinder.volume.drivers.quobyte [None req-5446cc8c-1a73-478c-bf40-eb2265840e45 tempest-ProjectReaderTests-1033063197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d943b49-6876-4d31-b29a-3adb64cef09d'] {{(pid=89096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 13:10:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.lockutils [None req-5446cc8c-1a73-478c-bf40-eb2265840e45 tempest-ProjectReaderTests-1033063197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 13:10:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5446cc8c-1a73-478c-bf40-eb2265840e45 tempest-ProjectReaderTests-1033063197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 13:10:30 devstack sudo[110612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e Aug 10 13:10:30 devstack sudo[110612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 13:10:30 devstack sudo[110612]: pam_unix(sudo:session): session closed for user root Aug 10 13:10:30 devstack cinder-volume[89096]: DEBUG oslo_concurrency.processutils [None req-5446cc8c-1a73-478c-bf40-eb2265840e45 tempest-ProjectReaderTests-1033063197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30a240d0b59b2bf80035446dca859a8e" returned: 0 in 0.236s {{(pid=89096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 13:10:30 devstack cinder-volume[89096]: DEBUG cinder.manager [None req-5446cc8c-1a73-478c-bf40-eb2265840e45 tempest-ProjectReaderTests-1033063197 None] Notifying Schedulers of capabilities ... {{(pid=89096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 13:10:30 devstack cinder-volume[89096]: INFO cinder.volume.manager [None req-5446cc8c-1a73-478c-bf40-eb2265840e45 tempest-ProjectReaderTests-1033063197 None] Deleted volume successfully. Aug 10 13:10:30 devstack cinder-volume[89096]: DEBUG cinder.coordination [None req-5446cc8c-1a73-478c-bf40-eb2265840e45 tempest-ProjectReaderTests-1033063197 None] Lock "cinder-39235950-ca6e-498c-a178-ba90a022ec1a-delete_volume" released by "delete_volume" :: held 1.034s {{(pid=89096) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 13:10:40 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:SELECT=12,cinder:UPDATE=21,cinder:INSERT=3 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 13:10:40 devstack cinder-volume[89096]: DEBUG dbcounter [-] [89096] Writing DB stats cinder:UPDATE=23,cinder:SELECT=16,cinder:INSERT=7,cinder:DELETE=4 {{(pid=89096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}